[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:27:14 dist-test-slave-h3ft krb5kdc[27374](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:27:14 dist-test-slave-h3ft krb5kdc[27374](info): set up 2 sockets
Aug 09 05:27:14 dist-test-slave-h3ft krb5kdc[27374](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260809 05:27:15.791499 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.569s user 0.005s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:27:15 dist-test-slave-h3ft krb5kdc[27374](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253235, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:27:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:27:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
I20260809 05:27:16.040405 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:41071
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:39225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:41071
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:27:16.446657 27392 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:27:16.447141 27392 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:27:16.447341 27392 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:27:16.455595 27392 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:27:16.455736 27392 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:27:16.455829 27392 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:27:16.455941 27392 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:27:16.456035 27392 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:27:16.467640 27392 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:39225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:41071
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:41071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:27:16.469470 27392 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:27:16.471212 27392 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:27:16.485739 27407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:16.485832 27402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:16.485798 27410 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:16.486753 27392 server_base.cc:1034] running on GCE node
I20260809 05:27:16.487846 27392 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:27:16.489683 27392 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:27:16.490923 27392 hybrid_clock.cc:648] HybridClock initialized: now 1786253236490862 us; error 47 us; skew 500 ppm
I20260809 05:27:16.491389 27392 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:27:16 dist-test-slave-h3ft krb5kdc[27374](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253236, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:27:16.495492 27392 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:27:16.497416 27392 webserver.cc:460] Webserver started at http://127.26.185.62:32879/ using document root <none> and password file <none>
I20260809 05:27:16.498291 27392 fs_manager.cc:359] Metadata directory not provided
I20260809 05:27:16.498404 27392 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:27:16.498733 27392 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:27:16.502658 27392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "86f24872c1c349ce9cd48ecaf271c9c1"
format_stamp: "Formatted at 2026-08-09 05:27:16 on dist-test-slave-h3ft"
server_key: "4bd845484ea576b5be7a0c68290c0560"
server_key_iv: "be0a201cbbc6518f38f78cfbb5247a4e"
server_key_version: "encryptionkey@0"
I20260809 05:27:16.503608 27392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "86f24872c1c349ce9cd48ecaf271c9c1"
format_stamp: "Formatted at 2026-08-09 05:27:16 on dist-test-slave-h3ft"
server_key: "4bd845484ea576b5be7a0c68290c0560"
server_key_iv: "be0a201cbbc6518f38f78cfbb5247a4e"
server_key_version: "encryptionkey@0"
I20260809 05:27:16.509984 27392 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.003s
I20260809 05:27:16.514328 27426 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:16.516163 27392 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:27:16.516383 27392 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "86f24872c1c349ce9cd48ecaf271c9c1"
format_stamp: "Formatted at 2026-08-09 05:27:16 on dist-test-slave-h3ft"
server_key: "4bd845484ea576b5be7a0c68290c0560"
server_key_iv: "be0a201cbbc6518f38f78cfbb5247a4e"
server_key_version: "encryptionkey@0"
I20260809 05:27:16.516633 27392 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:27:16.545223 27392 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:27:16.550668 27392 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:27:16.551060 27392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:27:16.573297 27392 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:41071
I20260809 05:27:16.573305 27511 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:41071 every 8 connection(s)
I20260809 05:27:16.575042 27392 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:27:16.578337 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 27392
I20260809 05:27:16.578788 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:27:16.579887 27512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:16.581502 27364 external_mini_cluster.cc:1428] Setting key 61f26f62648f5c9f9450264203262f4a
I20260809 05:27:16.593101 27512 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86f24872c1c349ce9cd48ecaf271c9c1: Bootstrap starting.
I20260809 05:27:16.596741 27512 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 86f24872c1c349ce9cd48ecaf271c9c1: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:16.597915 27512 log.cc:824] T 00000000000000000000000000000000 P 86f24872c1c349ce9cd48ecaf271c9c1: Log is configured to *not* fsync() on all Append() calls
I20260809 05:27:16.601341 27512 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86f24872c1c349ce9cd48ecaf271c9c1: No bootstrap required, opened a new log
I20260809 05:27:16.609237 27512 raft_consensus.cc:348] T 00000000000000000000000000000000 P 86f24872c1c349ce9cd48ecaf271c9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86f24872c1c349ce9cd48ecaf271c9c1" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 41071 } }
I20260809 05:27:16.609675 27512 raft_consensus.cc:374] T 00000000000000000000000000000000 P 86f24872c1c349ce9cd48ecaf271c9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:16.609834 27512 raft_consensus.cc:729] T 00000000000000000000000000000000 P 86f24872c1c349ce9cd48ecaf271c9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f24872c1c349ce9cd48ecaf271c9c1, State: Initialized, Role: FOLLOWER
I20260809 05:27:16.610528 27512 consensus_queue.cc:260] T 00000000000000000000000000000000 P 86f24872c1c349ce9cd48ecaf271c9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86f24872c1c349ce9cd48ecaf271c9c1" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 41071 } }
I20260809 05:27:16.610828 27512 raft_consensus.cc:388] T 00000000000000000000000000000000 P 86f24872c1c349ce9cd48ecaf271c9c1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:27:16.610991 27512 raft_consensus.cc:482] T 00000000000000000000000000000000 P 86f24872c1c349ce9cd48ecaf271c9c1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:27:16.611284 27512 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 86f24872c1c349ce9cd48ecaf271c9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:16.613974 27512 raft_consensus.cc:504] T 00000000000000000000000000000000 P 86f24872c1c349ce9cd48ecaf271c9c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86f24872c1c349ce9cd48ecaf271c9c1" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 41071 } }
I20260809 05:27:16.614585 27512 leader_election.cc:302] T 00000000000000000000000000000000 P 86f24872c1c349ce9cd48ecaf271c9c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 86f24872c1c349ce9cd48ecaf271c9c1; no voters:
I20260809 05:27:16.615433 27512 leader_election.cc:288] T 00000000000000000000000000000000 P 86f24872c1c349ce9cd48ecaf271c9c1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:27:16.615561 27519 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 86f24872c1c349ce9cd48ecaf271c9c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:27:16.616878 27519 raft_consensus.cc:686] T 00000000000000000000000000000000 P 86f24872c1c349ce9cd48ecaf271c9c1 [term 1 LEADER]: Becoming Leader. State: Replica: 86f24872c1c349ce9cd48ecaf271c9c1, State: Running, Role: LEADER
Aug 09 05:27:16 dist-test-slave-h3ft krb5kdc[27374](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253235, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:16.617594 27519 consensus_queue.cc:237] T 00000000000000000000000000000000 P 86f24872c1c349ce9cd48ecaf271c9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86f24872c1c349ce9cd48ecaf271c9c1" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 41071 } }
I20260809 05:27:16.618283 27512 sys_catalog.cc:564] T 00000000000000000000000000000000 P 86f24872c1c349ce9cd48ecaf271c9c1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:27:16.621277 27521 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86f24872c1c349ce9cd48ecaf271c9c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 86f24872c1c349ce9cd48ecaf271c9c1. Latest consensus state: current_term: 1 leader_uuid: "86f24872c1c349ce9cd48ecaf271c9c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86f24872c1c349ce9cd48ecaf271c9c1" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 41071 } } }
I20260809 05:27:16.621790 27521 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86f24872c1c349ce9cd48ecaf271c9c1 [sys.catalog]: This master's current role is: LEADER
I20260809 05:27:16.625595 27520 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86f24872c1c349ce9cd48ecaf271c9c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "86f24872c1c349ce9cd48ecaf271c9c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86f24872c1c349ce9cd48ecaf271c9c1" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 41071 } } }
I20260809 05:27:16.626070 27520 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86f24872c1c349ce9cd48ecaf271c9c1 [sys.catalog]: This master's current role is: LEADER
I20260809 05:27:16.627599 27526 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:27:16.635366 27526 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:27:16.635668 27514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:16.586813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34688 (local address 127.26.185.62:41071)
0809 05:27:16.588040 (+ 1227us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:16.588065 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:16.589422 (+ 1357us) server_negotiation.cc:407] Connection header received
0809 05:27:16.600862 (+ 11440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:16.600892 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:16.601351 (+ 459us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:16.601900 (+ 549us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:16.605797 (+ 3897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:16.607636 (+ 1839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:16.609700 (+ 2064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:16.610915 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:16.611251 (+ 336us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:16.619169 (+ 7918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:16.619180 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:16.619200 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:16.619251 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:16.625350 (+ 6099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:16.626750 (+ 1400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:16.626765 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:16.626774 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:16.627188 (+ 414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:16.628025 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:16.628030 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:16.628035 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:16.629098 (+ 1063us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:16.629606 (+ 508us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:16.632972 (+ 3366us) server_negotiation.cc:299] Negotiation successful
0809 05:27:16.633665 (+ 693us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":885,"thread_start_us":595,"threads_started":1}
I20260809 05:27:16.649873 27526 catalog_manager.cc:1347] Generated new cluster ID: 62e70947368b4da4b483b0fdc4e6b5e2
I20260809 05:27:16.650050 27526 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:27:16.666510 27526 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:27:16.668213 27526 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:27:16.679352 27526 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 86f24872c1c349ce9cd48ecaf271c9c1: Generated new TSK 0
I20260809 05:27:16.680488 27526 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.185.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
I20260809 05:27:16.760138 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:0
--local_ip_for_outbound_sockets=127.26.185.1
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:41071
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:39225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:27:17.205631 27558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:27:17.206027 27558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:27:17.206140 27558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:27:17.214210 27558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:27:17.214386 27558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:27:17.214525 27558 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:27:17.226150 27558 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:39225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:41071
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:27:17.227943 27558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:27:17.229902 27558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:27:17.247248 27572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:17.247331 27569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:17.247303 27568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:17.248394 27558 server_base.cc:1034] running on GCE node
I20260809 05:27:17.249337 27558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:27:17.250694 27558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:27:17.251952 27558 hybrid_clock.cc:648] HybridClock initialized: now 1786253237251878 us; error 70 us; skew 500 ppm
I20260809 05:27:17.252381 27558 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:27:17 dist-test-slave-h3ft krb5kdc[27374](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253237, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:27:17.256443 27558 init.cc:377] Logged in from keytab as kudu/127.26.185.1@KRBTEST.COM (short username kudu)
I20260809 05:27:17.258421 27558 webserver.cc:460] Webserver started at http://127.26.185.1:44961/ using document root <none> and password file <none>
I20260809 05:27:17.259452 27558 fs_manager.cc:359] Metadata directory not provided
I20260809 05:27:17.259620 27558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:27:17.260010 27558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:27:17.263702 27558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-0/data/instance:
uuid: "dd5e4f788591426ebc60c792c43cd893"
format_stamp: "Formatted at 2026-08-09 05:27:17 on dist-test-slave-h3ft"
server_key: "c8127b10abc28e888fabd13181cef549"
server_key_iv: "47c70391998466102cffa454df6b921c"
server_key_version: "encryptionkey@0"
I20260809 05:27:17.264605 27558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance:
uuid: "dd5e4f788591426ebc60c792c43cd893"
format_stamp: "Formatted at 2026-08-09 05:27:17 on dist-test-slave-h3ft"
server_key: "c8127b10abc28e888fabd13181cef549"
server_key_iv: "47c70391998466102cffa454df6b921c"
server_key_version: "encryptionkey@0"
I20260809 05:27:17.270937 27558 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260809 05:27:17.275298 27581 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:17.276983 27558 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 05:27:17.277207 27558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "dd5e4f788591426ebc60c792c43cd893"
format_stamp: "Formatted at 2026-08-09 05:27:17 on dist-test-slave-h3ft"
server_key: "c8127b10abc28e888fabd13181cef549"
server_key_iv: "47c70391998466102cffa454df6b921c"
server_key_version: "encryptionkey@0"
I20260809 05:27:17.277460 27558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:27:17.293627 27558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:27:17.298743 27558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:27:17.299188 27558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:27:17.300424 27558 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:27:17.302114 27558 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:27:17.302229 27558 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:17.302392 27558 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:27:17.302485 27558 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:17.340658 27558 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:34191
I20260809 05:27:17.340675 27760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:34191 every 8 connection(s)
I20260809 05:27:17.342470 27558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:27:17.351384 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 27558
I20260809 05:27:17.351680 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance
I20260809 05:27:17.352476 27364 external_mini_cluster.cc:1428] Setting key e238513a81e8a4a2a581fb1babe4df63
Aug 09 05:27:17 dist-test-slave-h3ft krb5kdc[27374](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253237, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:17.368415 27765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:17.346059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:43177 (local address 127.26.185.62:41071)
0809 05:27:17.346673 (+ 614us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:17.346681 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:17.347983 (+ 1302us) server_negotiation.cc:407] Connection header received
0809 05:27:17.350062 (+ 2079us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:17.350067 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:17.350158 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:17.350271 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:17.352379 (+ 2108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:17.353527 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:17.355749 (+ 2222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:17.356459 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:17.356610 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:17.360810 (+ 4200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:17.360820 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:17.360828 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:17.360881 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:17.364381 (+ 3500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:17.365262 (+ 881us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:17.365272 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:17.365279 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:17.365466 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:17.365942 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:17.365949 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:17.365955 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:17.366417 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:17.366587 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:17.367528 (+ 941us) server_negotiation.cc:299] Negotiation successful
0809 05:27:17.367841 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":440,"thread_start_us":292,"threads_started":1}
I20260809 05:27:17.369304 27766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:17.346866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:41071 (local address 127.26.185.1:43177)
0809 05:27:17.347785 (+ 919us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:17.347841 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:17.349741 (+ 1900us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:17.350520 (+ 779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:17.350530 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:17.351360 (+ 830us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:27:17.352161 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:17.352181 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:17.353702 (+ 1521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:17.353706 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:17.355592 (+ 1886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:17.355605 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:17.356717 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:17.356723 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:17.356950 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:17.357820 (+ 870us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:27:17.357848 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:27:17.360493 (+ 2645us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:27:17.364578 (+ 4085us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:17.364587 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:17.364606 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:17.365114 (+ 508us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:17.365585 (+ 471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:17.365589 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:17.365591 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:17.365809 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:17.366566 (+ 757us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:27:17.366574 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:27:17.366992 (+ 418us) client_negotiation.cc:769] Sending connection context
0809 05:27:17.367355 (+ 363us) client_negotiation.cc:240] Negotiation successful
0809 05:27:17.367885 (+ 530us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":646,"thread_start_us":334,"threads_started":1}
I20260809 05:27:17.371357 27762 heartbeater.cc:347] Connected to a master server at 127.26.185.62:41071
I20260809 05:27:17.371763 27762 heartbeater.cc:464] Registering TS with master...
I20260809 05:27:17.372797 27762 heartbeater.cc:511] Master 127.26.185.62:41071 requested a full tablet report, sending...
I20260809 05:27:17.376019 27455 ts_manager.cc:194] Registered new tserver with Master: dd5e4f788591426ebc60c792c43cd893 (127.26.185.1:34191)
WARNING: no policy specified for kudu/127.26.185.2@KRBTEST.COM; defaulting to no policy
I20260809 05:27:17.377916 27455 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.1@KRBTEST.COM'} at 127.26.185.1:43177
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
I20260809 05:27:17.410799 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:0
--local_ip_for_outbound_sockets=127.26.185.2
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:41071
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:39225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:27:17.836824 27770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:27:17.837252 27770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:27:17.837464 27770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:27:17.846539 27770 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:27:17.846688 27770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:27:17.846907 27770 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:27:17.858615 27770 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:39225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:41071
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:27:17.860518 27770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:27:17.862264 27770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:27:17.879101 27780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:17.878988 27782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:17.879145 27778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:17.884425 27770 server_base.cc:1034] running on GCE node
I20260809 05:27:17.885363 27770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:27:17.886665 27770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:27:17.887931 27770 hybrid_clock.cc:648] HybridClock initialized: now 1786253237887840 us; error 88 us; skew 500 ppm
I20260809 05:27:17.888334 27770 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:27:17 dist-test-slave-h3ft krb5kdc[27374](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253237, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:27:17.892361 27770 init.cc:377] Logged in from keytab as kudu/127.26.185.2@KRBTEST.COM (short username kudu)
I20260809 05:27:17.894229 27770 webserver.cc:460] Webserver started at http://127.26.185.2:35093/ using document root <none> and password file <none>
I20260809 05:27:17.895272 27770 fs_manager.cc:359] Metadata directory not provided
I20260809 05:27:17.895440 27770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:27:17.895825 27770 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:27:17.899536 27770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-1/data/instance:
uuid: "2ae302774aa04213adbf034025bc8101"
format_stamp: "Formatted at 2026-08-09 05:27:17 on dist-test-slave-h3ft"
server_key: "b46fff5d91e85dcf8c877e4d8b27842f"
server_key_iv: "92501fcd8bf71de71d0a9469dcd2d33c"
server_key_version: "encryptionkey@0"
I20260809 05:27:17.900442 27770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance:
uuid: "2ae302774aa04213adbf034025bc8101"
format_stamp: "Formatted at 2026-08-09 05:27:17 on dist-test-slave-h3ft"
server_key: "b46fff5d91e85dcf8c877e4d8b27842f"
server_key_iv: "92501fcd8bf71de71d0a9469dcd2d33c"
server_key_version: "encryptionkey@0"
I20260809 05:27:17.906870 27770 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260809 05:27:17.911149 27795 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:17.912814 27770 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 05:27:17.913028 27770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "2ae302774aa04213adbf034025bc8101"
format_stamp: "Formatted at 2026-08-09 05:27:17 on dist-test-slave-h3ft"
server_key: "b46fff5d91e85dcf8c877e4d8b27842f"
server_key_iv: "92501fcd8bf71de71d0a9469dcd2d33c"
server_key_version: "encryptionkey@0"
I20260809 05:27:17.913291 27770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:27:17.929592 27770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:27:17.935263 27770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:27:17.935645 27770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:27:17.936913 27770 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:27:17.938601 27770 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:27:17.938715 27770 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:17.938882 27770 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:27:17.938964 27770 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:17.980643 27770 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:36685
I20260809 05:27:17.980697 27971 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:36685 every 8 connection(s)
I20260809 05:27:17.982570 27770 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:27:17.989080 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 27770
I20260809 05:27:17.989342 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance
I20260809 05:27:17.989990 27364 external_mini_cluster.cc:1428] Setting key 9e45d577bbc277e5a6ad5467a10dae05
Aug 09 05:27:17 dist-test-slave-h3ft krb5kdc[27374](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253237, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:18.011626 27974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:17.986099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:59885 (local address 127.26.185.62:41071)
0809 05:27:17.986714 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:17.986723 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:17.987978 (+ 1255us) server_negotiation.cc:407] Connection header received
0809 05:27:17.990953 (+ 2975us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:17.990960 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:17.991118 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:17.991263 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:17.993683 (+ 2420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:17.994489 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:17.997360 (+ 2871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:17.997860 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:17.997969 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:18.002909 (+ 4940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:18.002918 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:18.002926 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:18.002982 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:18.007355 (+ 4373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:18.008289 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:18.008299 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:18.008306 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:18.008500 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:18.009036 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:18.009044 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:18.009050 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:18.009517 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:18.009688 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:18.010649 (+ 961us) server_negotiation.cc:299] Negotiation successful
0809 05:27:18.010994 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":278,"threads_started":1}
I20260809 05:27:18.012809 27975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:17.986757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:41071 (local address 127.26.185.2:59885)
0809 05:27:17.987761 (+ 1004us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:17.987809 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:17.990513 (+ 2704us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:17.991638 (+ 1125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:17.991650 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:17.992415 (+ 765us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:27:17.993456 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:17.993491 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:17.994672 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:17.994682 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:17.997192 (+ 2510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:17.997212 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:17.998128 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:17.998139 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:17.998500 (+ 361us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:17.999477 (+ 977us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:27:17.999516 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:27:18.002618 (+ 3102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:27:18.007544 (+ 4926us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:18.007554 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:18.007573 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:18.008126 (+ 553us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:18.008631 (+ 505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:18.008635 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:18.008638 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:18.008884 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:18.009672 (+ 788us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:27:18.009680 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:27:18.010181 (+ 501us) client_negotiation.cc:769] Sending connection context
0809 05:27:18.010484 (+ 303us) client_negotiation.cc:240] Negotiation successful
0809 05:27:18.011130 (+ 646us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":704,"thread_start_us":437,"threads_started":1}
I20260809 05:27:18.014964 27972 heartbeater.cc:347] Connected to a master server at 127.26.185.62:41071
I20260809 05:27:18.015529 27972 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.26.185.3@KRBTEST.COM; defaulting to no policy
I20260809 05:27:18.016647 27972 heartbeater.cc:511] Master 127.26.185.62:41071 requested a full tablet report, sending...
I20260809 05:27:18.019133 27455 ts_manager.cc:194] Registered new tserver with Master: 2ae302774aa04213adbf034025bc8101 (127.26.185.2:36685)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.3@KRBTEST.COM" created.
I20260809 05:27:18.020398 27455 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.2@KRBTEST.COM'} at 127.26.185.2:59885
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
I20260809 05:27:18.050748 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:0
--local_ip_for_outbound_sockets=127.26.185.3
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:41071
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:39225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:27:18.382846 27762 heartbeater.cc:503] Master 127.26.185.62:41071 was elected leader, sending a full tablet report...
W20260809 05:27:18.468449 27979 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:27:18.468868 27979 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:27:18.468986 27979 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:27:18.477167 27979 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:27:18.477312 27979 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:27:18.477448 27979 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:27:18.488847 27979 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:39225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:41071
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:27:18.490604 27979 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:27:18.492511 27979 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:27:18.508872 27989 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:18.508809 27991 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:18.509469 27988 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:18.510188 27979 server_base.cc:1034] running on GCE node
I20260809 05:27:18.510943 27979 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:27:18.512319 27979 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:27:18.513612 27979 hybrid_clock.cc:648] HybridClock initialized: now 1786253238513542 us; error 49 us; skew 500 ppm
I20260809 05:27:18.514024 27979 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:27:18 dist-test-slave-h3ft krb5kdc[27374](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253238, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:27:18.518023 27979 init.cc:377] Logged in from keytab as kudu/127.26.185.3@KRBTEST.COM (short username kudu)
I20260809 05:27:18.520259 27979 webserver.cc:460] Webserver started at http://127.26.185.3:33043/ using document root <none> and password file <none>
I20260809 05:27:18.521217 27979 fs_manager.cc:359] Metadata directory not provided
I20260809 05:27:18.521376 27979 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:27:18.521767 27979 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:27:18.525367 27979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-2/data/instance:
uuid: "0d0e48a748d44141a351ebddb42852a7"
format_stamp: "Formatted at 2026-08-09 05:27:18 on dist-test-slave-h3ft"
server_key: "e795a0099d11d4105f7083d43742824e"
server_key_iv: "b63f496a4b6c44b5b3da985dcd2acf99"
server_key_version: "encryptionkey@0"
I20260809 05:27:18.526261 27979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance:
uuid: "0d0e48a748d44141a351ebddb42852a7"
format_stamp: "Formatted at 2026-08-09 05:27:18 on dist-test-slave-h3ft"
server_key: "e795a0099d11d4105f7083d43742824e"
server_key_iv: "b63f496a4b6c44b5b3da985dcd2acf99"
server_key_version: "encryptionkey@0"
I20260809 05:27:18.533115 27979 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260809 05:27:18.537847 28004 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:18.539781 27979 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260809 05:27:18.540022 27979 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "0d0e48a748d44141a351ebddb42852a7"
format_stamp: "Formatted at 2026-08-09 05:27:18 on dist-test-slave-h3ft"
server_key: "e795a0099d11d4105f7083d43742824e"
server_key_iv: "b63f496a4b6c44b5b3da985dcd2acf99"
server_key_version: "encryptionkey@0"
I20260809 05:27:18.540302 27979 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:27:18.561878 27979 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:27:18.567308 27979 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:27:18.567685 27979 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:27:18.568988 27979 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:27:18.570772 27979 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:27:18.570859 27979 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:18.571034 27979 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:27:18.571091 27979 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260809 05:27:18.613098 27979 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:43545
I20260809 05:27:18.613166 28182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:43545 every 8 connection(s)
I20260809 05:27:18.614758 27979 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:27:18.618871 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 27979
I20260809 05:27:18.619244 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance
I20260809 05:27:18.619841 27364 external_mini_cluster.cc:1428] Setting key cdbf8a23b73bfe3a755aa9fe1d68a864
Aug 09 05:27:18 dist-test-slave-h3ft krb5kdc[27374](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253238, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:18.640791 28189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:18.618199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:51171 (local address 127.26.185.62:41071)
0809 05:27:18.618911 (+ 712us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:18.618919 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:18.620627 (+ 1708us) server_negotiation.cc:407] Connection header received
0809 05:27:18.623139 (+ 2512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:18.623145 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:18.623240 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:18.623376 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:18.625473 (+ 2097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:18.626336 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:18.628105 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:18.628595 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:18.628696 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:18.633084 (+ 4388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:18.633091 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:18.633094 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:18.633137 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:18.636684 (+ 3547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:18.637724 (+ 1040us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:18.637733 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:18.637742 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:18.637945 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:18.638509 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:18.638515 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:18.638519 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:18.638882 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:18.639096 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:18.639998 (+ 902us) server_negotiation.cc:299] Negotiation successful
0809 05:27:18.640272 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":506,"thread_start_us":277,"threads_started":1}
I20260809 05:27:18.642251 28190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:18.619198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:41071 (local address 127.26.185.3:51171)
0809 05:27:18.620358 (+ 1160us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:18.620430 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:18.622775 (+ 2345us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:18.623618 (+ 843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:18.623627 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:18.624566 (+ 939us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:27:18.625294 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:18.625315 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:18.626495 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:18.626500 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:18.627964 (+ 1464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:18.627978 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:18.628812 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:18.628816 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:18.629127 (+ 311us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:18.629980 (+ 853us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:27:18.630013 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:27:18.632819 (+ 2806us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:27:18.636929 (+ 4110us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:18.636940 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:18.636960 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:18.637558 (+ 598us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:18.638094 (+ 536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:18.638102 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:18.638110 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:18.638366 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:18.639055 (+ 689us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:27:18.639066 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:27:18.639550 (+ 484us) client_negotiation.cc:769] Sending connection context
0809 05:27:18.639905 (+ 355us) client_negotiation.cc:240] Negotiation successful
0809 05:27:18.640632 (+ 727us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":755,"thread_start_us":461,"threads_started":1}
I20260809 05:27:18.644093 28184 heartbeater.cc:347] Connected to a master server at 127.26.185.62:41071
I20260809 05:27:18.644524 28184 heartbeater.cc:464] Registering TS with master...
I20260809 05:27:18.645653 28184 heartbeater.cc:511] Master 127.26.185.62:41071 requested a full tablet report, sending...
I20260809 05:27:18.647507 27455 ts_manager.cc:194] Registered new tserver with Master: 0d0e48a748d44141a351ebddb42852a7 (127.26.185.3:43545)
I20260809 05:27:18.648708 27455 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.3@KRBTEST.COM'} at 127.26.185.3:51171
I20260809 05:27:18.650717 27364 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 05:27:18 dist-test-slave-h3ft krb5kdc[27374](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253238, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 05:27:18 dist-test-slave-h3ft krb5kdc[27374](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253238, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.185.1@KRBTEST.COM
I20260809 05:27:18.711795 28197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:18.693286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49776 (local address 127.26.185.1:34191)
0809 05:27:18.694087 (+ 801us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:18.694097 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:18.694136 (+ 39us) server_negotiation.cc:407] Connection header received
0809 05:27:18.694361 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:18.694370 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:18.694684 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:18.694853 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:18.696630 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:18.697805 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:18.699239 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:18.699903 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:18.700010 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:18.705123 (+ 5113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:18.705139 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:18.705160 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:18.705211 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:18.708679 (+ 3468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:18.709402 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:18.709411 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:18.709413 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:18.709653 (+ 240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:18.710047 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:18.710050 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:18.710052 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:18.710462 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:18.710746 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:18.711058 (+ 312us) server_negotiation.cc:299] Negotiation successful
0809 05:27:18.711319 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":619,"thread_start_us":402,"threads_started":1}
W20260809 05:27:18.713531 27626 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49776
Aug 09 05:27:18 dist-test-slave-h3ft krb5kdc[27374](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253238, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 05:27:18 dist-test-slave-h3ft krb5kdc[27374](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253238, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.1@KRBTEST.COM
I20260809 05:27:18.776430 28197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:18.760213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49790 (local address 127.26.185.1:34191)
0809 05:27:18.760489 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:18.760498 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:18.760656 (+ 158us) server_negotiation.cc:407] Connection header received
0809 05:27:18.760973 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:18.760977 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:18.761064 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:18.761187 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:18.762807 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:18.763705 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:18.765111 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:18.765589 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:18.765736 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:18.770472 (+ 4736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:18.770478 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:18.770482 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:18.770526 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:18.773616 (+ 3090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:18.774353 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:18.774358 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:18.774360 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:18.774572 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:18.774925 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:18.774928 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:18.774931 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:18.775292 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:18.775512 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:18.775880 (+ 368us) server_negotiation.cc:299] Negotiation successful
0809 05:27:18.776090 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260809 05:27:18.778479 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 27558
I20260809 05:27:18.793606 28197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:18.779828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49794 (local address 127.26.185.1:34191)
0809 05:27:18.780088 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:18.780095 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:18.780271 (+ 176us) server_negotiation.cc:407] Connection header received
0809 05:27:18.780415 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:18.780419 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:18.780480 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:18.780566 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:18.781997 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:18.782894 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:18.784425 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:18.784889 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:18.784987 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:18.787627 (+ 2640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:18.787632 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:18.787635 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:18.787667 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:18.790388 (+ 2721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:18.791214 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:18.791220 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:18.791222 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:18.791424 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:18.791838 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:18.791842 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:18.791845 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:18.792306 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:18.792547 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:18.792868 (+ 321us) server_negotiation.cc:299] Negotiation successful
0809 05:27:18.793074 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260809 05:27:18.794595 27746 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:27:18.895381 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 27558
I20260809 05:27:18.927057 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 27770
Aug 09 05:27:18 dist-test-slave-h3ft krb5kdc[27374](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253238, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.2@KRBTEST.COM
I20260809 05:27:18.946431 28208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:18.928317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54008 (local address 127.26.185.2:36685)
0809 05:27:18.929009 (+ 692us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:18.929019 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:18.929052 (+ 33us) server_negotiation.cc:407] Connection header received
0809 05:27:18.929132 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:18.929140 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:18.929419 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:18.929576 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:18.931244 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:18.932428 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:18.933822 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:18.934510 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:18.934627 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:18.939717 (+ 5090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:18.939738 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:18.939761 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:18.939818 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:18.943255 (+ 3437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:18.944046 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:18.944055 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:18.944057 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:18.944200 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:18.944570 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:18.944574 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:18.944576 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:18.944996 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:18.945266 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:18.945781 (+ 515us) server_negotiation.cc:299] Negotiation successful
0809 05:27:18.946030 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":489,"thread_start_us":354,"threads_started":1}
I20260809 05:27:18.948282 27966 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:27:19.041103 27972 heartbeater.cc:503] Master 127.26.185.62:41071 was elected leader, sending a full tablet report...
I20260809 05:27:19.042604 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 27770
W20260809 05:27:19.073523 27431 connection.cc:535] server connection from 127.26.185.2:59885 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 05:27:19.073722 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 27979
Aug 09 05:27:19 dist-test-slave-h3ft krb5kdc[27374](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253238, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.3@KRBTEST.COM
I20260809 05:27:19.100091 28214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:19.075397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39874 (local address 127.26.185.3:43545)
0809 05:27:19.076632 (+ 1235us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:19.076646 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:19.076700 (+ 54us) server_negotiation.cc:407] Connection header received
0809 05:27:19.076833 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:19.076843 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:19.077159 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:19.077395 (+ 236us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:19.079074 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:19.080796 (+ 1722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:19.083540 (+ 2744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:19.085087 (+ 1547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:19.085298 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:19.092320 (+ 7022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:19.092344 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:19.092368 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:19.092431 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:19.096345 (+ 3914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:19.097466 (+ 1121us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:19.097478 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:19.097481 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:19.097681 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:19.098142 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:19.098147 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:19.098149 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:19.098675 (+ 526us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:19.098979 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:19.099405 (+ 426us) server_negotiation.cc:299] Negotiation successful
0809 05:27:19.099712 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":975,"thread_start_us":718,"threads_started":1}
I20260809 05:27:19.102396 28176 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:27:19.196480 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 27979
I20260809 05:27:19.226943 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 27392
I20260809 05:27:19.228782 27507 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:27:19.349100 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 27392
2026-08-09T05:27:19Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (5199 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:27:19 dist-test-slave-h3ft krb5kdc[28224](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:27:19 dist-test-slave-h3ft krb5kdc[28224](info): set up 2 sockets
Aug 09 05:27:19 dist-test-slave-h3ft krb5kdc[28224](info): commencing operation
krb5kdc: starting...
W20260809 05:27:20.723405 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.316s user 0.001s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:27:20 dist-test-slave-h3ft krb5kdc[28224](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253240, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:27:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:27:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
I20260809 05:27:20.972421 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:38721
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:34525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:38721
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:27:21.371282 28250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:27:21.371630 28250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:27:21.371819 28250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:27:21.379420 28250 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:27:21.379539 28250 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:27:21.379655 28250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:27:21.379766 28250 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:27:21.379834 28250 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:27:21.390259 28250 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:34525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:38721
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:38721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:27:21.391996 28250 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:27:21.393728 28250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:27:21.407639 28256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:21.407713 28257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:21.407686 28261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:21.412776 28250 server_base.cc:1034] running on GCE node
I20260809 05:27:21.414079 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:27:21.416245 28250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:27:21.417524 28250 hybrid_clock.cc:648] HybridClock initialized: now 1786253241417498 us; error 63 us; skew 500 ppm
I20260809 05:27:21.417949 28250 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:27:21 dist-test-slave-h3ft krb5kdc[28224](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253241, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:27:21.421684 28250 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:27:21.423707 28250 webserver.cc:460] Webserver started at http://127.26.185.62:38099/ using document root <none> and password file <none>
I20260809 05:27:21.424605 28250 fs_manager.cc:359] Metadata directory not provided
I20260809 05:27:21.424769 28250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:27:21.425171 28250 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:27:21.428892 28250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "ce12afdad2f54f7f8d7c451e50568b13"
format_stamp: "Formatted at 2026-08-09 05:27:21 on dist-test-slave-h3ft"
server_key: "6e2c138561dbe9fba18627fd9c6c9c0b"
server_key_iv: "ee3b473b661afb1ff8f2ddfa95b95f00"
server_key_version: "encryptionkey@0"
I20260809 05:27:21.429769 28250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "ce12afdad2f54f7f8d7c451e50568b13"
format_stamp: "Formatted at 2026-08-09 05:27:21 on dist-test-slave-h3ft"
server_key: "6e2c138561dbe9fba18627fd9c6c9c0b"
server_key_iv: "ee3b473b661afb1ff8f2ddfa95b95f00"
server_key_version: "encryptionkey@0"
I20260809 05:27:21.436094 28250 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260809 05:27:21.440162 28272 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:21.441685 28250 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 05:27:21.441887 28250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "ce12afdad2f54f7f8d7c451e50568b13"
format_stamp: "Formatted at 2026-08-09 05:27:21 on dist-test-slave-h3ft"
server_key: "6e2c138561dbe9fba18627fd9c6c9c0b"
server_key_iv: "ee3b473b661afb1ff8f2ddfa95b95f00"
server_key_version: "encryptionkey@0"
I20260809 05:27:21.442121 28250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:27:21.462916 28250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:27:21.467875 28250 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:27:21.468228 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:27:21.491715 28250 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:38721
I20260809 05:27:21.491739 28355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:38721 every 8 connection(s)
I20260809 05:27:21.493681 28250 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:27:21.498637 28357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:21.500037 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 28250
I20260809 05:27:21.500384 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:27:21.501197 27364 external_mini_cluster.cc:1428] Setting key 440639af4bf1c3d18bac0dd7b646b621
I20260809 05:27:21.515683 28357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce12afdad2f54f7f8d7c451e50568b13: Bootstrap starting.
Aug 09 05:27:21 dist-test-slave-h3ft krb5kdc[28224](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253240, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:21.519744 28357 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce12afdad2f54f7f8d7c451e50568b13: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:21.521451 28357 log.cc:824] T 00000000000000000000000000000000 P ce12afdad2f54f7f8d7c451e50568b13: Log is configured to *not* fsync() on all Append() calls
I20260809 05:27:21.525646 28357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce12afdad2f54f7f8d7c451e50568b13: No bootstrap required, opened a new log
I20260809 05:27:21.529738 28362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:21.503923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42654 (local address 127.26.185.62:38721)
0809 05:27:21.504990 (+ 1067us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:21.505011 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:21.505076 (+ 65us) server_negotiation.cc:407] Connection header received
0809 05:27:21.507174 (+ 2098us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:21.507211 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:21.507874 (+ 663us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:21.508367 (+ 493us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:21.510143 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:21.512425 (+ 2282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:21.513885 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:21.514996 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:21.515236 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:21.520045 (+ 4809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:21.520057 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:21.520081 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:21.520183 (+ 102us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:21.524398 (+ 4215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:21.525175 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:21.525183 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:21.525193 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:21.525418 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:21.525812 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:21.525817 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:21.525820 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:21.526660 (+ 840us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:21.526986 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:21.527532 (+ 546us) server_negotiation.cc:299] Negotiation successful
0809 05:27:21.528058 (+ 526us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":744,"thread_start_us":488,"threads_started":1}
I20260809 05:27:21.536098 28357 raft_consensus.cc:348] T 00000000000000000000000000000000 P ce12afdad2f54f7f8d7c451e50568b13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce12afdad2f54f7f8d7c451e50568b13" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 38721 } }
I20260809 05:27:21.536540 28357 raft_consensus.cc:374] T 00000000000000000000000000000000 P ce12afdad2f54f7f8d7c451e50568b13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:21.536630 28357 raft_consensus.cc:729] T 00000000000000000000000000000000 P ce12afdad2f54f7f8d7c451e50568b13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce12afdad2f54f7f8d7c451e50568b13, State: Initialized, Role: FOLLOWER
I20260809 05:27:21.537323 28357 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce12afdad2f54f7f8d7c451e50568b13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce12afdad2f54f7f8d7c451e50568b13" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 38721 } }
I20260809 05:27:21.537652 28357 raft_consensus.cc:388] T 00000000000000000000000000000000 P ce12afdad2f54f7f8d7c451e50568b13 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:27:21.537815 28357 raft_consensus.cc:482] T 00000000000000000000000000000000 P ce12afdad2f54f7f8d7c451e50568b13 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:27:21.538054 28357 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ce12afdad2f54f7f8d7c451e50568b13 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:21.540723 28357 raft_consensus.cc:504] T 00000000000000000000000000000000 P ce12afdad2f54f7f8d7c451e50568b13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce12afdad2f54f7f8d7c451e50568b13" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 38721 } }
I20260809 05:27:21.541270 28357 leader_election.cc:302] T 00000000000000000000000000000000 P ce12afdad2f54f7f8d7c451e50568b13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ce12afdad2f54f7f8d7c451e50568b13; no voters:
I20260809 05:27:21.541976 28357 leader_election.cc:288] T 00000000000000000000000000000000 P ce12afdad2f54f7f8d7c451e50568b13 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:27:21.542251 28364 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ce12afdad2f54f7f8d7c451e50568b13 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:27:21.542991 28364 raft_consensus.cc:686] T 00000000000000000000000000000000 P ce12afdad2f54f7f8d7c451e50568b13 [term 1 LEADER]: Becoming Leader. State: Replica: ce12afdad2f54f7f8d7c451e50568b13, State: Running, Role: LEADER
I20260809 05:27:21.543721 28364 consensus_queue.cc:237] T 00000000000000000000000000000000 P ce12afdad2f54f7f8d7c451e50568b13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce12afdad2f54f7f8d7c451e50568b13" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 38721 } }
I20260809 05:27:21.544579 28357 sys_catalog.cc:564] T 00000000000000000000000000000000 P ce12afdad2f54f7f8d7c451e50568b13 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:27:21.547237 28367 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce12afdad2f54f7f8d7c451e50568b13 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce12afdad2f54f7f8d7c451e50568b13. Latest consensus state: current_term: 1 leader_uuid: "ce12afdad2f54f7f8d7c451e50568b13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce12afdad2f54f7f8d7c451e50568b13" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 38721 } } }
I20260809 05:27:21.547204 28366 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce12afdad2f54f7f8d7c451e50568b13 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ce12afdad2f54f7f8d7c451e50568b13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce12afdad2f54f7f8d7c451e50568b13" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 38721 } } }
I20260809 05:27:21.547744 28367 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce12afdad2f54f7f8d7c451e50568b13 [sys.catalog]: This master's current role is: LEADER
I20260809 05:27:21.547756 28366 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce12afdad2f54f7f8d7c451e50568b13 [sys.catalog]: This master's current role is: LEADER
I20260809 05:27:21.548869 28373 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:27:21.556516 28373 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:27:21.566890 28373 catalog_manager.cc:1347] Generated new cluster ID: 322a19285d1b454285c15960e77a5174
I20260809 05:27:21.567080 28373 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:27:21.588086 28373 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:27:21.589664 28373 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:27:21.599535 28373 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ce12afdad2f54f7f8d7c451e50568b13: Generated new TSK 0
I20260809 05:27:21.600750 28373 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.185.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
I20260809 05:27:21.671873 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:0
--local_ip_for_outbound_sockets=127.26.185.1
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:38721
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:34525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:27:22.109159 28400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:27:22.109537 28400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:27:22.109651 28400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:27:22.117935 28400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:27:22.118072 28400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:27:22.118199 28400 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:27:22.129042 28400 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:34525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:38721
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:27:22.130708 28400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:27:22.132357 28400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:27:22.148504 28409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:22.148556 28412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:22.148614 28414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:22.149784 28400 server_base.cc:1034] running on GCE node
I20260809 05:27:22.150579 28400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:27:22.151861 28400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:27:22.153112 28400 hybrid_clock.cc:648] HybridClock initialized: now 1786253242153041 us; error 63 us; skew 500 ppm
I20260809 05:27:22.153503 28400 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:27:22 dist-test-slave-h3ft krb5kdc[28224](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253242, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:27:22.157400 28400 init.cc:377] Logged in from keytab as kudu/127.26.185.1@KRBTEST.COM (short username kudu)
I20260809 05:27:22.159300 28400 webserver.cc:460] Webserver started at http://127.26.185.1:40513/ using document root <none> and password file <none>
I20260809 05:27:22.160164 28400 fs_manager.cc:359] Metadata directory not provided
I20260809 05:27:22.160326 28400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:27:22.160713 28400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:27:22.164227 28400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-0/data/instance:
uuid: "df00fc6b29b94917b88cc86e23bbe6cf"
format_stamp: "Formatted at 2026-08-09 05:27:22 on dist-test-slave-h3ft"
server_key: "03844dc748ecbcc8631f4514919c9ba6"
server_key_iv: "7ca58af3ff22471124a85387c6614d07"
server_key_version: "encryptionkey@0"
I20260809 05:27:22.165132 28400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance:
uuid: "df00fc6b29b94917b88cc86e23bbe6cf"
format_stamp: "Formatted at 2026-08-09 05:27:22 on dist-test-slave-h3ft"
server_key: "03844dc748ecbcc8631f4514919c9ba6"
server_key_iv: "7ca58af3ff22471124a85387c6614d07"
server_key_version: "encryptionkey@0"
I20260809 05:27:22.171547 28400 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260809 05:27:22.175714 28433 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:22.177294 28400 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 05:27:22.177490 28400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "df00fc6b29b94917b88cc86e23bbe6cf"
format_stamp: "Formatted at 2026-08-09 05:27:22 on dist-test-slave-h3ft"
server_key: "03844dc748ecbcc8631f4514919c9ba6"
server_key_iv: "7ca58af3ff22471124a85387c6614d07"
server_key_version: "encryptionkey@0"
I20260809 05:27:22.177716 28400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:27:22.193933 28400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:27:22.199064 28400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:27:22.199416 28400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:27:22.200563 28400 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:27:22.202178 28400 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:27:22.202307 28400 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:22.202486 28400 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:27:22.202569 28400 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:22.245941 28400 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:46011
I20260809 05:27:22.245968 28608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:46011 every 8 connection(s)
I20260809 05:27:22.248051 28400 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:27:22.250356 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 28400
I20260809 05:27:22.250658 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance
I20260809 05:27:22.251621 27364 external_mini_cluster.cc:1428] Setting key 29ae67ed62c696e249356f3ebbb6b18c
Aug 09 05:27:22 dist-test-slave-h3ft krb5kdc[28224](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253242, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.185.2@KRBTEST.COM; defaulting to no policy
I20260809 05:27:22.278796 28615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:22.252202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:48767 (local address 127.26.185.62:38721)
0809 05:27:22.252975 (+ 773us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:22.252985 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:22.254639 (+ 1654us) server_negotiation.cc:407] Connection header received
0809 05:27:22.257123 (+ 2484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:22.257133 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:22.257259 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:22.257435 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:22.259817 (+ 2382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:22.261212 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:22.263900 (+ 2688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:22.264564 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:22.264745 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:22.269866 (+ 5121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:22.269880 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:22.269890 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:22.269955 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:22.274579 (+ 4624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:22.275685 (+ 1106us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:22.275692 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:22.275700 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:22.275908 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:22.276406 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:22.276412 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:22.276418 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:22.276918 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:22.277122 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:22.277982 (+ 860us) server_negotiation.cc:299] Negotiation successful
0809 05:27:22.278317 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":596,"thread_start_us":403,"threads_started":1}
I20260809 05:27:22.279739 28618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:22.253235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:38721 (local address 127.26.185.1:48767)
0809 05:27:22.254394 (+ 1159us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:22.254477 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:22.256751 (+ 2274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:22.257715 (+ 964us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:22.257733 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:22.258626 (+ 893us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:27:22.259589 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:22.259617 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:22.261417 (+ 1800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:22.261425 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:22.263715 (+ 2290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:22.263730 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:22.264884 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:22.264893 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:22.265189 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:22.266201 (+ 1012us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:27:22.266233 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:27:22.269516 (+ 3283us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:27:22.274773 (+ 5257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:22.274783 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:22.274803 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:22.275517 (+ 714us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:22.276055 (+ 538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:22.276059 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:22.276062 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:22.276269 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:22.277069 (+ 800us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:27:22.277076 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:27:22.277487 (+ 411us) client_negotiation.cc:769] Sending connection context
0809 05:27:22.277755 (+ 268us) client_negotiation.cc:240] Negotiation successful
0809 05:27:22.278259 (+ 504us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":748,"thread_start_us":427,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.2@KRBTEST.COM" created.
I20260809 05:27:22.282271 28609 heartbeater.cc:347] Connected to a master server at 127.26.185.62:38721
I20260809 05:27:22.282711 28609 heartbeater.cc:464] Registering TS with master...
I20260809 05:27:22.283842 28609 heartbeater.cc:511] Master 127.26.185.62:38721 requested a full tablet report, sending...
I20260809 05:27:22.287231 28301 ts_manager.cc:194] Registered new tserver with Master: df00fc6b29b94917b88cc86e23bbe6cf (127.26.185.1:46011)
I20260809 05:27:22.289959 28301 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.1@KRBTEST.COM'} at 127.26.185.1:48767
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
I20260809 05:27:22.316102 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:0
--local_ip_for_outbound_sockets=127.26.185.2
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:38721
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:34525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:27:22.726459 28622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:27:22.726929 28622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:27:22.727155 28622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:27:22.735386 28622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:27:22.735579 28622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:27:22.735790 28622 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:27:22.748536 28622 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:34525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:38721
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:27:22.750617 28622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:27:22.752489 28622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:27:22.768652 28630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:22.769228 28632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:22.769439 28635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:22.770388 28622 server_base.cc:1034] running on GCE node
I20260809 05:27:22.771309 28622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:27:22.772554 28622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:27:22.773886 28622 hybrid_clock.cc:648] HybridClock initialized: now 1786253242773783 us; error 78 us; skew 500 ppm
I20260809 05:27:22.774305 28622 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:27:22 dist-test-slave-h3ft krb5kdc[28224](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253242, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:27:22.778297 28622 init.cc:377] Logged in from keytab as kudu/127.26.185.2@KRBTEST.COM (short username kudu)
I20260809 05:27:22.780236 28622 webserver.cc:460] Webserver started at http://127.26.185.2:38119/ using document root <none> and password file <none>
I20260809 05:27:22.781154 28622 fs_manager.cc:359] Metadata directory not provided
I20260809 05:27:22.781301 28622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:27:22.781700 28622 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:27:22.785609 28622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-1/data/instance:
uuid: "ca424f4ca089438aa054539a4ecbdad3"
format_stamp: "Formatted at 2026-08-09 05:27:22 on dist-test-slave-h3ft"
server_key: "79e6e6f8d1d7f385d30bd745098c1db9"
server_key_iv: "3eb429e208cf90ba4bf9dbdc426b64cd"
server_key_version: "encryptionkey@0"
I20260809 05:27:22.786661 28622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance:
uuid: "ca424f4ca089438aa054539a4ecbdad3"
format_stamp: "Formatted at 2026-08-09 05:27:22 on dist-test-slave-h3ft"
server_key: "79e6e6f8d1d7f385d30bd745098c1db9"
server_key_iv: "3eb429e208cf90ba4bf9dbdc426b64cd"
server_key_version: "encryptionkey@0"
I20260809 05:27:22.793926 28622 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.001s sys 0.004s
I20260809 05:27:22.798386 28645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:22.800084 28622 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 05:27:22.800308 28622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "ca424f4ca089438aa054539a4ecbdad3"
format_stamp: "Formatted at 2026-08-09 05:27:22 on dist-test-slave-h3ft"
server_key: "79e6e6f8d1d7f385d30bd745098c1db9"
server_key_iv: "3eb429e208cf90ba4bf9dbdc426b64cd"
server_key_version: "encryptionkey@0"
I20260809 05:27:22.800570 28622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:27:22.827167 28622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:27:22.832505 28622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:27:22.832899 28622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:27:22.834204 28622 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:27:22.835947 28622 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:27:22.836045 28622 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:22.836227 28622 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:27:22.836298 28622 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:22.882210 28622 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:37745
I20260809 05:27:22.882293 28821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:37745 every 8 connection(s)
I20260809 05:27:22.884169 28622 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:27:22.894047 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 28622
I20260809 05:27:22.894321 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance
I20260809 05:27:22.894873 27364 external_mini_cluster.cc:1428] Setting key 53ccccd2fbfdd9aff921fd6f23a63793
Aug 09 05:27:22 dist-test-slave-h3ft krb5kdc[28224](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253242, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:22.910931 28826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:22.887913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:39957 (local address 127.26.185.62:38721)
0809 05:27:22.888446 (+ 533us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:22.888451 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:22.889706 (+ 1255us) server_negotiation.cc:407] Connection header received
0809 05:27:22.892054 (+ 2348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:22.892060 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:22.892179 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:22.892323 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:22.894244 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:22.895235 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:22.897583 (+ 2348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:22.898049 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:22.898195 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:22.902834 (+ 4639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:22.902844 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:22.902853 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:22.902907 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:22.906865 (+ 3958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:22.908112 (+ 1247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:22.908117 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:22.908120 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:22.908268 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:22.908843 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:22.908846 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:22.908849 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:22.909154 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:22.909276 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:22.910376 (+ 1100us) server_negotiation.cc:299] Negotiation successful
0809 05:27:22.910598 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":263,"threads_started":1}
I20260809 05:27:22.913005 28827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:22.888646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:38721 (local address 127.26.185.2:39957)
0809 05:27:22.889490 (+ 844us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:22.889551 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:22.891706 (+ 2155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:22.892655 (+ 949us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:22.892665 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:22.893321 (+ 656us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:27:22.894021 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:22.894052 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:22.895411 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:22.895415 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:22.897438 (+ 2023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:22.897454 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:22.898308 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:22.898316 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:22.898589 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:22.899500 (+ 911us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:27:22.899529 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:27:22.902529 (+ 3000us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:27:22.907096 (+ 4567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:22.907112 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:22.907145 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:22.907971 (+ 826us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:22.908392 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:22.908400 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:22.908407 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:22.908720 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:22.909289 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:27:22.909301 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:27:22.909907 (+ 606us) client_negotiation.cc:769] Sending connection context
0809 05:27:22.910289 (+ 382us) client_negotiation.cc:240] Negotiation successful
0809 05:27:22.911074 (+ 785us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":323,"threads_started":1}
I20260809 05:27:22.914955 28822 heartbeater.cc:347] Connected to a master server at 127.26.185.62:38721
I20260809 05:27:22.915419 28822 heartbeater.cc:464] Registering TS with master...
I20260809 05:27:22.916388 28822 heartbeater.cc:511] Master 127.26.185.62:38721 requested a full tablet report, sending...
I20260809 05:27:22.918426 28301 ts_manager.cc:194] Registered new tserver with Master: ca424f4ca089438aa054539a4ecbdad3 (127.26.185.2:37745)
I20260809 05:27:22.919895 28301 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.2@KRBTEST.COM'} at 127.26.185.2:39957
WARNING: no policy specified for kudu/127.26.185.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
I20260809 05:27:22.956261 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:0
--local_ip_for_outbound_sockets=127.26.185.3
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:38721
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:34525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:27:23.294212 28609 heartbeater.cc:503] Master 127.26.185.62:38721 was elected leader, sending a full tablet report...
W20260809 05:27:23.364388 28830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:27:23.364790 28830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:27:23.364991 28830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:27:23.372987 28830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:27:23.373167 28830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:27:23.373392 28830 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:27:23.384454 28830 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:34525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:38721
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:27:23.386234 28830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:27:23.387960 28830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:27:23.404341 28836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:23.404291 28843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:23.404254 28837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:23.405473 28830 server_base.cc:1034] running on GCE node
I20260809 05:27:23.406322 28830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:27:23.407756 28830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:27:23.409049 28830 hybrid_clock.cc:648] HybridClock initialized: now 1786253243408989 us; error 64 us; skew 500 ppm
I20260809 05:27:23.409485 28830 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:27:23 dist-test-slave-h3ft krb5kdc[28224](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253243, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:27:23.413976 28830 init.cc:377] Logged in from keytab as kudu/127.26.185.3@KRBTEST.COM (short username kudu)
I20260809 05:27:23.415957 28830 webserver.cc:460] Webserver started at http://127.26.185.3:35195/ using document root <none> and password file <none>
I20260809 05:27:23.416872 28830 fs_manager.cc:359] Metadata directory not provided
I20260809 05:27:23.417037 28830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:27:23.417424 28830 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:27:23.421140 28830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-2/data/instance:
uuid: "d2301d8fb67849b9874d908f4874ab67"
format_stamp: "Formatted at 2026-08-09 05:27:23 on dist-test-slave-h3ft"
server_key: "67fb761895c52ac8bfb224c668b7b281"
server_key_iv: "043d6d3169bdeaf198db2b5ea53f5fd6"
server_key_version: "encryptionkey@0"
I20260809 05:27:23.422076 28830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance:
uuid: "d2301d8fb67849b9874d908f4874ab67"
format_stamp: "Formatted at 2026-08-09 05:27:23 on dist-test-slave-h3ft"
server_key: "67fb761895c52ac8bfb224c668b7b281"
server_key_iv: "043d6d3169bdeaf198db2b5ea53f5fd6"
server_key_version: "encryptionkey@0"
I20260809 05:27:23.428363 28830 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260809 05:27:23.432554 28850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:23.434113 28830 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 05:27:23.434329 28830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "d2301d8fb67849b9874d908f4874ab67"
format_stamp: "Formatted at 2026-08-09 05:27:23 on dist-test-slave-h3ft"
server_key: "67fb761895c52ac8bfb224c668b7b281"
server_key_iv: "043d6d3169bdeaf198db2b5ea53f5fd6"
server_key_version: "encryptionkey@0"
I20260809 05:27:23.434573 28830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:27:23.461901 28830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:27:23.467608 28830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:27:23.468032 28830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:27:23.469316 28830 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:27:23.471206 28830 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:27:23.471323 28830 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:23.471498 28830 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:27:23.471575 28830 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:23.511709 28830 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:41493
I20260809 05:27:23.511757 29037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:41493 every 8 connection(s)
I20260809 05:27:23.513476 28830 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:27:23.523672 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 28830
I20260809 05:27:23.523911 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance
I20260809 05:27:23.524456 27364 external_mini_cluster.cc:1428] Setting key 4dd15c32bfef00e295980eec429d98ab
Aug 09 05:27:23 dist-test-slave-h3ft krb5kdc[28224](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253243, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:23.537675 29041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:23.516848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:60961 (local address 127.26.185.62:38721)
0809 05:27:23.517423 (+ 575us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:23.517429 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:23.518562 (+ 1133us) server_negotiation.cc:407] Connection header received
0809 05:27:23.520716 (+ 2154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:23.520721 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:23.520829 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:23.520968 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:23.522714 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.523977 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.526003 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.526618 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.526755 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:23.531319 (+ 4564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:23.531324 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:23.531328 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:23.531364 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:23.534234 (+ 2870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:23.535067 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:23.535073 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:23.535097 (+ 24us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:23.535245 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:23.535716 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:23.535722 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:23.535725 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:23.536018 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:23.536203 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:23.536980 (+ 777us) server_negotiation.cc:299] Negotiation successful
0809 05:27:23.537237 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":277,"threads_started":1}
I20260809 05:27:23.539058 29042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:23.517570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:38721 (local address 127.26.185.3:60961)
0809 05:27:23.518372 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:23.518416 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:23.520384 (+ 1968us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:23.521244 (+ 860us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:23.521253 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:23.521855 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:27:23.522503 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:23.522521 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.524187 (+ 1666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.524191 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:23.525819 (+ 1628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:23.525848 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.526980 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.526990 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:23.527443 (+ 453us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:23.528415 (+ 972us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:27:23.528442 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:27:23.531082 (+ 2640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:27:23.534384 (+ 3302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:23.534395 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:23.534415 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:23.534901 (+ 486us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:23.535363 (+ 462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:23.535368 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:23.535372 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:23.535597 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:23.536168 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:27:23.536178 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:27:23.536577 (+ 399us) client_negotiation.cc:769] Sending connection context
0809 05:27:23.536880 (+ 303us) client_negotiation.cc:240] Negotiation successful
0809 05:27:23.537542 (+ 662us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":306,"threads_started":1}
I20260809 05:27:23.540799 29039 heartbeater.cc:347] Connected to a master server at 127.26.185.62:38721
I20260809 05:27:23.541181 29039 heartbeater.cc:464] Registering TS with master...
I20260809 05:27:23.542042 29039 heartbeater.cc:511] Master 127.26.185.62:38721 requested a full tablet report, sending...
I20260809 05:27:23.543769 28301 ts_manager.cc:194] Registered new tserver with Master: d2301d8fb67849b9874d908f4874ab67 (127.26.185.3:41493)
I20260809 05:27:23.544782 28301 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.3@KRBTEST.COM'} at 127.26.185.3:60961
I20260809 05:27:23.553998 27364 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 05:27:23.575567 29041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:23.561492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42664 (local address 127.26.185.62:38721)
0809 05:27:23.561684 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:23.561708 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:23.562211 (+ 503us) server_negotiation.cc:407] Connection header received
0809 05:27:23.562437 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:23.562442 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:23.562515 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:23.562644 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:23.564443 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.565244 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.566558 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.567051 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.567218 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:23.569784 (+ 2566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:23.569789 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:23.569793 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:23.569828 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:23.572683 (+ 2855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:23.573375 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:23.573383 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:23.573387 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:23.573533 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:23.573927 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:23.573934 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:23.573938 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:23.574302 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:23.574591 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:23.574940 (+ 349us) server_negotiation.cc:299] Negotiation successful
0809 05:27:23.575213 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 05:27:23.584132 28301 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42664:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 05:27:23.592141 28301 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 05:27:23.635454 29068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:23.608661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58310 (local address 127.26.185.3:41493)
0809 05:27:23.623924 (+ 15263us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:23.623935 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:23.625123 (+ 1188us) server_negotiation.cc:407] Connection header received
0809 05:27:23.625274 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:23.625286 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:23.625613 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:23.625854 (+ 241us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:27:23.627309 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.629534 (+ 2225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.632615 (+ 3081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.634081 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.634249 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:23.634549 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:23.634812 (+ 263us) server_negotiation.cc:299] Negotiation successful
0809 05:27:23.635045 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15029,"thread_start_us":15275,"threads_started":1}
I20260809 05:27:23.635502 29073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:23.608157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:41493 (local address 127.0.0.1:58310)
0809 05:27:23.624751 (+ 16594us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:23.624784 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:23.624941 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:23.626293 (+ 1352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:23.626301 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:23.626336 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:27:23.626982 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:23.627018 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.629841 (+ 2823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.629850 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:23.632375 (+ 2525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:23.632388 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.634306 (+ 1918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.634312 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:23.634534 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:23.634594 (+ 60us) client_negotiation.cc:769] Sending connection context
0809 05:27:23.634747 (+ 153us) client_negotiation.cc:240] Negotiation successful
0809 05:27:23.634971 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16426,"mutex_wait_us":1,"thread_start_us":11093,"threads_started":1}
I20260809 05:27:23.635823 29066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:23.608194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40168 (local address 127.26.185.2:37745)
0809 05:27:23.621291 (+ 13097us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:23.621305 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:23.621371 (+ 66us) server_negotiation.cc:407] Connection header received
0809 05:27:23.621534 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:23.621548 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:23.621962 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:23.622255 (+ 293us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:27:23.624721 (+ 2466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.627038 (+ 2317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.632896 (+ 5858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.634319 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.634460 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:23.634665 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:23.635255 (+ 590us) server_negotiation.cc:299] Negotiation successful
0809 05:27:23.635454 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12878,"thread_start_us":18465,"threads_started":1}
I20260809 05:27:23.636868 29064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:23.607964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:37745 (local address 127.0.0.1:40168)
0809 05:27:23.619887 (+ 11923us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:23.619958 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:23.620250 (+ 292us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:23.622267 (+ 2017us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:23.622279 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:23.622323 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:27:23.624397 (+ 2074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:23.624419 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.627293 (+ 2874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.627303 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:23.632702 (+ 5399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:23.632714 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.634824 (+ 2110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.634830 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:23.635035 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:23.635067 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 05:27:23.636054 (+ 987us) client_negotiation.cc:240] Negotiation successful
0809 05:27:23.636230 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11498,"mutex_wait_us":1924,"thread_start_us":23487,"threads_started":1}
I20260809 05:27:23.641445 29063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:23.620603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:46011 (local address 127.0.0.1:42502)
0809 05:27:23.631699 (+ 11096us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:23.631721 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:23.631882 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:23.632950 (+ 1068us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:23.632955 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:23.632987 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:27:23.633421 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:23.633436 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.636139 (+ 2703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.636145 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:23.638367 (+ 2222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:23.638380 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.640582 (+ 2202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.640589 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:23.640756 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:23.640790 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 05:27:23.640904 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 05:27:23.641043 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10993,"thread_start_us":3797,"threads_started":1}
I20260809 05:27:23.641144 28929 tablet_service.cc:1467] Processing CreateTablet for tablet 6be14de0092c457ba471322948e49297 (DEFAULT_TABLE table=test-table [id=b54170f930554354856caae1c8952d0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:27:23.641144 28719 tablet_service.cc:1467] Processing CreateTablet for tablet 6be14de0092c457ba471322948e49297 (DEFAULT_TABLE table=test-table [id=b54170f930554354856caae1c8952d0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:27:23.642583 29074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:23.621041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42502 (local address 127.26.185.1:46011)
0809 05:27:23.631299 (+ 10258us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:23.631306 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:23.631868 (+ 562us) server_negotiation.cc:407] Connection header received
0809 05:27:23.632099 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:23.632108 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:23.632390 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:23.632654 (+ 264us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:27:23.633645 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.635974 (+ 2329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.638526 (+ 2552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.640048 (+ 1522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.640191 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:23.640444 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:23.642154 (+ 1710us) server_negotiation.cc:299] Negotiation successful
0809 05:27:23.642303 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10084,"thread_start_us":9836,"threads_started":1}
I20260809 05:27:23.643069 28719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6be14de0092c457ba471322948e49297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:23.643065 28929 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6be14de0092c457ba471322948e49297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:23.646764 28502 tablet_service.cc:1467] Processing CreateTablet for tablet 6be14de0092c457ba471322948e49297 (DEFAULT_TABLE table=test-table [id=b54170f930554354856caae1c8952d0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:27:23.648424 28502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6be14de0092c457ba471322948e49297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:23.660668 29076 tablet_bootstrap.cc:492] T 6be14de0092c457ba471322948e49297 P d2301d8fb67849b9874d908f4874ab67: Bootstrap starting.
I20260809 05:27:23.661716 29075 tablet_bootstrap.cc:492] T 6be14de0092c457ba471322948e49297 P ca424f4ca089438aa054539a4ecbdad3: Bootstrap starting.
I20260809 05:27:23.664532 29077 tablet_bootstrap.cc:492] T 6be14de0092c457ba471322948e49297 P df00fc6b29b94917b88cc86e23bbe6cf: Bootstrap starting.
I20260809 05:27:23.666697 29075 tablet_bootstrap.cc:654] T 6be14de0092c457ba471322948e49297 P ca424f4ca089438aa054539a4ecbdad3: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:23.666716 29076 tablet_bootstrap.cc:654] T 6be14de0092c457ba471322948e49297 P d2301d8fb67849b9874d908f4874ab67: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:23.668221 29075 log.cc:824] T 6be14de0092c457ba471322948e49297 P ca424f4ca089438aa054539a4ecbdad3: Log is configured to *not* fsync() on all Append() calls
I20260809 05:27:23.668244 29076 log.cc:824] T 6be14de0092c457ba471322948e49297 P d2301d8fb67849b9874d908f4874ab67: Log is configured to *not* fsync() on all Append() calls
I20260809 05:27:23.668534 29077 tablet_bootstrap.cc:654] T 6be14de0092c457ba471322948e49297 P df00fc6b29b94917b88cc86e23bbe6cf: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:23.669858 29077 log.cc:824] T 6be14de0092c457ba471322948e49297 P df00fc6b29b94917b88cc86e23bbe6cf: Log is configured to *not* fsync() on all Append() calls
I20260809 05:27:23.672483 29075 tablet_bootstrap.cc:492] T 6be14de0092c457ba471322948e49297 P ca424f4ca089438aa054539a4ecbdad3: No bootstrap required, opened a new log
I20260809 05:27:23.672874 29075 ts_tablet_manager.cc:1397] T 6be14de0092c457ba471322948e49297 P ca424f4ca089438aa054539a4ecbdad3: Time spent bootstrapping tablet: real 0.011s user 0.010s sys 0.000s
I20260809 05:27:23.673421 29076 tablet_bootstrap.cc:492] T 6be14de0092c457ba471322948e49297 P d2301d8fb67849b9874d908f4874ab67: No bootstrap required, opened a new log
I20260809 05:27:23.673720 29076 ts_tablet_manager.cc:1397] T 6be14de0092c457ba471322948e49297 P d2301d8fb67849b9874d908f4874ab67: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.000s
I20260809 05:27:23.673795 29077 tablet_bootstrap.cc:492] T 6be14de0092c457ba471322948e49297 P df00fc6b29b94917b88cc86e23bbe6cf: No bootstrap required, opened a new log
I20260809 05:27:23.674081 29077 ts_tablet_manager.cc:1397] T 6be14de0092c457ba471322948e49297 P df00fc6b29b94917b88cc86e23bbe6cf: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260809 05:27:23.682144 29075 raft_consensus.cc:348] T 6be14de0092c457ba471322948e49297 P ca424f4ca089438aa054539a4ecbdad3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca424f4ca089438aa054539a4ecbdad3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 37745 } } peers { permanent_uuid: "d2301d8fb67849b9874d908f4874ab67" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 41493 } } peers { permanent_uuid: "df00fc6b29b94917b88cc86e23bbe6cf" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 46011 } }
I20260809 05:27:23.682907 29075 raft_consensus.cc:374] T 6be14de0092c457ba471322948e49297 P ca424f4ca089438aa054539a4ecbdad3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:23.683164 29075 raft_consensus.cc:729] T 6be14de0092c457ba471322948e49297 P ca424f4ca089438aa054539a4ecbdad3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca424f4ca089438aa054539a4ecbdad3, State: Initialized, Role: FOLLOWER
I20260809 05:27:23.684232 29075 consensus_queue.cc:260] T 6be14de0092c457ba471322948e49297 P ca424f4ca089438aa054539a4ecbdad3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca424f4ca089438aa054539a4ecbdad3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 37745 } } peers { permanent_uuid: "d2301d8fb67849b9874d908f4874ab67" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 41493 } } peers { permanent_uuid: "df00fc6b29b94917b88cc86e23bbe6cf" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 46011 } }
I20260809 05:27:23.685789 28822 heartbeater.cc:503] Master 127.26.185.62:38721 was elected leader, sending a full tablet report...
I20260809 05:27:23.685662 29077 raft_consensus.cc:348] T 6be14de0092c457ba471322948e49297 P df00fc6b29b94917b88cc86e23bbe6cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca424f4ca089438aa054539a4ecbdad3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 37745 } } peers { permanent_uuid: "d2301d8fb67849b9874d908f4874ab67" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 41493 } } peers { permanent_uuid: "df00fc6b29b94917b88cc86e23bbe6cf" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 46011 } }
I20260809 05:27:23.685670 29076 raft_consensus.cc:348] T 6be14de0092c457ba471322948e49297 P d2301d8fb67849b9874d908f4874ab67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca424f4ca089438aa054539a4ecbdad3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 37745 } } peers { permanent_uuid: "d2301d8fb67849b9874d908f4874ab67" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 41493 } } peers { permanent_uuid: "df00fc6b29b94917b88cc86e23bbe6cf" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 46011 } }
I20260809 05:27:23.686208 29076 raft_consensus.cc:374] T 6be14de0092c457ba471322948e49297 P d2301d8fb67849b9874d908f4874ab67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:23.686208 29077 raft_consensus.cc:374] T 6be14de0092c457ba471322948e49297 P df00fc6b29b94917b88cc86e23bbe6cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:23.686316 29077 raft_consensus.cc:729] T 6be14de0092c457ba471322948e49297 P df00fc6b29b94917b88cc86e23bbe6cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df00fc6b29b94917b88cc86e23bbe6cf, State: Initialized, Role: FOLLOWER
I20260809 05:27:23.686316 29076 raft_consensus.cc:729] T 6be14de0092c457ba471322948e49297 P d2301d8fb67849b9874d908f4874ab67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2301d8fb67849b9874d908f4874ab67, State: Initialized, Role: FOLLOWER
I20260809 05:27:23.686797 29075 ts_tablet_manager.cc:1428] T 6be14de0092c457ba471322948e49297 P ca424f4ca089438aa054539a4ecbdad3: Time spent starting tablet: real 0.014s user 0.012s sys 0.000s
I20260809 05:27:23.687134 29077 consensus_queue.cc:260] T 6be14de0092c457ba471322948e49297 P df00fc6b29b94917b88cc86e23bbe6cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca424f4ca089438aa054539a4ecbdad3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 37745 } } peers { permanent_uuid: "d2301d8fb67849b9874d908f4874ab67" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 41493 } } peers { permanent_uuid: "df00fc6b29b94917b88cc86e23bbe6cf" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 46011 } }
I20260809 05:27:23.687132 29076 consensus_queue.cc:260] T 6be14de0092c457ba471322948e49297 P d2301d8fb67849b9874d908f4874ab67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca424f4ca089438aa054539a4ecbdad3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 37745 } } peers { permanent_uuid: "d2301d8fb67849b9874d908f4874ab67" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 41493 } } peers { permanent_uuid: "df00fc6b29b94917b88cc86e23bbe6cf" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 46011 } }
I20260809 05:27:23.689594 29077 ts_tablet_manager.cc:1428] T 6be14de0092c457ba471322948e49297 P df00fc6b29b94917b88cc86e23bbe6cf: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
I20260809 05:27:23.691381 29039 heartbeater.cc:503] Master 127.26.185.62:38721 was elected leader, sending a full tablet report...
I20260809 05:27:23.692739 29076 ts_tablet_manager.cc:1428] T 6be14de0092c457ba471322948e49297 P d2301d8fb67849b9874d908f4874ab67: Time spent starting tablet: real 0.019s user 0.019s sys 0.000s
W20260809 05:27:23.751538 28613 tablet.cc:2369] T 6be14de0092c457ba471322948e49297 P df00fc6b29b94917b88cc86e23bbe6cf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:27:23.758195 29083 raft_consensus.cc:482] T 6be14de0092c457ba471322948e49297 P df00fc6b29b94917b88cc86e23bbe6cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:27:23.758685 29083 raft_consensus.cc:504] T 6be14de0092c457ba471322948e49297 P df00fc6b29b94917b88cc86e23bbe6cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca424f4ca089438aa054539a4ecbdad3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 37745 } } peers { permanent_uuid: "d2301d8fb67849b9874d908f4874ab67" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 41493 } } peers { permanent_uuid: "df00fc6b29b94917b88cc86e23bbe6cf" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 46011 } }
I20260809 05:27:23.760991 29083 leader_election.cc:288] T 6be14de0092c457ba471322948e49297 P df00fc6b29b94917b88cc86e23bbe6cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca424f4ca089438aa054539a4ecbdad3 (127.26.185.2:37745), d2301d8fb67849b9874d908f4874ab67 (127.26.185.3:41493)
W20260809 05:27:23.765467 29040 tablet.cc:2369] T 6be14de0092c457ba471322948e49297 P d2301d8fb67849b9874d908f4874ab67: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:27:23.769948 29066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:23.761700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:36427 (local address 127.26.185.2:37745)
0809 05:27:23.762051 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:23.762060 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:23.763048 (+ 988us) server_negotiation.cc:407] Connection header received
0809 05:27:23.763281 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:23.763285 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:23.763361 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:23.763488 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:27:23.764278 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.765191 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.767737 (+ 2546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.768589 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.768732 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:23.768841 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:23.769504 (+ 663us) server_negotiation.cc:299] Negotiation successful
0809 05:27:23.769674 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
I20260809 05:27:23.769946 29068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:23.761661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:43547 (local address 127.26.185.3:41493)
0809 05:27:23.761997 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:23.762007 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:23.762915 (+ 908us) server_negotiation.cc:407] Connection header received
0809 05:27:23.763223 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:23.763231 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:23.763322 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:23.763404 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:27:23.764150 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.764995 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.767714 (+ 2719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.768688 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.768909 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:23.769003 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:23.769465 (+ 462us) server_negotiation.cc:299] Negotiation successful
0809 05:27:23.769629 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260809 05:27:23.770018 29088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:23.761348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:41493 (local address 127.26.185.1:43547)
0809 05:27:23.762756 (+ 1408us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:23.762779 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:23.763008 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:23.763453 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:23.763461 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:23.763490 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:27:23.763972 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:23.763986 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.765403 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.765408 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:23.767522 (+ 2114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:23.767535 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.768986 (+ 1451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.768994 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:23.769209 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:23.769237 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 05:27:23.769318 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 05:27:23.769476 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1268,"mutex_wait_us":110,"thread_start_us":963,"threads_started":1}
I20260809 05:27:23.770139 29087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:23.761341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:37745 (local address 127.26.185.1:36427)
0809 05:27:23.762816 (+ 1475us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:23.762832 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:23.763112 (+ 280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:23.763525 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:23.763530 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:23.763559 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:27:23.764086 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:23.764097 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.765368 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.765374 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:23.767537 (+ 2163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:23.767551 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.768845 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.768853 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:23.769219 (+ 366us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:23.769252 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 05:27:23.769443 (+ 191us) client_negotiation.cc:240] Negotiation successful
0809 05:27:23.769586 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1368,"mutex_wait_us":181,"thread_start_us":801,"threads_started":1}
I20260809 05:27:23.771338 28963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6be14de0092c457ba471322948e49297" candidate_uuid: "df00fc6b29b94917b88cc86e23bbe6cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2301d8fb67849b9874d908f4874ab67" is_pre_election: true
I20260809 05:27:23.771361 28751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6be14de0092c457ba471322948e49297" candidate_uuid: "df00fc6b29b94917b88cc86e23bbe6cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca424f4ca089438aa054539a4ecbdad3" is_pre_election: true
I20260809 05:27:23.771943 28963 raft_consensus.cc:2454] T 6be14de0092c457ba471322948e49297 P d2301d8fb67849b9874d908f4874ab67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df00fc6b29b94917b88cc86e23bbe6cf in term 0.
I20260809 05:27:23.771961 28751 raft_consensus.cc:2454] T 6be14de0092c457ba471322948e49297 P ca424f4ca089438aa054539a4ecbdad3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df00fc6b29b94917b88cc86e23bbe6cf in term 0.
I20260809 05:27:23.772730 28438 leader_election.cc:302] T 6be14de0092c457ba471322948e49297 P df00fc6b29b94917b88cc86e23bbe6cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2301d8fb67849b9874d908f4874ab67, df00fc6b29b94917b88cc86e23bbe6cf; no voters:
I20260809 05:27:23.773187 29083 raft_consensus.cc:2781] T 6be14de0092c457ba471322948e49297 P df00fc6b29b94917b88cc86e23bbe6cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:27:23.773355 29083 raft_consensus.cc:482] T 6be14de0092c457ba471322948e49297 P df00fc6b29b94917b88cc86e23bbe6cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:27:23.773492 29083 raft_consensus.cc:3037] T 6be14de0092c457ba471322948e49297 P df00fc6b29b94917b88cc86e23bbe6cf [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:23.776351 29083 raft_consensus.cc:504] T 6be14de0092c457ba471322948e49297 P df00fc6b29b94917b88cc86e23bbe6cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca424f4ca089438aa054539a4ecbdad3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 37745 } } peers { permanent_uuid: "d2301d8fb67849b9874d908f4874ab67" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 41493 } } peers { permanent_uuid: "df00fc6b29b94917b88cc86e23bbe6cf" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 46011 } }
I20260809 05:27:23.777268 29083 leader_election.cc:288] T 6be14de0092c457ba471322948e49297 P df00fc6b29b94917b88cc86e23bbe6cf [CANDIDATE]: Term 1 election: Requested vote from peers ca424f4ca089438aa054539a4ecbdad3 (127.26.185.2:37745), d2301d8fb67849b9874d908f4874ab67 (127.26.185.3:41493)
I20260809 05:27:23.777947 28751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6be14de0092c457ba471322948e49297" candidate_uuid: "df00fc6b29b94917b88cc86e23bbe6cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca424f4ca089438aa054539a4ecbdad3"
I20260809 05:27:23.778069 28963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6be14de0092c457ba471322948e49297" candidate_uuid: "df00fc6b29b94917b88cc86e23bbe6cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2301d8fb67849b9874d908f4874ab67"
I20260809 05:27:23.778229 28751 raft_consensus.cc:3037] T 6be14de0092c457ba471322948e49297 P ca424f4ca089438aa054539a4ecbdad3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:23.778365 28963 raft_consensus.cc:3037] T 6be14de0092c457ba471322948e49297 P d2301d8fb67849b9874d908f4874ab67 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:23.781333 28963 raft_consensus.cc:2454] T 6be14de0092c457ba471322948e49297 P d2301d8fb67849b9874d908f4874ab67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df00fc6b29b94917b88cc86e23bbe6cf in term 1.
I20260809 05:27:23.781428 28751 raft_consensus.cc:2454] T 6be14de0092c457ba471322948e49297 P ca424f4ca089438aa054539a4ecbdad3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df00fc6b29b94917b88cc86e23bbe6cf in term 1.
I20260809 05:27:23.781922 28438 leader_election.cc:302] T 6be14de0092c457ba471322948e49297 P df00fc6b29b94917b88cc86e23bbe6cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2301d8fb67849b9874d908f4874ab67, df00fc6b29b94917b88cc86e23bbe6cf; no voters:
I20260809 05:27:23.782348 29083 raft_consensus.cc:2781] T 6be14de0092c457ba471322948e49297 P df00fc6b29b94917b88cc86e23bbe6cf [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:27:23.782980 29083 raft_consensus.cc:686] T 6be14de0092c457ba471322948e49297 P df00fc6b29b94917b88cc86e23bbe6cf [term 1 LEADER]: Becoming Leader. State: Replica: df00fc6b29b94917b88cc86e23bbe6cf, State: Running, Role: LEADER
I20260809 05:27:23.783762 29083 consensus_queue.cc:237] T 6be14de0092c457ba471322948e49297 P df00fc6b29b94917b88cc86e23bbe6cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca424f4ca089438aa054539a4ecbdad3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 37745 } } peers { permanent_uuid: "d2301d8fb67849b9874d908f4874ab67" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 41493 } } peers { permanent_uuid: "df00fc6b29b94917b88cc86e23bbe6cf" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 46011 } }
I20260809 05:27:23.790134 28297 catalog_manager.cc:5495] T 6be14de0092c457ba471322948e49297 P df00fc6b29b94917b88cc86e23bbe6cf reported cstate change: term changed from 0 to 1, leader changed from <none> to df00fc6b29b94917b88cc86e23bbe6cf (127.26.185.1). New cstate: current_term: 1 leader_uuid: "df00fc6b29b94917b88cc86e23bbe6cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca424f4ca089438aa054539a4ecbdad3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 37745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2301d8fb67849b9874d908f4874ab67" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df00fc6b29b94917b88cc86e23bbe6cf" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 46011 } health_report { overall_health: HEALTHY } } }
Aug 09 05:27:23 dist-test-slave-h3ft krb5kdc[28224](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253240, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.1@KRBTEST.COM
I20260809 05:27:23.849174 29074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:23.830958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42514 (local address 127.26.185.1:46011)
0809 05:27:23.831288 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:23.831297 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:23.831797 (+ 500us) server_negotiation.cc:407] Connection header received
0809 05:27:23.832047 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:23.832060 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:23.832166 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:23.832297 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:23.834082 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.834890 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.836353 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.836813 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.836963 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:23.841887 (+ 4924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:23.841909 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:23.841952 (+ 43us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:23.841994 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:23.845644 (+ 3650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:23.846721 (+ 1077us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:23.846730 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:23.846733 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:23.846886 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:23.847346 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:23.847349 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:23.847351 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:23.847921 (+ 570us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:23.848351 (+ 430us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:23.848643 (+ 292us) server_negotiation.cc:299] Negotiation successful
0809 05:27:23.848875 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123}
W20260809 05:27:23.887159 28824 tablet.cc:2369] T 6be14de0092c457ba471322948e49297 P ca424f4ca089438aa054539a4ecbdad3: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 05:27:23 dist-test-slave-h3ft krb5kdc[28224](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253243, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 05:27:23 dist-test-slave-h3ft krb5kdc[28224](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253243, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.185.1@KRBTEST.COM
I20260809 05:27:23.913201 29074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:23.896817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42522 (local address 127.26.185.1:46011)
0809 05:27:23.897078 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:23.897088 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:23.897519 (+ 431us) server_negotiation.cc:407] Connection header received
0809 05:27:23.897772 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:23.897777 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:23.897860 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:23.897982 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:23.899633 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.900465 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.901804 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.902265 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.902416 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:23.907158 (+ 4742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:23.907165 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:23.907168 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:23.907215 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:23.910156 (+ 2941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:23.910885 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:23.910893 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:23.910897 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:23.911123 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:23.911568 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:23.911574 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:23.911578 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:23.911903 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:23.912263 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:23.912498 (+ 235us) server_negotiation.cc:299] Negotiation successful
0809 05:27:23.912803 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
Aug 09 05:27:23 dist-test-slave-h3ft krb5kdc[28224](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253243, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 05:27:23 dist-test-slave-h3ft krb5kdc[28224](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253243, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.1@KRBTEST.COM
I20260809 05:27:23.977223 29074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:23.961029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42526 (local address 127.26.185.1:46011)
0809 05:27:23.961346 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:23.961354 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:23.961598 (+ 244us) server_negotiation.cc:407] Connection header received
0809 05:27:23.961795 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:23.961799 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:23.961902 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:23.962012 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:23.963801 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.964697 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.966188 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.966639 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.966740 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:23.971429 (+ 4689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:23.971435 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:23.971440 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:23.971482 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:23.974371 (+ 2889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:23.975221 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:23.975225 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:23.975228 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:23.975370 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:23.975746 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:23.975750 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:23.975752 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:23.976046 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:23.976302 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:23.976665 (+ 363us) server_negotiation.cc:299] Negotiation successful
0809 05:27:23.976857 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
W20260809 05:27:23.979722 28476 tablet_service.cc:2908] Rejecting scan request for tablet 6be14de0092c457ba471322948e49297: Uninitialized: clean time has not yet been initialized
I20260809 05:27:23.983696 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 28400
I20260809 05:27:23.998384 29074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:23.984776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42532 (local address 127.26.185.1:46011)
0809 05:27:23.985033 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:23.985040 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:23.985336 (+ 296us) server_negotiation.cc:407] Connection header received
0809 05:27:23.985489 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:23.985493 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:23.985572 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:23.985664 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:23.986984 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.987787 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.989107 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:23.989523 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:23.989623 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:23.992210 (+ 2587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:23.992215 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:23.992219 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:23.992261 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:23.995539 (+ 3278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:23.996217 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:23.996221 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:23.996224 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:23.996381 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:23.996744 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:23.996748 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:23.996750 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:23.997116 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:23.997354 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:23.997620 (+ 266us) server_negotiation.cc:299] Negotiation successful
0809 05:27:23.997963 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 05:27:23.999313 28600 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:27:24.108099 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 28400
I20260809 05:27:24.138758 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 28622
Aug 09 05:27:24 dist-test-slave-h3ft krb5kdc[28224](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253243, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.2@KRBTEST.COM
I20260809 05:27:24.156662 29066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:24.140012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40174 (local address 127.26.185.2:37745)
0809 05:27:24.140246 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:24.140252 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:24.140275 (+ 23us) server_negotiation.cc:407] Connection header received
0809 05:27:24.140483 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:24.140488 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:24.140580 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:24.140699 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:24.142087 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:24.142952 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:24.144534 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:24.145086 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:24.145239 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:24.150083 (+ 4844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:24.150103 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:24.150126 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:24.150169 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:24.153537 (+ 3368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:24.154248 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:24.154257 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:24.154260 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:24.154407 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:24.154819 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:24.154824 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:24.154827 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:24.155355 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:24.155710 (+ 355us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:24.156013 (+ 303us) server_negotiation.cc:299] Negotiation successful
0809 05:27:24.156269 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 05:27:24.157509 28816 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:27:24.255561 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 28622
I20260809 05:27:24.285270 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 28830
Aug 09 05:27:24 dist-test-slave-h3ft krb5kdc[28224](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253243, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.3@KRBTEST.COM
I20260809 05:27:24.302589 29114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:24.286362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58326 (local address 127.26.185.3:41493)
0809 05:27:24.286931 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:24.286936 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:24.286956 (+ 20us) server_negotiation.cc:407] Connection header received
0809 05:27:24.287094 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:24.287099 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:24.287180 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:24.287291 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:24.288755 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:24.289541 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:24.290849 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:24.291347 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:24.291450 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:24.296241 (+ 4791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:24.296261 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:24.296285 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:24.296329 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:24.299504 (+ 3175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:24.300172 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:24.300181 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:24.300184 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:24.300343 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:24.300665 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:24.300668 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:24.300669 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:24.301078 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:24.301476 (+ 398us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:24.301775 (+ 299us) server_negotiation.cc:299] Negotiation successful
0809 05:27:24.302120 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":415,"thread_start_us":288,"threads_started":1}
I20260809 05:27:24.303417 29031 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:27:24.398881 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 28830
I20260809 05:27:24.422370 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 28250
I20260809 05:27:24.423849 28349 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:27:24.550434 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 28250
2026-08-09T05:27:24Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (5198 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:27:24 dist-test-slave-h3ft krb5kdc[29120](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:27:24 dist-test-slave-h3ft krb5kdc[29120](info): set up 2 sockets
Aug 09 05:27:24 dist-test-slave-h3ft krb5kdc[29120](info): commencing operation
krb5kdc: starting...
W20260809 05:27:25.933575 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.327s user 0.003s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:27:26 dist-test-slave-h3ft krb5kdc[29120](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253246, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:27:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:27:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
I20260809 05:27:26.192198 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:45493
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:36081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:45493
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:27:26.594705 29142 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:27:26.595207 29142 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:27:26.595407 29142 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:27:26.603590 29142 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:27:26.603734 29142 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 05:27:26.603801 29142 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:27:26.603896 29142 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:27:26.603982 29142 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:27:26.604110 29142 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:27:26.615487 29142 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:36081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:45493
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:45493
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:27:26.617293 29142 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:27:26.619161 29142 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:27:26.633339 29154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:26.633304 29148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:26.633278 29149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:26.634500 29142 server_base.cc:1034] running on GCE node
I20260809 05:27:26.635581 29142 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:27:26.637288 29142 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:27:26.638522 29142 hybrid_clock.cc:648] HybridClock initialized: now 1786253246638456 us; error 39 us; skew 500 ppm
I20260809 05:27:26.638912 29142 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:27:26 dist-test-slave-h3ft krb5kdc[29120](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253246, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:27:26.642549 29142 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:27:26.644290 29142 webserver.cc:460] Webserver started at http://127.26.185.62:36457/ using document root <none> and password file <none>
I20260809 05:27:26.645183 29142 fs_manager.cc:359] Metadata directory not provided
I20260809 05:27:26.645328 29142 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:27:26.645725 29142 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:27:26.649484 29142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "ed6e5cda279540b991eac7b57bc60aa5"
format_stamp: "Formatted at 2026-08-09 05:27:26 on dist-test-slave-h3ft"
server_key: "f800a8555f0d7412b1b9b49b26ea0914"
server_key_iv: "cd6444696f478f182628c054344b0c22"
server_key_version: "encryptionkey@0"
I20260809 05:27:26.650425 29142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "ed6e5cda279540b991eac7b57bc60aa5"
format_stamp: "Formatted at 2026-08-09 05:27:26 on dist-test-slave-h3ft"
server_key: "f800a8555f0d7412b1b9b49b26ea0914"
server_key_iv: "cd6444696f478f182628c054344b0c22"
server_key_version: "encryptionkey@0"
I20260809 05:27:26.656921 29142 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.003s
I20260809 05:27:26.661392 29165 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:26.663265 29142 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260809 05:27:26.663476 29142 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "ed6e5cda279540b991eac7b57bc60aa5"
format_stamp: "Formatted at 2026-08-09 05:27:26 on dist-test-slave-h3ft"
server_key: "f800a8555f0d7412b1b9b49b26ea0914"
server_key_iv: "cd6444696f478f182628c054344b0c22"
server_key_version: "encryptionkey@0"
I20260809 05:27:26.663748 29142 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:27:26.697817 29142 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:27:26.703408 29142 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:27:26.703756 29142 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:27:26.730914 29142 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:45493
I20260809 05:27:26.730921 29270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:45493 every 8 connection(s)
I20260809 05:27:26.732848 29142 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:27:26.737972 29271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:26.740739 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 29142
I20260809 05:27:26.741065 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:27:26.742010 27364 external_mini_cluster.cc:1428] Setting key d22a827f75275e389b939eb10cc0233e
I20260809 05:27:26.752947 29271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed6e5cda279540b991eac7b57bc60aa5: Bootstrap starting.
I20260809 05:27:26.757143 29271 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ed6e5cda279540b991eac7b57bc60aa5: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:26.758486 29271 log.cc:824] T 00000000000000000000000000000000 P ed6e5cda279540b991eac7b57bc60aa5: Log is configured to *not* fsync() on all Append() calls
Aug 09 05:27:26 dist-test-slave-h3ft krb5kdc[29120](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253246, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:26.762307 29271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed6e5cda279540b991eac7b57bc60aa5: No bootstrap required, opened a new log
I20260809 05:27:26.768806 29276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:26.745077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60046 (local address 127.26.185.62:45493)
0809 05:27:26.746128 (+ 1051us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:26.746144 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:26.746200 (+ 56us) server_negotiation.cc:407] Connection header received
0809 05:27:26.748351 (+ 2151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:26.748392 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:26.748911 (+ 519us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:26.749459 (+ 548us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:26.751242 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:26.752714 (+ 1472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:26.754172 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:26.755045 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:26.755269 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:26.760351 (+ 5082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:26.760360 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:26.760386 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:26.760424 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:26.763848 (+ 3424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:26.764762 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:26.764768 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:26.764776 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:26.764974 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:26.765413 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:26.765416 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:26.765418 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:26.766062 (+ 644us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:26.766313 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:26.766801 (+ 488us) server_negotiation.cc:299] Negotiation successful
0809 05:27:26.767336 (+ 535us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":769,"thread_start_us":454,"threads_started":1}
I20260809 05:27:26.772457 29271 raft_consensus.cc:348] T 00000000000000000000000000000000 P ed6e5cda279540b991eac7b57bc60aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed6e5cda279540b991eac7b57bc60aa5" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 45493 } }
I20260809 05:27:26.772894 29271 raft_consensus.cc:374] T 00000000000000000000000000000000 P ed6e5cda279540b991eac7b57bc60aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:26.773025 29271 raft_consensus.cc:729] T 00000000000000000000000000000000 P ed6e5cda279540b991eac7b57bc60aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed6e5cda279540b991eac7b57bc60aa5, State: Initialized, Role: FOLLOWER
I20260809 05:27:26.773667 29271 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed6e5cda279540b991eac7b57bc60aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed6e5cda279540b991eac7b57bc60aa5" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 45493 } }
I20260809 05:27:26.773950 29271 raft_consensus.cc:388] T 00000000000000000000000000000000 P ed6e5cda279540b991eac7b57bc60aa5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:27:26.774109 29271 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed6e5cda279540b991eac7b57bc60aa5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:27:26.774299 29271 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ed6e5cda279540b991eac7b57bc60aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:26.776921 29271 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed6e5cda279540b991eac7b57bc60aa5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed6e5cda279540b991eac7b57bc60aa5" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 45493 } }
I20260809 05:27:26.777503 29271 leader_election.cc:302] T 00000000000000000000000000000000 P ed6e5cda279540b991eac7b57bc60aa5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ed6e5cda279540b991eac7b57bc60aa5; no voters:
I20260809 05:27:26.778092 29271 leader_election.cc:288] T 00000000000000000000000000000000 P ed6e5cda279540b991eac7b57bc60aa5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:27:26.778241 29278 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ed6e5cda279540b991eac7b57bc60aa5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:27:26.779531 29278 raft_consensus.cc:686] T 00000000000000000000000000000000 P ed6e5cda279540b991eac7b57bc60aa5 [term 1 LEADER]: Becoming Leader. State: Replica: ed6e5cda279540b991eac7b57bc60aa5, State: Running, Role: LEADER
I20260809 05:27:26.780103 29278 consensus_queue.cc:237] T 00000000000000000000000000000000 P ed6e5cda279540b991eac7b57bc60aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed6e5cda279540b991eac7b57bc60aa5" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 45493 } }
I20260809 05:27:26.780689 29271 sys_catalog.cc:564] T 00000000000000000000000000000000 P ed6e5cda279540b991eac7b57bc60aa5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:27:26.783495 29280 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed6e5cda279540b991eac7b57bc60aa5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ed6e5cda279540b991eac7b57bc60aa5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed6e5cda279540b991eac7b57bc60aa5" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 45493 } } }
I20260809 05:27:26.783461 29283 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed6e5cda279540b991eac7b57bc60aa5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed6e5cda279540b991eac7b57bc60aa5. Latest consensus state: current_term: 1 leader_uuid: "ed6e5cda279540b991eac7b57bc60aa5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed6e5cda279540b991eac7b57bc60aa5" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 45493 } } }
I20260809 05:27:26.784011 29280 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed6e5cda279540b991eac7b57bc60aa5 [sys.catalog]: This master's current role is: LEADER
I20260809 05:27:26.784169 29283 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed6e5cda279540b991eac7b57bc60aa5 [sys.catalog]: This master's current role is: LEADER
I20260809 05:27:26.786752 29290 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:27:26.792785 29290 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:27:26.802398 29290 catalog_manager.cc:1347] Generated new cluster ID: 05b9134cf14b471ebc0c0e0fd17c8899
I20260809 05:27:26.802556 29290 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:27:26.843683 29290 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:27:26.846508 29290 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:27:26.860903 29290 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ed6e5cda279540b991eac7b57bc60aa5: Generated new TSK 0
I20260809 05:27:26.862484 29290 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.185.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
I20260809 05:27:26.940985 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:0
--local_ip_for_outbound_sockets=127.26.185.1
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:45493
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:36081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:27:27.349651 29323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:27:27.350121 29323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:27:27.350327 29323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:27:27.358541 29323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:27:27.358744 29323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:27:27.358907 29323 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 05:27:27.359083 29323 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:27:27.371565 29323 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:36081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.185.62:45493
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:27:27.373413 29323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:27:27.375267 29323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:27:27.392450 29333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:27.392513 29331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:27.392738 29330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:27.393424 29323 server_base.cc:1034] running on GCE node
I20260809 05:27:27.394332 29323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:27:27.395825 29323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:27:27.397105 29323 hybrid_clock.cc:648] HybridClock initialized: now 1786253247396998 us; error 74 us; skew 500 ppm
I20260809 05:27:27.397478 29323 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:27:27 dist-test-slave-h3ft krb5kdc[29120](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253247, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:27:27.401687 29323 init.cc:377] Logged in from keytab as kudu/127.26.185.1@KRBTEST.COM (short username kudu)
I20260809 05:27:27.403898 29323 webserver.cc:460] Webserver started at http://127.26.185.1:43419/ using document root <none> and password file <none>
I20260809 05:27:27.404800 29323 fs_manager.cc:359] Metadata directory not provided
I20260809 05:27:27.404904 29323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:27:27.405228 29323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:27:27.409022 29323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-0/data/instance:
uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b"
format_stamp: "Formatted at 2026-08-09 05:27:27 on dist-test-slave-h3ft"
server_key: "e8e2665f8b9d17dd95025e6f18b5b14a"
server_key_iv: "9591d4ef2c74b81fc82873cdbd906c1a"
server_key_version: "encryptionkey@0"
I20260809 05:27:27.409951 29323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance:
uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b"
format_stamp: "Formatted at 2026-08-09 05:27:27 on dist-test-slave-h3ft"
server_key: "e8e2665f8b9d17dd95025e6f18b5b14a"
server_key_iv: "9591d4ef2c74b81fc82873cdbd906c1a"
server_key_version: "encryptionkey@0"
I20260809 05:27:27.416489 29323 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260809 05:27:27.420874 29341 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:27.422633 29323 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260809 05:27:27.422816 29323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b"
format_stamp: "Formatted at 2026-08-09 05:27:27 on dist-test-slave-h3ft"
server_key: "e8e2665f8b9d17dd95025e6f18b5b14a"
server_key_iv: "9591d4ef2c74b81fc82873cdbd906c1a"
server_key_version: "encryptionkey@0"
I20260809 05:27:27.423127 29323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:27:27.446882 29323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:27:27.452286 29323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:27:27.452553 29323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:27:27.455929 29323 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:27:27.456023 29323 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:27.456189 29323 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:27:27.456256 29323 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 05:27:27 dist-test-slave-h3ft krb5kdc[29120](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253247, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:27.486491 29355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:27.456704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:45717 (local address 127.26.185.62:45493)
0809 05:27:27.457427 (+ 723us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:27.457435 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:27.459137 (+ 1702us) server_negotiation.cc:407] Connection header received
0809 05:27:27.461183 (+ 2046us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:27.461194 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:27.461332 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:27.461498 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:27.464221 (+ 2723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:27.465409 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:27.468315 (+ 2906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:27.469093 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:27.469510 (+ 417us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:27.476142 (+ 6632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:27.476155 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:27.476162 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:27.476225 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:27.480762 (+ 4537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:27.482247 (+ 1485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:27.482252 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:27.482256 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:27.482453 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:27.483275 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:27.483282 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:27.483288 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:27.483812 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:27.484008 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:27.485544 (+ 1536us) server_negotiation.cc:299] Negotiation successful
0809 05:27:27.485903 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":432,"threads_started":1}
I20260809 05:27:27.488844 29357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:27.457521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:45493 (local address 127.26.185.1:45717)
0809 05:27:27.458590 (+ 1069us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:27.458646 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:27.460839 (+ 2193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:27.461840 (+ 1001us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:27.461852 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:27.462749 (+ 897us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:27:27.463985 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:27.464017 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:27.465596 (+ 1579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:27.465602 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:27.468086 (+ 2484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:27.468123 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:27.469581 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:27.469596 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:27.469971 (+ 375us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:27.471099 (+ 1128us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:27:27.471135 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:27:27.475685 (+ 4550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:27:27.480979 (+ 5294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:27.481002 (+ 23us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:27.481032 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:27.482049 (+ 1017us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:27.482610 (+ 561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:27.482619 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:27.482627 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:27.483099 (+ 472us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:27.484012 (+ 913us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:27:27.484028 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:27:27.484907 (+ 879us) client_negotiation.cc:769] Sending connection context
0809 05:27:27.485384 (+ 477us) client_negotiation.cc:240] Negotiation successful
0809 05:27:27.486354 (+ 970us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":732,"thread_start_us":443,"threads_started":1}
I20260809 05:27:27.505558 29323 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:33033
I20260809 05:27:27.505610 29531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:33033 every 8 connection(s)
I20260809 05:27:27.507630 29323 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:27:27.510285 29532 heartbeater.cc:347] Connected to a master server at 127.26.185.62:45493
I20260809 05:27:27.510571 29532 heartbeater.cc:464] Registering TS with master...
I20260809 05:27:27.511477 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 29323
I20260809 05:27:27.511615 29532 heartbeater.cc:511] Master 127.26.185.62:45493 requested a full tablet report, sending...
I20260809 05:27:27.511758 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance
I20260809 05:27:27.512486 27364 external_mini_cluster.cc:1428] Setting key c2c84c75a1b73df7bf287445329f9b60
I20260809 05:27:27.514660 29188 ts_manager.cc:194] Registered new tserver with Master: fe1a5faed6c74e03a4fec4c8a5e17a2b (127.26.185.1:33033)
I20260809 05:27:27.515894 29355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:27.498269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:38657 (local address 127.26.185.62:45493)
0809 05:27:27.498609 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:27.498620 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:27.499265 (+ 645us) server_negotiation.cc:407] Connection header received
0809 05:27:27.499585 (+ 320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:27.499595 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:27.499718 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:27.499872 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:27.501153 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:27.502589 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:27.504499 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:27.505296 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:27.505448 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:27.507894 (+ 2446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:27.507900 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:27.507903 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:27.507941 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:27.512510 (+ 4569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:27.513462 (+ 952us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:27.513467 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:27.513471 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:27.513653 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:27.514117 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:27.514122 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:27.514125 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:27.514493 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:27.514672 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:27.515230 (+ 558us) server_negotiation.cc:299] Negotiation successful
0809 05:27:27.515488 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260809 05:27:27.515930 29512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:27.498289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:45493 (local address 127.26.185.1:38657)
0809 05:27:27.499102 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:27.499127 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:27.499378 (+ 251us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:27.499947 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:27.499954 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:27.500612 (+ 658us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:27:27.500972 (+ 360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:27.500983 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:27.502773 (+ 1790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:27.502781 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:27.504304 (+ 1523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:27.504327 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:27.505575 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:27.505585 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:27.505804 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:27.506587 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:27:27.506606 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:27:27.507676 (+ 1070us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:27:27.512679 (+ 5003us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:27.512686 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:27.512692 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:27.513327 (+ 635us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:27.513780 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:27.513785 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:27.513789 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:27.513987 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:27.514621 (+ 634us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:27:27.514627 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:27:27.514879 (+ 252us) client_negotiation.cc:769] Sending connection context
0809 05:27:27.515084 (+ 205us) client_negotiation.cc:240] Negotiation successful
0809 05:27:27.515476 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":615,"thread_start_us":444,"threads_started":1}
I20260809 05:27:27.516942 29188 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.1@KRBTEST.COM'} at 127.26.185.1:45717
WARNING: no policy specified for kudu/127.26.185.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
I20260809 05:27:27.571276 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:0
--local_ip_for_outbound_sockets=127.26.185.2
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:45493
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:36081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:27:27.983431 29539 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:27:27.983791 29539 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:27:27.983902 29539 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:27:27.992038 29539 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:27:27.992201 29539 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:27:27.992340 29539 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 05:27:27.992443 29539 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:27:28.003754 29539 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:36081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.185.62:45493
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:27:28.005559 29539 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:27:28.007395 29539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:27:28.023186 29548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:28.023226 29550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:28.023161 29547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:28.024690 29539 server_base.cc:1034] running on GCE node
I20260809 05:27:28.025461 29539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:27:28.026625 29539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:27:28.027905 29539 hybrid_clock.cc:648] HybridClock initialized: now 1786253248027823 us; error 46 us; skew 500 ppm
I20260809 05:27:28.028338 29539 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:27:28 dist-test-slave-h3ft krb5kdc[29120](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253248, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:27:28.032146 29539 init.cc:377] Logged in from keytab as kudu/127.26.185.2@KRBTEST.COM (short username kudu)
I20260809 05:27:28.033990 29539 webserver.cc:460] Webserver started at http://127.26.185.2:46657/ using document root <none> and password file <none>
I20260809 05:27:28.034881 29539 fs_manager.cc:359] Metadata directory not provided
I20260809 05:27:28.034981 29539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:27:28.035442 29539 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:27:28.039601 29539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-1/data/instance:
uuid: "139c0831ab82459c81f35ef3a323b18a"
format_stamp: "Formatted at 2026-08-09 05:27:28 on dist-test-slave-h3ft"
server_key: "53965a9884ffcfb9d9030ecd1d010274"
server_key_iv: "5178dadb8acf6e1ca6c2a72ad773030b"
server_key_version: "encryptionkey@0"
I20260809 05:27:28.040593 29539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance:
uuid: "139c0831ab82459c81f35ef3a323b18a"
format_stamp: "Formatted at 2026-08-09 05:27:28 on dist-test-slave-h3ft"
server_key: "53965a9884ffcfb9d9030ecd1d010274"
server_key_iv: "5178dadb8acf6e1ca6c2a72ad773030b"
server_key_version: "encryptionkey@0"
I20260809 05:27:28.046860 29539 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260809 05:27:28.050830 29560 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:28.052484 29539 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 05:27:28.052703 29539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "139c0831ab82459c81f35ef3a323b18a"
format_stamp: "Formatted at 2026-08-09 05:27:28 on dist-test-slave-h3ft"
server_key: "53965a9884ffcfb9d9030ecd1d010274"
server_key_iv: "5178dadb8acf6e1ca6c2a72ad773030b"
server_key_version: "encryptionkey@0"
I20260809 05:27:28.052960 29539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:27:28.085063 29539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:27:28.090696 29539 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:27:28.091130 29539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:27:28.094920 29539 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:27:28.095117 29539 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260809 05:27:28.095356 29539 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:27:28.095467 29539 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 05:27:28 dist-test-slave-h3ft krb5kdc[29120](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253248, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:28.128856 29586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:28.096861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:40639 (local address 127.26.185.62:45493)
0809 05:27:28.097997 (+ 1136us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:28.098009 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:28.100182 (+ 2173us) server_negotiation.cc:407] Connection header received
0809 05:27:28.103296 (+ 3114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:28.103307 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:28.103465 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:28.103659 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:28.106783 (+ 3124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:28.108484 (+ 1701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:28.112394 (+ 3910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:28.113300 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:28.113465 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:28.120059 (+ 6594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:28.120066 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:28.120071 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:28.120116 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:28.123875 (+ 3759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:28.125378 (+ 1503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:28.125390 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:28.125395 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:28.125633 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:28.126242 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:28.126248 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:28.126252 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:28.126752 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:28.126996 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:28.128151 (+ 1155us) server_negotiation.cc:299] Negotiation successful
0809 05:27:28.128506 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":915,"thread_start_us":749,"threads_started":1}
I20260809 05:27:28.130209 29587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:28.097209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:45493 (local address 127.26.185.2:40639)
0809 05:27:28.099876 (+ 2667us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:28.099965 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:28.102749 (+ 2784us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:28.104131 (+ 1382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:28.104147 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:28.105333 (+ 1186us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:27:28.106502 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:28.106530 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:28.108793 (+ 2263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:28.108801 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:28.112084 (+ 3283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:28.112110 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:28.113655 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:28.113663 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:28.113913 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:28.115081 (+ 1168us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:27:28.115120 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:27:28.119727 (+ 4607us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:27:28.124179 (+ 4452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:28.124201 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:28.124239 (+ 38us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:28.125114 (+ 875us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:28.125803 (+ 689us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:28.125807 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:28.125810 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:28.126087 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:28.127010 (+ 923us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:27:28.127047 (+ 37us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:27:28.127582 (+ 535us) client_negotiation.cc:769] Sending connection context
0809 05:27:28.127951 (+ 369us) client_negotiation.cc:240] Negotiation successful
0809 05:27:28.128617 (+ 666us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2245,"thread_start_us":1961,"threads_started":1}
I20260809 05:27:28.157163 29539 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:39703
I20260809 05:27:28.157123 29761 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:39703 every 8 connection(s)
I20260809 05:27:28.158700 29694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:28.138691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:45493 (local address 127.26.185.2:34835)
0809 05:27:28.139672 (+ 981us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:28.139703 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:28.139976 (+ 273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:28.140518 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:28.140526 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:28.141358 (+ 832us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:27:28.141991 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:28.142006 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:28.143639 (+ 1633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:28.143644 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:28.145826 (+ 2182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:28.145841 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:28.147115 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:28.147128 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:28.147375 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:28.148306 (+ 931us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:27:28.148340 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:27:28.150102 (+ 1762us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:27:28.155169 (+ 5067us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:28.155173 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:28.155176 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:28.155746 (+ 570us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:28.156373 (+ 627us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:28.156382 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:28.156388 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:28.156593 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:28.157531 (+ 938us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:27:28.157537 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:27:28.157737 (+ 200us) client_negotiation.cc:769] Sending connection context
0809 05:27:28.157910 (+ 173us) client_negotiation.cc:240] Negotiation successful
0809 05:27:28.158248 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":726,"thread_start_us":507,"threads_started":1}
I20260809 05:27:28.158708 29586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:28.138508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:34835 (local address 127.26.185.62:45493)
0809 05:27:28.138749 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:28.138757 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:28.139843 (+ 1086us) server_negotiation.cc:407] Connection header received
0809 05:27:28.140187 (+ 344us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:28.140197 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:28.140311 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:28.140430 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:28.142267 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:28.143418 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:28.146001 (+ 2583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:28.146773 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:28.146945 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:28.150439 (+ 3494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:28.150450 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:28.150457 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:28.150504 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:28.155035 (+ 4531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:28.155910 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:28.155919 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:28.155925 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:28.156147 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:28.156762 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:28.156770 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:28.156776 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:28.157351 (+ 575us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:28.157578 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:28.158037 (+ 459us) server_negotiation.cc:299] Negotiation successful
0809 05:27:28.158307 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 05:27:28.159296 29539 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:27:28.161823 29762 heartbeater.cc:347] Connected to a master server at 127.26.185.62:45493
I20260809 05:27:28.162585 29762 heartbeater.cc:464] Registering TS with master...
I20260809 05:27:28.163492 29762 heartbeater.cc:511] Master 127.26.185.62:45493 requested a full tablet report, sending...
I20260809 05:27:28.165023 29188 ts_manager.cc:194] Registered new tserver with Master: 139c0831ab82459c81f35ef3a323b18a (127.26.185.2:39703)
I20260809 05:27:28.165925 29188 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.2@KRBTEST.COM'} at 127.26.185.2:40639
I20260809 05:27:28.169761 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 29539
I20260809 05:27:28.170001 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance
I20260809 05:27:28.170539 27364 external_mini_cluster.cc:1428] Setting key 79bc70b2aed5e593f32924e7372b285e
WARNING: no policy specified for kudu/127.26.185.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
I20260809 05:27:28.228926 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:0
--local_ip_for_outbound_sockets=127.26.185.3
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:45493
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:36081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:27:28.520745 29532 heartbeater.cc:503] Master 127.26.185.62:45493 was elected leader, sending a full tablet report...
W20260809 05:27:28.633610 29769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:27:28.633996 29769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:27:28.634131 29769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:27:28.641942 29769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:27:28.642068 29769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:27:28.642163 29769 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 05:27:28.642252 29769 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:27:28.653076 29769 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:36081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.185.62:45493
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:27:28.654757 29769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:27:28.656484 29769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:27:28.673177 29781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:28.673235 29779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:28.673200 29778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:28.674283 29769 server_base.cc:1034] running on GCE node
I20260809 05:27:28.675067 29769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:27:28.676168 29769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:27:28.677429 29769 hybrid_clock.cc:648] HybridClock initialized: now 1786253248677344 us; error 39 us; skew 500 ppm
I20260809 05:27:28.677802 29769 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:27:28 dist-test-slave-h3ft krb5kdc[29120](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253248, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:27:28.681932 29769 init.cc:377] Logged in from keytab as kudu/127.26.185.3@KRBTEST.COM (short username kudu)
I20260809 05:27:28.683864 29769 webserver.cc:460] Webserver started at http://127.26.185.3:33017/ using document root <none> and password file <none>
I20260809 05:27:28.684739 29769 fs_manager.cc:359] Metadata directory not provided
I20260809 05:27:28.684837 29769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:27:28.685176 29769 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:27:28.689112 29769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-2/data/instance:
uuid: "2a6a591aa5ee4435bffaa140bf8d2d01"
format_stamp: "Formatted at 2026-08-09 05:27:28 on dist-test-slave-h3ft"
server_key: "1ded16ef4d7fab378b6c2f16bbc64791"
server_key_iv: "8feb9f8a1e495385dd82fd33a9f6069e"
server_key_version: "encryptionkey@0"
I20260809 05:27:28.689990 29769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance:
uuid: "2a6a591aa5ee4435bffaa140bf8d2d01"
format_stamp: "Formatted at 2026-08-09 05:27:28 on dist-test-slave-h3ft"
server_key: "1ded16ef4d7fab378b6c2f16bbc64791"
server_key_iv: "8feb9f8a1e495385dd82fd33a9f6069e"
server_key_version: "encryptionkey@0"
I20260809 05:27:28.696594 29769 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260809 05:27:28.700887 29800 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:28.702711 29769 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260809 05:27:28.702961 29769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "2a6a591aa5ee4435bffaa140bf8d2d01"
format_stamp: "Formatted at 2026-08-09 05:27:28 on dist-test-slave-h3ft"
server_key: "1ded16ef4d7fab378b6c2f16bbc64791"
server_key_iv: "8feb9f8a1e495385dd82fd33a9f6069e"
server_key_version: "encryptionkey@0"
I20260809 05:27:28.703285 29769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:27:28.724529 29769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:27:28.730902 29769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:27:28.731292 29769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:27:28.735338 29769 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:27:28.735483 29769 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:28.735666 29769 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:27:28.735734 29769 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 05:27:28 dist-test-slave-h3ft krb5kdc[29120](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253248, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:28.769232 29813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:28.736388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:58333 (local address 127.26.185.62:45493)
0809 05:27:28.737027 (+ 639us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:28.737035 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:28.739220 (+ 2185us) server_negotiation.cc:407] Connection header received
0809 05:27:28.743106 (+ 3886us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:28.743119 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:28.743267 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:28.743409 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:28.747743 (+ 4334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:28.748967 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:28.752831 (+ 3864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:28.753576 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:28.753798 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:28.760132 (+ 6334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:28.760139 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:28.760143 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:28.760195 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:28.763563 (+ 3368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:28.764923 (+ 1360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:28.764928 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:28.764931 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:28.765110 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:28.765832 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:28.765837 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:28.765841 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:28.766226 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:28.766394 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:28.767865 (+ 1471us) server_negotiation.cc:299] Negotiation successful
0809 05:27:28.768276 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":476,"thread_start_us":336,"threads_started":1}
I20260809 05:27:28.771224 29817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:28.737885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:45493 (local address 127.26.185.3:58333)
0809 05:27:28.738978 (+ 1093us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:28.739069 (+ 91us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:28.742405 (+ 3336us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:28.744267 (+ 1862us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:28.744283 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:28.745776 (+ 1493us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:27:28.747367 (+ 1591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:28.747426 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:28.749184 (+ 1758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:28.749190 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:28.752543 (+ 3353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:28.752570 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:28.754161 (+ 1591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:28.754170 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:28.754462 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:28.755622 (+ 1160us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:27:28.755677 (+ 55us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:27:28.759717 (+ 4040us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:27:28.763764 (+ 4047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:28.763780 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:28.763813 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:28.764725 (+ 912us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:28.765243 (+ 518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:28.765251 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:28.765257 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:28.765653 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:28.766390 (+ 737us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:27:28.766405 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:27:28.767204 (+ 799us) client_negotiation.cc:769] Sending connection context
0809 05:27:28.767669 (+ 465us) client_negotiation.cc:240] Negotiation successful
0809 05:27:28.768658 (+ 989us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":730,"thread_start_us":460,"threads_started":1}
I20260809 05:27:28.799921 29769 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:40843
I20260809 05:27:28.799984 30003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:40843 every 8 connection(s)
I20260809 05:27:28.802057 29769 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:27:28.802234 29941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:28.782437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:45493 (local address 127.26.185.3:44023)
0809 05:27:28.783601 (+ 1164us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:28.783627 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:28.783855 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:28.784389 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:28.784393 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:28.784935 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:27:28.785305 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:28.785314 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:28.787098 (+ 1784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:28.787107 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:28.789272 (+ 2165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:28.789287 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:28.790573 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:28.790582 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:28.790847 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:28.791990 (+ 1143us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:27:28.792029 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:27:28.793725 (+ 1696us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:27:28.798755 (+ 5030us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:28.798765 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:28.798773 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:28.799689 (+ 916us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:28.800224 (+ 535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:28.800230 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:28.800234 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:28.800420 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:28.801176 (+ 756us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:27:28.801181 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:27:28.801377 (+ 196us) client_negotiation.cc:769] Sending connection context
0809 05:27:28.801503 (+ 126us) client_negotiation.cc:240] Negotiation successful
0809 05:27:28.801801 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":982,"thread_start_us":817,"threads_started":1}
I20260809 05:27:28.802341 29813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:28.782278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:44023 (local address 127.26.185.62:45493)
0809 05:27:28.782537 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:28.782544 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:28.783771 (+ 1227us) server_negotiation.cc:407] Connection header received
0809 05:27:28.784062 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:28.784072 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:28.784200 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:28.784333 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:28.785483 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:28.786913 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:28.789443 (+ 2530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:28.790271 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:28.790464 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:28.794009 (+ 3545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:28.794018 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:28.794026 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:28.794085 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:28.798550 (+ 4465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:28.799856 (+ 1306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:28.799864 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:28.799870 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:28.800074 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:28.800577 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:28.800582 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:28.800586 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:28.801021 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:28.801209 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:28.801670 (+ 461us) server_negotiation.cc:299] Negotiation successful
0809 05:27:28.801961 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260809 05:27:28.804787 30007 heartbeater.cc:347] Connected to a master server at 127.26.185.62:45493
I20260809 05:27:28.805409 30007 heartbeater.cc:464] Registering TS with master...
I20260809 05:27:28.806353 30007 heartbeater.cc:511] Master 127.26.185.62:45493 requested a full tablet report, sending...
I20260809 05:27:28.807325 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 29769
I20260809 05:27:28.807580 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance
I20260809 05:27:28.808158 29188 ts_manager.cc:194] Registered new tserver with Master: 2a6a591aa5ee4435bffaa140bf8d2d01 (127.26.185.3:40843)
I20260809 05:27:28.808189 27364 external_mini_cluster.cc:1428] Setting key 37c73cc56755811da146053c91ec6dbb
I20260809 05:27:28.809234 29188 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.3@KRBTEST.COM'} at 127.26.185.3:58333
I20260809 05:27:28.811584 27364 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 05:27:28 dist-test-slave-h3ft krb5kdc[29120](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253248, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 05:27:28 dist-test-slave-h3ft krb5kdc[29120](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253248, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:28.875294 29813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:28.857943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48456 (local address 127.26.185.62:45493)
0809 05:27:28.858217 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:28.858224 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:28.858454 (+ 230us) server_negotiation.cc:407] Connection header received
0809 05:27:28.858651 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:28.858656 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:28.858744 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:28.858840 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:28.860593 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:28.861455 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:28.862967 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:28.863544 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:28.863670 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:28.868804 (+ 5134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:28.868810 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:28.868814 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:28.868889 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:28.872003 (+ 3114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:28.872792 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:28.872797 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:28.872800 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:28.872958 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:28.873362 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:28.873365 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:28.873367 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:28.873677 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:28.873964 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:28.874576 (+ 612us) server_negotiation.cc:299] Negotiation successful
0809 05:27:28.874867 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 05:27:28.880821 29188 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48456:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 05:27:28.889370 29188 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 05:27:28.917784 30040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:28.906754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56534 (local address 127.26.185.1:33033)
0809 05:27:28.907579 (+ 825us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:28.907589 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:28.908306 (+ 717us) server_negotiation.cc:407] Connection header received
0809 05:27:28.908727 (+ 421us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:28.908742 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:28.909109 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:28.909345 (+ 236us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:27:28.910206 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:28.911968 (+ 1762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:28.914739 (+ 2771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:28.915974 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:28.916066 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:28.916279 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:28.917206 (+ 927us) server_negotiation.cc:299] Negotiation successful
0809 05:27:28.917434 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":554,"thread_start_us":1095,"threads_started":1}
I20260809 05:27:28.917815 30043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:28.906036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:33033 (local address 127.0.0.1:56534)
0809 05:27:28.908171 (+ 2135us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:28.908193 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:28.908458 (+ 265us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:28.909471 (+ 1013us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:28.909479 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:28.909511 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:27:28.910005 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:28.910019 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:28.912166 (+ 2147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:28.912171 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:28.914503 (+ 2332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:28.914521 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:28.916450 (+ 1929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:28.916454 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:28.916819 (+ 365us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:28.916882 (+ 63us) client_negotiation.cc:769] Sending connection context
0809 05:27:28.917111 (+ 229us) client_negotiation.cc:240] Negotiation successful
0809 05:27:28.917335 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1970,"mutex_wait_us":73,"thread_start_us":2239,"threads_started":1}
I20260809 05:27:28.919771 30034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:28.905439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:39703 (local address 127.0.0.1:33440)
0809 05:27:28.906423 (+ 984us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:28.906477 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:28.906693 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:28.910569 (+ 3876us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:28.910573 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:28.910599 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:27:28.911068 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:28.911081 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:28.913288 (+ 2207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:28.913296 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:28.916525 (+ 3229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:28.916547 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:28.918664 (+ 2117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:28.918671 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:28.918925 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:28.918958 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 05:27:28.919059 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 05:27:28.919204 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"mutex_wait_us":27,"thread_start_us":422,"threads_started":1}
I20260809 05:27:28.920213 30036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:28.905775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33440 (local address 127.26.185.2:39703)
0809 05:27:28.909844 (+ 4069us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:28.909856 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:28.909893 (+ 37us) server_negotiation.cc:407] Connection header received
0809 05:27:28.910025 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:28.910032 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:28.910321 (+ 289us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:28.911357 (+ 1036us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:27:28.911584 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:28.913123 (+ 1539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:28.916797 (+ 3674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:28.918397 (+ 1600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:28.919402 (+ 1005us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:28.919645 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:28.919727 (+ 82us) server_negotiation.cc:299] Negotiation successful
0809 05:27:28.919912 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3442,"thread_start_us":3292,"threads_started":1}
I20260809 05:27:28.923236 29422 tablet_service.cc:1467] Processing CreateTablet for tablet b94e286c572a4749bbb04763ca530869 (DEFAULT_TABLE table=test-table [id=18021118d93840bd81f6bb96b49da7e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:27:28.923840 29661 tablet_service.cc:1467] Processing CreateTablet for tablet b94e286c572a4749bbb04763ca530869 (DEFAULT_TABLE table=test-table [id=18021118d93840bd81f6bb96b49da7e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:27:28.925233 29422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b94e286c572a4749bbb04763ca530869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:28.925323 29661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b94e286c572a4749bbb04763ca530869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:28.927392 30038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:28.907511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:40843 (local address 127.0.0.1:52884)
0809 05:27:28.908612 (+ 1101us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:28.908635 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:28.908788 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:28.918589 (+ 9801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:28.918594 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:28.918623 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:27:28.920145 (+ 1522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:28.920163 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:28.922134 (+ 1971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:28.922139 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:28.924161 (+ 2022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:28.924180 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:28.926361 (+ 2181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:28.926368 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:28.926622 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:28.926660 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 05:27:28.926773 (+ 113us) client_negotiation.cc:240] Negotiation successful
0809 05:27:28.926933 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":956,"mutex_wait_us":364,"thread_start_us":360,"threads_started":1}
I20260809 05:27:28.927747 30044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:28.907575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52884 (local address 127.26.185.3:40843)
0809 05:27:28.917199 (+ 9624us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:28.917209 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:28.917249 (+ 40us) server_negotiation.cc:407] Connection header received
0809 05:27:28.917367 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:28.917376 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:28.917706 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:28.918213 (+ 507us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:27:28.920393 (+ 2180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:28.921949 (+ 1556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:28.924372 (+ 2423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:28.926110 (+ 1738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:28.926267 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:28.926546 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:28.926845 (+ 299us) server_negotiation.cc:299] Negotiation successful
0809 05:27:28.927239 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9394,"thread_start_us":9162,"threads_started":1}
I20260809 05:27:28.934600 29888 tablet_service.cc:1467] Processing CreateTablet for tablet b94e286c572a4749bbb04763ca530869 (DEFAULT_TABLE table=test-table [id=18021118d93840bd81f6bb96b49da7e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:27:28.936697 29888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b94e286c572a4749bbb04763ca530869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:28.940342 30047 tablet_bootstrap.cc:492] T b94e286c572a4749bbb04763ca530869 P 139c0831ab82459c81f35ef3a323b18a: Bootstrap starting.
I20260809 05:27:28.942862 30048 tablet_bootstrap.cc:492] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b: Bootstrap starting.
I20260809 05:27:28.945047 30047 tablet_bootstrap.cc:654] T b94e286c572a4749bbb04763ca530869 P 139c0831ab82459c81f35ef3a323b18a: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:28.946632 30047 log.cc:824] T b94e286c572a4749bbb04763ca530869 P 139c0831ab82459c81f35ef3a323b18a: Log is configured to *not* fsync() on all Append() calls
I20260809 05:27:28.947053 30048 tablet_bootstrap.cc:654] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:28.948632 30048 log.cc:824] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b: Log is configured to *not* fsync() on all Append() calls
I20260809 05:27:28.951547 30047 tablet_bootstrap.cc:492] T b94e286c572a4749bbb04763ca530869 P 139c0831ab82459c81f35ef3a323b18a: No bootstrap required, opened a new log
I20260809 05:27:28.951874 30047 ts_tablet_manager.cc:1397] T b94e286c572a4749bbb04763ca530869 P 139c0831ab82459c81f35ef3a323b18a: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260809 05:27:28.951959 30048 tablet_bootstrap.cc:492] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b: No bootstrap required, opened a new log
I20260809 05:27:28.952256 30048 ts_tablet_manager.cc:1397] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.005s
I20260809 05:27:28.953357 30051 tablet_bootstrap.cc:492] T b94e286c572a4749bbb04763ca530869 P 2a6a591aa5ee4435bffaa140bf8d2d01: Bootstrap starting.
I20260809 05:27:28.958065 30051 tablet_bootstrap.cc:654] T b94e286c572a4749bbb04763ca530869 P 2a6a591aa5ee4435bffaa140bf8d2d01: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:28.959679 30051 log.cc:824] T b94e286c572a4749bbb04763ca530869 P 2a6a591aa5ee4435bffaa140bf8d2d01: Log is configured to *not* fsync() on all Append() calls
I20260809 05:27:28.962276 30048 raft_consensus.cc:348] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } } peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } }
I20260809 05:27:28.962747 30048 raft_consensus.cc:374] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:28.962872 30048 raft_consensus.cc:729] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe1a5faed6c74e03a4fec4c8a5e17a2b, State: Initialized, Role: FOLLOWER
I20260809 05:27:28.963792 30051 tablet_bootstrap.cc:492] T b94e286c572a4749bbb04763ca530869 P 2a6a591aa5ee4435bffaa140bf8d2d01: No bootstrap required, opened a new log
I20260809 05:27:28.963665 30048 consensus_queue.cc:260] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } } peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } }
I20260809 05:27:28.963747 30047 raft_consensus.cc:348] T b94e286c572a4749bbb04763ca530869 P 139c0831ab82459c81f35ef3a323b18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } } peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } }
I20260809 05:27:28.964164 30051 ts_tablet_manager.cc:1397] T b94e286c572a4749bbb04763ca530869 P 2a6a591aa5ee4435bffaa140bf8d2d01: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.002s
I20260809 05:27:28.964274 30047 raft_consensus.cc:374] T b94e286c572a4749bbb04763ca530869 P 139c0831ab82459c81f35ef3a323b18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:28.964397 30047 raft_consensus.cc:729] T b94e286c572a4749bbb04763ca530869 P 139c0831ab82459c81f35ef3a323b18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 139c0831ab82459c81f35ef3a323b18a, State: Initialized, Role: FOLLOWER
I20260809 05:27:28.965230 30047 consensus_queue.cc:260] T b94e286c572a4749bbb04763ca530869 P 139c0831ab82459c81f35ef3a323b18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } } peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } }
I20260809 05:27:28.965997 30048 ts_tablet_manager.cc:1428] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b: Time spent starting tablet: real 0.014s user 0.011s sys 0.003s
I20260809 05:27:28.967296 29762 heartbeater.cc:503] Master 127.26.185.62:45493 was elected leader, sending a full tablet report...
I20260809 05:27:28.967941 30047 ts_tablet_manager.cc:1428] T b94e286c572a4749bbb04763ca530869 P 139c0831ab82459c81f35ef3a323b18a: Time spent starting tablet: real 0.016s user 0.003s sys 0.013s
I20260809 05:27:28.975819 30051 raft_consensus.cc:348] T b94e286c572a4749bbb04763ca530869 P 2a6a591aa5ee4435bffaa140bf8d2d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } } peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } }
I20260809 05:27:28.976333 30051 raft_consensus.cc:374] T b94e286c572a4749bbb04763ca530869 P 2a6a591aa5ee4435bffaa140bf8d2d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:28.976459 30051 raft_consensus.cc:729] T b94e286c572a4749bbb04763ca530869 P 2a6a591aa5ee4435bffaa140bf8d2d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a6a591aa5ee4435bffaa140bf8d2d01, State: Initialized, Role: FOLLOWER
I20260809 05:27:28.977197 30051 consensus_queue.cc:260] T b94e286c572a4749bbb04763ca530869 P 2a6a591aa5ee4435bffaa140bf8d2d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } } peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } }
I20260809 05:27:28.978528 30007 heartbeater.cc:503] Master 127.26.185.62:45493 was elected leader, sending a full tablet report...
I20260809 05:27:28.979384 30051 ts_tablet_manager.cc:1428] T b94e286c572a4749bbb04763ca530869 P 2a6a591aa5ee4435bffaa140bf8d2d01: Time spent starting tablet: real 0.015s user 0.007s sys 0.009s
W20260809 05:27:29.011600 29533 tablet.cc:2369] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:27:29.023164 30053 raft_consensus.cc:482] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:27:29.023644 30053 raft_consensus.cc:504] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } } peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } }
I20260809 05:27:29.025934 30053 leader_election.cc:288] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 139c0831ab82459c81f35ef3a323b18a (127.26.185.2:39703), 2a6a591aa5ee4435bffaa140bf8d2d01 (127.26.185.3:40843)
I20260809 05:27:29.035573 30044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:29.027947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:53581 (local address 127.26.185.3:40843)
0809 05:27:29.028211 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:29.028217 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:29.028533 (+ 316us) server_negotiation.cc:407] Connection header received
0809 05:27:29.028808 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:29.028819 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:29.028895 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:29.029056 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:27:29.029660 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.030685 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.033250 (+ 2565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.034349 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.034570 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:29.034665 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:29.035068 (+ 403us) server_negotiation.cc:299] Negotiation successful
0809 05:27:29.035226 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260809 05:27:29.035753 30058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:29.027610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:40843 (local address 127.26.185.1:53581)
0809 05:27:29.028330 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:29.028388 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:29.028599 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:29.029075 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:29.029078 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:29.029100 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:27:29.029481 (+ 381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:29.029492 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.030847 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.030853 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:29.033069 (+ 2216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:29.033081 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.034599 (+ 1518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.034605 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:29.034801 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:29.034830 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 05:27:29.035054 (+ 224us) client_negotiation.cc:240] Negotiation successful
0809 05:27:29.035245 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"spinlock_wait_cycles":6912,"thread_start_us":388,"threads_started":1}
I20260809 05:27:29.035959 30057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:29.026417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:39703 (local address 127.26.185.1:33519)
0809 05:27:29.027360 (+ 943us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:29.027392 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:29.027644 (+ 252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:29.028279 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:29.028285 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:29.028321 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:27:29.028853 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:29.028865 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.030321 (+ 1456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.030325 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:29.032863 (+ 2538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:29.032881 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.034964 (+ 2083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.034972 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:29.035168 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:29.035203 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 05:27:29.035316 (+ 113us) client_negotiation.cc:240] Negotiation successful
0809 05:27:29.035475 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":769,"mutex_wait_us":54,"spinlock_wait_cycles":50432,"thread_start_us":567,"threads_started":1}
I20260809 05:27:29.036520 30036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:29.026479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:33519 (local address 127.26.185.2:39703)
0809 05:27:29.026751 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:29.026757 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:29.027590 (+ 833us) server_negotiation.cc:407] Connection header received
0809 05:27:29.027898 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:29.027905 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:29.028021 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:29.028177 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:27:29.029055 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.030184 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.033070 (+ 2886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.034438 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.034640 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:29.034726 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:29.035350 (+ 624us) server_negotiation.cc:299] Negotiation successful
0809 05:27:29.035514 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260809 05:27:29.037164 29916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b94e286c572a4749bbb04763ca530869" candidate_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" is_pre_election: true
I20260809 05:27:29.037530 29684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b94e286c572a4749bbb04763ca530869" candidate_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "139c0831ab82459c81f35ef3a323b18a" is_pre_election: true
I20260809 05:27:29.037859 29916 raft_consensus.cc:2454] T b94e286c572a4749bbb04763ca530869 P 2a6a591aa5ee4435bffaa140bf8d2d01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe1a5faed6c74e03a4fec4c8a5e17a2b in term 0.
I20260809 05:27:29.038120 29684 raft_consensus.cc:2454] T b94e286c572a4749bbb04763ca530869 P 139c0831ab82459c81f35ef3a323b18a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe1a5faed6c74e03a4fec4c8a5e17a2b in term 0.
I20260809 05:27:29.038694 29342 leader_election.cc:302] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a6a591aa5ee4435bffaa140bf8d2d01, fe1a5faed6c74e03a4fec4c8a5e17a2b; no voters:
I20260809 05:27:29.039264 30053 raft_consensus.cc:2781] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:27:29.039470 30053 raft_consensus.cc:482] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:27:29.039628 30053 raft_consensus.cc:3037] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:29.042354 30053 raft_consensus.cc:504] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } } peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } }
I20260809 05:27:29.043195 30053 leader_election.cc:288] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b [CANDIDATE]: Term 1 election: Requested vote from peers 139c0831ab82459c81f35ef3a323b18a (127.26.185.2:39703), 2a6a591aa5ee4435bffaa140bf8d2d01 (127.26.185.3:40843)
I20260809 05:27:29.043889 29684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b94e286c572a4749bbb04763ca530869" candidate_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "139c0831ab82459c81f35ef3a323b18a"
I20260809 05:27:29.044154 29684 raft_consensus.cc:3037] T b94e286c572a4749bbb04763ca530869 P 139c0831ab82459c81f35ef3a323b18a [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:29.044423 29916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b94e286c572a4749bbb04763ca530869" candidate_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01"
I20260809 05:27:29.044690 29916 raft_consensus.cc:3037] T b94e286c572a4749bbb04763ca530869 P 2a6a591aa5ee4435bffaa140bf8d2d01 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:29.046921 29684 raft_consensus.cc:2454] T b94e286c572a4749bbb04763ca530869 P 139c0831ab82459c81f35ef3a323b18a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe1a5faed6c74e03a4fec4c8a5e17a2b in term 1.
I20260809 05:27:29.047508 29342 leader_election.cc:302] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 139c0831ab82459c81f35ef3a323b18a, fe1a5faed6c74e03a4fec4c8a5e17a2b; no voters:
I20260809 05:27:29.047799 29916 raft_consensus.cc:2454] T b94e286c572a4749bbb04763ca530869 P 2a6a591aa5ee4435bffaa140bf8d2d01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe1a5faed6c74e03a4fec4c8a5e17a2b in term 1.
I20260809 05:27:29.048036 30053 raft_consensus.cc:2781] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:27:29.048755 30053 raft_consensus.cc:686] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 1 LEADER]: Becoming Leader. State: Replica: fe1a5faed6c74e03a4fec4c8a5e17a2b, State: Running, Role: LEADER
I20260809 05:27:29.049424 30053 consensus_queue.cc:237] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } } peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } }
W20260809 05:27:29.055264 30008 tablet.cc:2369] T b94e286c572a4749bbb04763ca530869 P 2a6a591aa5ee4435bffaa140bf8d2d01: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:27:29.055454 29188 catalog_manager.cc:5495] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b reported cstate change: term changed from 0 to 1, leader changed from <none> to fe1a5faed6c74e03a4fec4c8a5e17a2b (127.26.185.1). New cstate: current_term: 1 leader_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } health_report { overall_health: HEALTHY } } }
I20260809 05:27:29.089114 30040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:29.082155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56542 (local address 127.26.185.1:33033)
0809 05:27:29.082413 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:29.082420 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:29.082526 (+ 106us) server_negotiation.cc:407] Connection header received
0809 05:27:29.082961 (+ 435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:29.082966 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:29.083147 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:29.083316 (+ 169us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:27:29.083745 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.084650 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.086165 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.086705 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.086853 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:29.087518 (+ 665us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:27:29.088329 (+ 811us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:27:29.088509 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:29.088657 (+ 148us) server_negotiation.cc:299] Negotiation successful
0809 05:27:29.088767 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 05:27:29.100394 29684 raft_consensus.cc:1261] T b94e286c572a4749bbb04763ca530869 P 139c0831ab82459c81f35ef3a323b18a [term 1 FOLLOWER]: Refusing update from remote peer fe1a5faed6c74e03a4fec4c8a5e17a2b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:27:29.100384 29916 raft_consensus.cc:1261] T b94e286c572a4749bbb04763ca530869 P 2a6a591aa5ee4435bffaa140bf8d2d01 [term 1 FOLLOWER]: Refusing update from remote peer fe1a5faed6c74e03a4fec4c8a5e17a2b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:27:29.102109 30053 consensus_queue.cc:1035] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:27:29.102627 30059 consensus_queue.cc:1035] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:27:29.122709 30065 mvcc.cc:205] Tried to move back new op lower bound from 7316493308299862016 to 7316493308110876672. Current Snapshot: MvccSnapshot[applied={T|T < 7316493308299862016}]
I20260809 05:27:29.127068 30066 mvcc.cc:205] Tried to move back new op lower bound from 7316493308299862016 to 7316493308110876672. Current Snapshot: MvccSnapshot[applied={T|T < 7316493308299862016}]
I20260809 05:27:29.145447 29188 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48456:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:27:29.145910 29188 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48456:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:27:29.150808 29188 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ed6e5cda279540b991eac7b57bc60aa5: Sending DeleteTablet for 3 replicas of tablet b94e286c572a4749bbb04763ca530869
I20260809 05:27:29.152374 29422 tablet_service.cc:1514] Processing DeleteTablet for tablet b94e286c572a4749bbb04763ca530869 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:27:29 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:56534
I20260809 05:27:29.152380 29661 tablet_service.cc:1514] Processing DeleteTablet for tablet b94e286c572a4749bbb04763ca530869 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:27:29 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:33440
I20260809 05:27:29.152596 29888 tablet_service.cc:1514] Processing DeleteTablet for tablet b94e286c572a4749bbb04763ca530869 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:27:29 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:52884
I20260809 05:27:29.158248 29188 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48456:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 05:27:29.159188 29188 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 05:27:29.172137 29420 tablet_service.cc:1467] Processing CreateTablet for tablet 253f164d30804e009c5375c16e4e6c58 (DEFAULT_TABLE table=test-table [id=1ec4d08640854f8191c4615267ee1586]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:27:29.173043 29420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 253f164d30804e009c5375c16e4e6c58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:29.176527 29660 tablet_service.cc:1467] Processing CreateTablet for tablet 253f164d30804e009c5375c16e4e6c58 (DEFAULT_TABLE table=test-table [id=1ec4d08640854f8191c4615267ee1586]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:27:29.177018 29887 tablet_service.cc:1467] Processing CreateTablet for tablet 253f164d30804e009c5375c16e4e6c58 (DEFAULT_TABLE table=test-table [id=1ec4d08640854f8191c4615267ee1586]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:27:29.177354 29660 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 253f164d30804e009c5375c16e4e6c58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:29.177699 29887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 253f164d30804e009c5375c16e4e6c58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:29.181025 30080 tablet_replica.cc:330] T b94e286c572a4749bbb04763ca530869 P 2a6a591aa5ee4435bffaa140bf8d2d01: stopping tablet replica
I20260809 05:27:29.181740 30080 raft_consensus.cc:2229] T b94e286c572a4749bbb04763ca530869 P 2a6a591aa5ee4435bffaa140bf8d2d01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:27:29.182432 30080 raft_consensus.cc:2258] T b94e286c572a4749bbb04763ca530869 P 2a6a591aa5ee4435bffaa140bf8d2d01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:27:29.185253 30080 ts_tablet_manager.cc:1905] T b94e286c572a4749bbb04763ca530869 P 2a6a591aa5ee4435bffaa140bf8d2d01: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:27:29.186901 30051 tablet_bootstrap.cc:492] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01: Bootstrap starting.
I20260809 05:27:29.188973 30051 tablet_bootstrap.cc:654] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:29.193727 30048 tablet_bootstrap.cc:492] T 253f164d30804e009c5375c16e4e6c58 P fe1a5faed6c74e03a4fec4c8a5e17a2b: Bootstrap starting.
I20260809 05:27:29.193778 30080 ts_tablet_manager.cc:1918] T b94e286c572a4749bbb04763ca530869 P 2a6a591aa5ee4435bffaa140bf8d2d01: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:27:29.193954 30080 log.cc:1196] T b94e286c572a4749bbb04763ca530869 P 2a6a591aa5ee4435bffaa140bf8d2d01: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-2/wal/wals/b94e286c572a4749bbb04763ca530869
I20260809 05:27:29.194654 30080 ts_tablet_manager.cc:1939] T b94e286c572a4749bbb04763ca530869 P 2a6a591aa5ee4435bffaa140bf8d2d01: Deleting consensus metadata
I20260809 05:27:29.195802 30048 tablet_bootstrap.cc:654] T 253f164d30804e009c5375c16e4e6c58 P fe1a5faed6c74e03a4fec4c8a5e17a2b: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:29.197517 29166 catalog_manager.cc:4841] TS 2a6a591aa5ee4435bffaa140bf8d2d01 (127.26.185.3:40843): tablet b94e286c572a4749bbb04763ca530869 (table test-table [id=18021118d93840bd81f6bb96b49da7e2]) successfully deleted
I20260809 05:27:29.198856 30051 tablet_bootstrap.cc:492] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01: No bootstrap required, opened a new log
I20260809 05:27:29.199129 30051 ts_tablet_manager.cc:1397] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.005s
I20260809 05:27:29.200196 30051 raft_consensus.cc:348] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } } peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } }
I20260809 05:27:29.200531 30051 raft_consensus.cc:374] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:29.200577 30047 tablet_bootstrap.cc:492] T 253f164d30804e009c5375c16e4e6c58 P 139c0831ab82459c81f35ef3a323b18a: Bootstrap starting.
I20260809 05:27:29.200663 30051 raft_consensus.cc:729] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a6a591aa5ee4435bffaa140bf8d2d01, State: Initialized, Role: FOLLOWER
I20260809 05:27:29.201054 30051 consensus_queue.cc:260] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } } peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } }
I20260809 05:27:29.203339 30047 tablet_bootstrap.cc:654] T 253f164d30804e009c5375c16e4e6c58 P 139c0831ab82459c81f35ef3a323b18a: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:29.204644 30051 ts_tablet_manager.cc:1428] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260809 05:27:29.206771 30079 tablet_replica.cc:330] T b94e286c572a4749bbb04763ca530869 P 139c0831ab82459c81f35ef3a323b18a: stopping tablet replica
I20260809 05:27:29.207536 30079 raft_consensus.cc:2229] T b94e286c572a4749bbb04763ca530869 P 139c0831ab82459c81f35ef3a323b18a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:27:29.208250 30079 raft_consensus.cc:2258] T b94e286c572a4749bbb04763ca530869 P 139c0831ab82459c81f35ef3a323b18a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:27:29.208741 30078 tablet_replica.cc:330] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b: stopping tablet replica
I20260809 05:27:29.209347 30078 raft_consensus.cc:2229] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 1 LEADER]: Raft consensus shutting down.
I20260809 05:27:29.210371 30078 raft_consensus.cc:2258] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:27:29.212440 30079 ts_tablet_manager.cc:1905] T b94e286c572a4749bbb04763ca530869 P 139c0831ab82459c81f35ef3a323b18a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:27:29.215794 30048 tablet_bootstrap.cc:492] T 253f164d30804e009c5375c16e4e6c58 P fe1a5faed6c74e03a4fec4c8a5e17a2b: No bootstrap required, opened a new log
I20260809 05:27:29.216025 30048 ts_tablet_manager.cc:1397] T 253f164d30804e009c5375c16e4e6c58 P fe1a5faed6c74e03a4fec4c8a5e17a2b: Time spent bootstrapping tablet: real 0.022s user 0.008s sys 0.002s
I20260809 05:27:29.216317 30047 tablet_bootstrap.cc:492] T 253f164d30804e009c5375c16e4e6c58 P 139c0831ab82459c81f35ef3a323b18a: No bootstrap required, opened a new log
I20260809 05:27:29.216522 30047 ts_tablet_manager.cc:1397] T 253f164d30804e009c5375c16e4e6c58 P 139c0831ab82459c81f35ef3a323b18a: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.010s
I20260809 05:27:29.217203 30048 raft_consensus.cc:348] T 253f164d30804e009c5375c16e4e6c58 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } } peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } }
I20260809 05:27:29.217526 30048 raft_consensus.cc:374] T 253f164d30804e009c5375c16e4e6c58 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:29.217651 30048 raft_consensus.cc:729] T 253f164d30804e009c5375c16e4e6c58 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe1a5faed6c74e03a4fec4c8a5e17a2b, State: Initialized, Role: FOLLOWER
I20260809 05:27:29.217486 30047 raft_consensus.cc:348] T 253f164d30804e009c5375c16e4e6c58 P 139c0831ab82459c81f35ef3a323b18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } } peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } }
I20260809 05:27:29.217788 30047 raft_consensus.cc:374] T 253f164d30804e009c5375c16e4e6c58 P 139c0831ab82459c81f35ef3a323b18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:29.217953 30047 raft_consensus.cc:729] T 253f164d30804e009c5375c16e4e6c58 P 139c0831ab82459c81f35ef3a323b18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 139c0831ab82459c81f35ef3a323b18a, State: Initialized, Role: FOLLOWER
I20260809 05:27:29.218109 30048 consensus_queue.cc:260] T 253f164d30804e009c5375c16e4e6c58 P fe1a5faed6c74e03a4fec4c8a5e17a2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } } peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } }
I20260809 05:27:29.218853 30048 ts_tablet_manager.cc:1428] T 253f164d30804e009c5375c16e4e6c58 P fe1a5faed6c74e03a4fec4c8a5e17a2b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 05:27:29.220738 30078 ts_tablet_manager.cc:1905] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:27:29.221648 30079 ts_tablet_manager.cc:1918] T b94e286c572a4749bbb04763ca530869 P 139c0831ab82459c81f35ef3a323b18a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:27:29.221848 30079 log.cc:1196] T b94e286c572a4749bbb04763ca530869 P 139c0831ab82459c81f35ef3a323b18a: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-1/wal/wals/b94e286c572a4749bbb04763ca530869
I20260809 05:27:29.222492 30079 ts_tablet_manager.cc:1939] T b94e286c572a4749bbb04763ca530869 P 139c0831ab82459c81f35ef3a323b18a: Deleting consensus metadata
I20260809 05:27:29.224677 30047 consensus_queue.cc:260] T 253f164d30804e009c5375c16e4e6c58 P 139c0831ab82459c81f35ef3a323b18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } } peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } }
I20260809 05:27:29.224860 29166 catalog_manager.cc:4841] TS 139c0831ab82459c81f35ef3a323b18a (127.26.185.2:39703): tablet b94e286c572a4749bbb04763ca530869 (table test-table [id=18021118d93840bd81f6bb96b49da7e2]) successfully deleted
I20260809 05:27:29.225373 30047 ts_tablet_manager.cc:1428] T 253f164d30804e009c5375c16e4e6c58 P 139c0831ab82459c81f35ef3a323b18a: Time spent starting tablet: real 0.009s user 0.001s sys 0.002s
I20260809 05:27:29.231926 30078 ts_tablet_manager.cc:1918] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:27:29.232146 30078 log.cc:1196] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-0/wal/wals/b94e286c572a4749bbb04763ca530869
I20260809 05:27:29.232771 30078 ts_tablet_manager.cc:1939] T b94e286c572a4749bbb04763ca530869 P fe1a5faed6c74e03a4fec4c8a5e17a2b: Deleting consensus metadata
I20260809 05:27:29.234959 29167 catalog_manager.cc:4841] TS fe1a5faed6c74e03a4fec4c8a5e17a2b (127.26.185.1:33033): tablet b94e286c572a4749bbb04763ca530869 (table test-table [id=18021118d93840bd81f6bb96b49da7e2]) successfully deleted
I20260809 05:27:29.261797 30056 raft_consensus.cc:482] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:27:29.262190 30056 raft_consensus.cc:504] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } } peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } }
I20260809 05:27:29.264597 30056 leader_election.cc:288] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe1a5faed6c74e03a4fec4c8a5e17a2b (127.26.185.1:33033), 139c0831ab82459c81f35ef3a323b18a (127.26.185.2:39703)
I20260809 05:27:29.272868 29817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:29.264867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:33033 (local address 127.26.185.3:34937)
0809 05:27:29.265102 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:29.265130 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:29.265280 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:29.266410 (+ 1130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:29.266415 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:29.266450 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:27:29.266719 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:29.266734 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.268298 (+ 1564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.268307 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:29.270717 (+ 2410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:29.270737 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.271997 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.272004 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:29.272204 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:29.272231 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 05:27:29.272349 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 05:27:29.272502 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79}
I20260809 05:27:29.272914 30040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:29.265220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:34937 (local address 127.26.185.1:33033)
0809 05:27:29.265594 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:29.265602 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:29.265623 (+ 21us) server_negotiation.cc:407] Connection header received
0809 05:27:29.265717 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:29.265722 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:29.265846 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:29.265950 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:27:29.266953 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.268129 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.270929 (+ 2800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.271812 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.272024 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:29.272118 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:29.272383 (+ 265us) server_negotiation.cc:299] Negotiation successful
0809 05:27:29.272528 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215}
I20260809 05:27:29.274019 30036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:29.265669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:37511 (local address 127.26.185.2:39703)
0809 05:27:29.266277 (+ 608us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:29.266284 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:29.266555 (+ 271us) server_negotiation.cc:407] Connection header received
0809 05:27:29.266743 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:29.266749 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:29.266843 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:29.266962 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:27:29.267973 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.269075 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.271044 (+ 1969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.272399 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.272612 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:29.272711 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:29.273534 (+ 823us) server_negotiation.cc:299] Negotiation successful
0809 05:27:29.273688 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":459}
I20260809 05:27:29.274267 30087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:29.265240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:39703 (local address 127.26.185.3:37511)
0809 05:27:29.266421 (+ 1181us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:29.266440 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:29.266574 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:29.267223 (+ 649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:29.267229 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:29.267261 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:27:29.267719 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:29.267736 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.269245 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.269258 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:29.270767 (+ 1509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:29.270780 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.272917 (+ 2137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.272925 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:29.273310 (+ 385us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:29.273362 (+ 52us) client_negotiation.cc:769] Sending connection context
0809 05:27:29.273484 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 05:27:29.273632 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1024,"mutex_wait_us":4,"thread_start_us":874,"threads_started":1}
I20260809 05:27:29.274026 29452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "253f164d30804e009c5375c16e4e6c58" candidate_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" is_pre_election: true
I20260809 05:27:29.274631 29452 raft_consensus.cc:2454] T 253f164d30804e009c5375c16e4e6c58 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a6a591aa5ee4435bffaa140bf8d2d01 in term 0.
I20260809 05:27:29.275168 29684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "253f164d30804e009c5375c16e4e6c58" candidate_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "139c0831ab82459c81f35ef3a323b18a" is_pre_election: true
I20260809 05:27:29.275501 29684 raft_consensus.cc:2454] T 253f164d30804e009c5375c16e4e6c58 P 139c0831ab82459c81f35ef3a323b18a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a6a591aa5ee4435bffaa140bf8d2d01 in term 0.
I20260809 05:27:29.275660 29802 leader_election.cc:302] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a6a591aa5ee4435bffaa140bf8d2d01, fe1a5faed6c74e03a4fec4c8a5e17a2b; no voters:
I20260809 05:27:29.276127 30056 raft_consensus.cc:2781] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:27:29.276273 30056 raft_consensus.cc:482] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:27:29.276400 30056 raft_consensus.cc:3037] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:29.279057 30056 raft_consensus.cc:504] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } } peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } }
I20260809 05:27:29.279817 30056 leader_election.cc:288] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01 [CANDIDATE]: Term 1 election: Requested vote from peers fe1a5faed6c74e03a4fec4c8a5e17a2b (127.26.185.1:33033), 139c0831ab82459c81f35ef3a323b18a (127.26.185.2:39703)
I20260809 05:27:29.280405 29452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "253f164d30804e009c5375c16e4e6c58" candidate_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b"
I20260809 05:27:29.280550 29684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "253f164d30804e009c5375c16e4e6c58" candidate_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "139c0831ab82459c81f35ef3a323b18a"
I20260809 05:27:29.280701 29452 raft_consensus.cc:3037] T 253f164d30804e009c5375c16e4e6c58 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:29.280810 29684 raft_consensus.cc:3037] T 253f164d30804e009c5375c16e4e6c58 P 139c0831ab82459c81f35ef3a323b18a [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:29.284408 29684 raft_consensus.cc:2454] T 253f164d30804e009c5375c16e4e6c58 P 139c0831ab82459c81f35ef3a323b18a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a6a591aa5ee4435bffaa140bf8d2d01 in term 1.
I20260809 05:27:29.284443 29452 raft_consensus.cc:2454] T 253f164d30804e009c5375c16e4e6c58 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a6a591aa5ee4435bffaa140bf8d2d01 in term 1.
I20260809 05:27:29.284883 29802 leader_election.cc:302] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a6a591aa5ee4435bffaa140bf8d2d01, fe1a5faed6c74e03a4fec4c8a5e17a2b; no voters:
I20260809 05:27:29.285252 30056 raft_consensus.cc:2781] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:27:29.286481 30056 raft_consensus.cc:686] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01 [term 1 LEADER]: Becoming Leader. State: Replica: 2a6a591aa5ee4435bffaa140bf8d2d01, State: Running, Role: LEADER
I20260809 05:27:29.287374 30056 consensus_queue.cc:237] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } } peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } }
I20260809 05:27:29.291958 29188 catalog_manager.cc:5495] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2a6a591aa5ee4435bffaa140bf8d2d01 (127.26.185.3). New cstate: current_term: 1 leader_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } health_report { overall_health: HEALTHY } } }
Aug 09 05:27:29 dist-test-slave-h3ft krb5kdc[29120](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253246, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:29.363740 30096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:29.346404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:45493 (local address 127.0.0.1:48464)
0809 05:27:29.347222 (+ 818us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:29.347251 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:29.347415 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:29.347836 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:29.347840 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:29.348700 (+ 860us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:27:29.349018 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:29.349028 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.350591 (+ 1563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.350594 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:29.351699 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:29.351713 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.352815 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.352819 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:29.352953 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:29.353906 (+ 953us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:27:29.353946 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:27:29.356727 (+ 2781us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:27:29.361001 (+ 4274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:29.361013 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:29.361021 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:29.361465 (+ 444us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:29.361898 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:29.361901 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:29.361903 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:29.362078 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:29.362742 (+ 664us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:27:29.362749 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:27:29.362917 (+ 168us) client_negotiation.cc:769] Sending connection context
0809 05:27:29.363161 (+ 244us) client_negotiation.cc:240] Negotiation successful
0809 05:27:29.363394 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"thread_start_us":431,"threads_started":1}
I20260809 05:27:29.363957 29813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:29.346382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48464 (local address 127.26.185.62:45493)
0809 05:27:29.346650 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:29.346659 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:29.347362 (+ 703us) server_negotiation.cc:407] Connection header received
0809 05:27:29.347565 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:29.347572 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:29.347671 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:29.347800 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:29.349194 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.350448 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.351862 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.352628 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.352766 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:29.356940 (+ 4174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:29.356947 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:29.356952 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:29.356991 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:29.360799 (+ 3808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:29.361599 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:29.361605 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:29.361610 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:29.361777 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:29.362198 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:29.362203 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:29.362207 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:29.362605 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:29.362763 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:29.363314 (+ 551us) server_negotiation.cc:299] Negotiation successful
0809 05:27:29.363569 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260809 05:27:29.370704 29188 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:48464:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 05:27:29.372319 29188 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 05:27:29.380716 29422 tablet_service.cc:1467] Processing CreateTablet for tablet 38da1393497b4f5e87f2ff2e710fb945 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7e3b3385e7154f94818fd5a832f638b4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 05:27:29.381446 29422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38da1393497b4f5e87f2ff2e710fb945. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:29.386940 29661 tablet_service.cc:1467] Processing CreateTablet for tablet 38da1393497b4f5e87f2ff2e710fb945 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7e3b3385e7154f94818fd5a832f638b4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 05:27:29.387017 29887 tablet_service.cc:1467] Processing CreateTablet for tablet 38da1393497b4f5e87f2ff2e710fb945 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7e3b3385e7154f94818fd5a832f638b4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 05:27:29.387696 29887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38da1393497b4f5e87f2ff2e710fb945. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:29.387694 29661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38da1393497b4f5e87f2ff2e710fb945. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:29.390820 30048 tablet_bootstrap.cc:492] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b: Bootstrap starting.
I20260809 05:27:29.393230 30048 tablet_bootstrap.cc:654] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:29.396309 30047 tablet_bootstrap.cc:492] T 38da1393497b4f5e87f2ff2e710fb945 P 139c0831ab82459c81f35ef3a323b18a: Bootstrap starting.
I20260809 05:27:29.397889 30051 tablet_bootstrap.cc:492] T 38da1393497b4f5e87f2ff2e710fb945 P 2a6a591aa5ee4435bffaa140bf8d2d01: Bootstrap starting.
I20260809 05:27:29.398252 30047 tablet_bootstrap.cc:654] T 38da1393497b4f5e87f2ff2e710fb945 P 139c0831ab82459c81f35ef3a323b18a: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:29.398591 30048 tablet_bootstrap.cc:492] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b: No bootstrap required, opened a new log
I20260809 05:27:29.398872 30048 ts_tablet_manager.cc:1397] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260809 05:27:29.399899 30051 tablet_bootstrap.cc:654] T 38da1393497b4f5e87f2ff2e710fb945 P 2a6a591aa5ee4435bffaa140bf8d2d01: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:29.399848 30048 raft_consensus.cc:348] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } } peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } }
I20260809 05:27:29.400345 30048 raft_consensus.cc:374] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:29.400514 30048 raft_consensus.cc:729] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe1a5faed6c74e03a4fec4c8a5e17a2b, State: Initialized, Role: FOLLOWER
I20260809 05:27:29.400913 30048 consensus_queue.cc:260] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } } peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } }
I20260809 05:27:29.401635 30053 tablet_replica.cc:439] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } } peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } } }
I20260809 05:27:29.402024 30053 tablet_replica.cc:442] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 05:27:29.403877 30048 ts_tablet_manager.cc:1428] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260809 05:27:29.412708 30047 tablet_bootstrap.cc:492] T 38da1393497b4f5e87f2ff2e710fb945 P 139c0831ab82459c81f35ef3a323b18a: No bootstrap required, opened a new log
I20260809 05:27:29.412935 30047 ts_tablet_manager.cc:1397] T 38da1393497b4f5e87f2ff2e710fb945 P 139c0831ab82459c81f35ef3a323b18a: Time spent bootstrapping tablet: real 0.017s user 0.008s sys 0.007s
I20260809 05:27:29.413658 30047 raft_consensus.cc:348] T 38da1393497b4f5e87f2ff2e710fb945 P 139c0831ab82459c81f35ef3a323b18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } } peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } }
I20260809 05:27:29.413926 30047 raft_consensus.cc:374] T 38da1393497b4f5e87f2ff2e710fb945 P 139c0831ab82459c81f35ef3a323b18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:29.414021 30047 raft_consensus.cc:729] T 38da1393497b4f5e87f2ff2e710fb945 P 139c0831ab82459c81f35ef3a323b18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 139c0831ab82459c81f35ef3a323b18a, State: Initialized, Role: FOLLOWER
W20260809 05:27:29.414112 29764 tablet.cc:2369] T 253f164d30804e009c5375c16e4e6c58 P 139c0831ab82459c81f35ef3a323b18a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:27:29.414361 30047 consensus_queue.cc:260] T 38da1393497b4f5e87f2ff2e710fb945 P 139c0831ab82459c81f35ef3a323b18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } } peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } }
I20260809 05:27:29.415202 30054 tablet_replica.cc:439] T 38da1393497b4f5e87f2ff2e710fb945 P 139c0831ab82459c81f35ef3a323b18a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } } peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } } }
I20260809 05:27:29.415567 30054 tablet_replica.cc:442] T 38da1393497b4f5e87f2ff2e710fb945 P 139c0831ab82459c81f35ef3a323b18a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 05:27:29.415813 30051 tablet_bootstrap.cc:492] T 38da1393497b4f5e87f2ff2e710fb945 P 2a6a591aa5ee4435bffaa140bf8d2d01: No bootstrap required, opened a new log
I20260809 05:27:29.416030 30051 ts_tablet_manager.cc:1397] T 38da1393497b4f5e87f2ff2e710fb945 P 2a6a591aa5ee4435bffaa140bf8d2d01: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.003s
I20260809 05:27:29.417030 30047 ts_tablet_manager.cc:1428] T 38da1393497b4f5e87f2ff2e710fb945 P 139c0831ab82459c81f35ef3a323b18a: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260809 05:27:29.416903 30051 raft_consensus.cc:348] T 38da1393497b4f5e87f2ff2e710fb945 P 2a6a591aa5ee4435bffaa140bf8d2d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } } peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } }
I20260809 05:27:29.417219 30051 raft_consensus.cc:374] T 38da1393497b4f5e87f2ff2e710fb945 P 2a6a591aa5ee4435bffaa140bf8d2d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:29.417311 30051 raft_consensus.cc:729] T 38da1393497b4f5e87f2ff2e710fb945 P 2a6a591aa5ee4435bffaa140bf8d2d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a6a591aa5ee4435bffaa140bf8d2d01, State: Initialized, Role: FOLLOWER
I20260809 05:27:29.417577 30051 consensus_queue.cc:260] T 38da1393497b4f5e87f2ff2e710fb945 P 2a6a591aa5ee4435bffaa140bf8d2d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } } peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } }
I20260809 05:27:29.418058 30056 tablet_replica.cc:439] T 38da1393497b4f5e87f2ff2e710fb945 P 2a6a591aa5ee4435bffaa140bf8d2d01: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } } peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } } }
I20260809 05:27:29.418371 30056 tablet_replica.cc:442] T 38da1393497b4f5e87f2ff2e710fb945 P 2a6a591aa5ee4435bffaa140bf8d2d01: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 05:27:29.418857 30051 ts_tablet_manager.cc:1428] T 38da1393497b4f5e87f2ff2e710fb945 P 2a6a591aa5ee4435bffaa140bf8d2d01: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 05:27:29.483145 30053 raft_consensus.cc:482] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:27:29.483475 30053 raft_consensus.cc:504] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } } peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } }
I20260809 05:27:29.484539 30053 leader_election.cc:288] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 139c0831ab82459c81f35ef3a323b18a (127.26.185.2:39703), 2a6a591aa5ee4435bffaa140bf8d2d01 (127.26.185.3:40843)
I20260809 05:27:29.485438 29916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38da1393497b4f5e87f2ff2e710fb945" candidate_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" is_pre_election: true
I20260809 05:27:29.485427 29684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38da1393497b4f5e87f2ff2e710fb945" candidate_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "139c0831ab82459c81f35ef3a323b18a" is_pre_election: true
I20260809 05:27:29.485785 29916 raft_consensus.cc:2454] T 38da1393497b4f5e87f2ff2e710fb945 P 2a6a591aa5ee4435bffaa140bf8d2d01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe1a5faed6c74e03a4fec4c8a5e17a2b in term 0.
I20260809 05:27:29.485811 29684 raft_consensus.cc:2454] T 38da1393497b4f5e87f2ff2e710fb945 P 139c0831ab82459c81f35ef3a323b18a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe1a5faed6c74e03a4fec4c8a5e17a2b in term 0.
I20260809 05:27:29.486472 29342 leader_election.cc:302] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 139c0831ab82459c81f35ef3a323b18a, fe1a5faed6c74e03a4fec4c8a5e17a2b; no voters:
I20260809 05:27:29.486871 30053 raft_consensus.cc:2781] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:27:29.487049 30053 raft_consensus.cc:482] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:27:29.487180 30053 raft_consensus.cc:3037] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:29.490872 30053 raft_consensus.cc:504] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } } peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } }
I20260809 05:27:29.491815 30053 leader_election.cc:288] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b [CANDIDATE]: Term 1 election: Requested vote from peers 139c0831ab82459c81f35ef3a323b18a (127.26.185.2:39703), 2a6a591aa5ee4435bffaa140bf8d2d01 (127.26.185.3:40843)
I20260809 05:27:29.492411 29684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38da1393497b4f5e87f2ff2e710fb945" candidate_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "139c0831ab82459c81f35ef3a323b18a"
I20260809 05:27:29.492805 29684 raft_consensus.cc:3037] T 38da1393497b4f5e87f2ff2e710fb945 P 139c0831ab82459c81f35ef3a323b18a [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:29.492767 29916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38da1393497b4f5e87f2ff2e710fb945" candidate_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01"
I20260809 05:27:29.493049 29916 raft_consensus.cc:3037] T 38da1393497b4f5e87f2ff2e710fb945 P 2a6a591aa5ee4435bffaa140bf8d2d01 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:29.496343 29684 raft_consensus.cc:2454] T 38da1393497b4f5e87f2ff2e710fb945 P 139c0831ab82459c81f35ef3a323b18a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe1a5faed6c74e03a4fec4c8a5e17a2b in term 1.
I20260809 05:27:29.496366 29916 raft_consensus.cc:2454] T 38da1393497b4f5e87f2ff2e710fb945 P 2a6a591aa5ee4435bffaa140bf8d2d01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe1a5faed6c74e03a4fec4c8a5e17a2b in term 1.
I20260809 05:27:29.496889 29342 leader_election.cc:302] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a6a591aa5ee4435bffaa140bf8d2d01, fe1a5faed6c74e03a4fec4c8a5e17a2b; no voters:
I20260809 05:27:29.497278 30053 raft_consensus.cc:2781] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:27:29.497516 30053 raft_consensus.cc:686] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 1 LEADER]: Becoming Leader. State: Replica: fe1a5faed6c74e03a4fec4c8a5e17a2b, State: Running, Role: LEADER
I20260809 05:27:29.497888 30053 consensus_queue.cc:237] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } } peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } }
I20260809 05:27:29.500226 30059 tablet_replica.cc:439] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b: TxnStatusTablet state changed. Reason: New leader fe1a5faed6c74e03a4fec4c8a5e17a2b. Latest consensus state: current_term: 1 leader_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } } peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } } }
I20260809 05:27:29.500639 30059 tablet_replica.cc:442] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b: This TxnStatusTablet replica's current role is: LEADER
I20260809 05:27:29.502341 29184 catalog_manager.cc:5495] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b reported cstate change: term changed from 0 to 1, leader changed from <none> to fe1a5faed6c74e03a4fec4c8a5e17a2b (127.26.185.1). New cstate: current_term: 1 leader_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } health_report { overall_health: UNKNOWN } } }
I20260809 05:27:29.503692 30103 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 05:27:29.504038 30103 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 05:27:29.529685 30040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:29.522185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56558 (local address 127.26.185.1:33033)
0809 05:27:29.522472 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:29.522480 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:29.522724 (+ 244us) server_negotiation.cc:407] Connection header received
0809 05:27:29.523115 (+ 391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:29.523122 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:29.523218 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:29.523339 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:27:29.523832 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.525184 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.527295 (+ 2111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.528089 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.528219 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:29.528819 (+ 600us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:27:29.528977 (+ 158us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:27:29.529060 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:29.529248 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 05:27:29.529344 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 05:27:29.529776 30096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:29.522340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:33033 (local address 127.0.0.1:56558)
0809 05:27:29.522617 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:29.522642 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:29.522837 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:29.523378 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:29.523397 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:29.523411 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 05:27:29.523669 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:29.523684 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.525355 (+ 1671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.525360 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:29.527123 (+ 1763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:29.527140 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.528268 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.528274 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:29.528484 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:29.528601 (+ 117us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 05:27:29.529087 (+ 486us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 05:27:29.529114 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 05:27:29.529212 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 05:27:29.529417 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 05:27:29.535760 29916 raft_consensus.cc:1261] T 38da1393497b4f5e87f2ff2e710fb945 P 2a6a591aa5ee4435bffaa140bf8d2d01 [term 1 FOLLOWER]: Refusing update from remote peer fe1a5faed6c74e03a4fec4c8a5e17a2b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:27:29.535835 29684 raft_consensus.cc:1261] T 38da1393497b4f5e87f2ff2e710fb945 P 139c0831ab82459c81f35ef3a323b18a [term 1 FOLLOWER]: Refusing update from remote peer fe1a5faed6c74e03a4fec4c8a5e17a2b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:27:29.536835 30053 consensus_queue.cc:1035] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:27:29.537201 30059 consensus_queue.cc:1035] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:27:29.544871 30056 tablet_replica.cc:439] T 38da1393497b4f5e87f2ff2e710fb945 P 2a6a591aa5ee4435bffaa140bf8d2d01: TxnStatusTablet state changed. Reason: New leader fe1a5faed6c74e03a4fec4c8a5e17a2b. Latest consensus state: current_term: 1 leader_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } } peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } } }
I20260809 05:27:29.545254 30056 tablet_replica.cc:442] T 38da1393497b4f5e87f2ff2e710fb945 P 2a6a591aa5ee4435bffaa140bf8d2d01: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 05:27:29.545537 30054 tablet_replica.cc:439] T 38da1393497b4f5e87f2ff2e710fb945 P 139c0831ab82459c81f35ef3a323b18a: TxnStatusTablet state changed. Reason: New leader fe1a5faed6c74e03a4fec4c8a5e17a2b. Latest consensus state: current_term: 1 leader_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } } peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } } }
I20260809 05:27:29.545905 30054 tablet_replica.cc:442] T 38da1393497b4f5e87f2ff2e710fb945 P 139c0831ab82459c81f35ef3a323b18a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 05:27:29.549213 30059 tablet_replica.cc:439] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } } peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } } }
I20260809 05:27:29.549512 30059 tablet_replica.cc:442] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b: This TxnStatusTablet replica's current role is: LEADER
I20260809 05:27:29.552114 30054 tablet_replica.cc:439] T 38da1393497b4f5e87f2ff2e710fb945 P 139c0831ab82459c81f35ef3a323b18a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } } peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } } }
I20260809 05:27:29.552436 30054 tablet_replica.cc:442] T 38da1393497b4f5e87f2ff2e710fb945 P 139c0831ab82459c81f35ef3a323b18a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 05:27:29.553334 30059 tablet_replica.cc:439] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } } peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } } }
I20260809 05:27:29.553622 30059 tablet_replica.cc:442] T 38da1393497b4f5e87f2ff2e710fb945 P fe1a5faed6c74e03a4fec4c8a5e17a2b: This TxnStatusTablet replica's current role is: LEADER
I20260809 05:27:29.554548 30068 mvcc.cc:205] Tried to move back new op lower bound from 7316493310089011200 to 7316493309946814464. Current Snapshot: MvccSnapshot[applied={T|T < 7316493310089011200}]
I20260809 05:27:29.554898 30056 tablet_replica.cc:439] T 38da1393497b4f5e87f2ff2e710fb945 P 2a6a591aa5ee4435bffaa140bf8d2d01: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 } } peers { permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 } } peers { permanent_uuid: "2a6a591aa5ee4435bffaa140bf8d2d01" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40843 } } }
I20260809 05:27:29.555261 30056 tablet_replica.cc:442] T 38da1393497b4f5e87f2ff2e710fb945 P 2a6a591aa5ee4435bffaa140bf8d2d01: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 05:27:29.571151 30110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:29.563493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52890 (local address 127.26.185.3:40843)
0809 05:27:29.564209 (+ 716us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:29.564214 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:29.564231 (+ 17us) server_negotiation.cc:407] Connection header received
0809 05:27:29.564334 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:29.564337 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:29.564430 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:29.564584 (+ 154us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:27:29.565088 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.565947 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.568076 (+ 2129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.568576 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.568677 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:29.569470 (+ 793us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:27:29.570266 (+ 796us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:27:29.570389 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:29.570565 (+ 176us) server_negotiation.cc:299] Negotiation successful
0809 05:27:29.570648 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":605,"thread_start_us":434,"threads_started":1}
I20260809 05:27:29.594209 30040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:29.586326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:57935 (local address 127.26.185.1:33033)
0809 05:27:29.586560 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:29.586566 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:29.587057 (+ 491us) server_negotiation.cc:407] Connection header received
0809 05:27:29.587351 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:29.587356 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:29.587468 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:29.587562 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:27:29.588303 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.589292 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.591581 (+ 2289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.592292 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.592412 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:29.593162 (+ 750us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:27:29.593320 (+ 158us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:27:29.593463 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:29.593632 (+ 169us) server_negotiation.cc:299] Negotiation successful
0809 05:27:29.593741 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 05:27:29.594275 30113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:29.586097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:33033 (local address 127.26.185.3:57935)
0809 05:27:29.586841 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:29.586866 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:29.587101 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:29.587631 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:29.587639 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:29.587656 (+ 17us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 05:27:29.588041 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:29.588057 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.589473 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.589481 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:29.591400 (+ 1919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:29.591428 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.592532 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.592540 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:29.592759 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:29.592859 (+ 100us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 05:27:29.593464 (+ 605us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 05:27:29.593482 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 05:27:29.593603 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 05:27:29.593777 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":446,"threads_started":1}
I20260809 05:27:29.609788 29684 raft_consensus.cc:1261] T 253f164d30804e009c5375c16e4e6c58 P 139c0831ab82459c81f35ef3a323b18a [term 1 FOLLOWER]: Refusing update from remote peer 2a6a591aa5ee4435bffaa140bf8d2d01: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:27:29.610273 29452 raft_consensus.cc:1261] T 253f164d30804e009c5375c16e4e6c58 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 1 FOLLOWER]: Refusing update from remote peer 2a6a591aa5ee4435bffaa140bf8d2d01: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:27:29.610726 30056 consensus_queue.cc:1035] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "139c0831ab82459c81f35ef3a323b18a" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:27:29.611254 30089 consensus_queue.cc:1035] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe1a5faed6c74e03a4fec4c8a5e17a2b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:27:29.662595 30110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:29.652595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:59955 (local address 127.26.185.3:40843)
0809 05:27:29.652823 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:29.652832 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:29.655797 (+ 2965us) server_negotiation.cc:407] Connection header received
0809 05:27:29.656213 (+ 416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:29.656219 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:29.656320 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:29.656449 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:27:29.657107 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.658026 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.660490 (+ 2464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.660947 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.661058 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:29.661706 (+ 648us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:27:29.661833 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:27:29.661937 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:29.662124 (+ 187us) server_negotiation.cc:299] Negotiation successful
0809 05:27:29.662222 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 05:27:29.662701 30119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:29.652479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:40843 (local address 127.26.185.1:59955)
0809 05:27:29.655650 (+ 3171us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:29.655682 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:29.655962 (+ 280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:29.656460 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:29.656465 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:29.656478 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 05:27:29.656914 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:29.656939 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.658234 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.658247 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:29.660322 (+ 2075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:29.660339 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.661168 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.661175 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:29.661387 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:29.661505 (+ 118us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 05:27:29.661945 (+ 440us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 05:27:29.661958 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 05:27:29.662058 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 05:27:29.662229 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2883,"thread_start_us":2364,"threads_started":1}
I20260809 05:27:29.711918 29184 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48456:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:27:29.712276 29184 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48456:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:27:29.717219 29184 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ed6e5cda279540b991eac7b57bc60aa5: Sending DeleteTablet for 3 replicas of tablet 253f164d30804e009c5375c16e4e6c58
I20260809 05:27:29.718814 29661 tablet_service.cc:1514] Processing DeleteTablet for tablet 253f164d30804e009c5375c16e4e6c58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:27:29 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:33440
I20260809 05:27:29.718811 29422 tablet_service.cc:1514] Processing DeleteTablet for tablet 253f164d30804e009c5375c16e4e6c58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:27:29 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:56534
I20260809 05:27:29.719257 30078 tablet_replica.cc:330] T 253f164d30804e009c5375c16e4e6c58 P fe1a5faed6c74e03a4fec4c8a5e17a2b: stopping tablet replica
I20260809 05:27:29.719542 30078 raft_consensus.cc:2229] T 253f164d30804e009c5375c16e4e6c58 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:27:29.719676 29887 tablet_service.cc:1514] Processing DeleteTablet for tablet 253f164d30804e009c5375c16e4e6c58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:27:29 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:52884
I20260809 05:27:29.719820 30078 raft_consensus.cc:2258] T 253f164d30804e009c5375c16e4e6c58 P fe1a5faed6c74e03a4fec4c8a5e17a2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:27:29.720183 30079 tablet_replica.cc:330] T 253f164d30804e009c5375c16e4e6c58 P 139c0831ab82459c81f35ef3a323b18a: stopping tablet replica
I20260809 05:27:29.720427 30079 raft_consensus.cc:2229] T 253f164d30804e009c5375c16e4e6c58 P 139c0831ab82459c81f35ef3a323b18a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:27:29.720690 30079 raft_consensus.cc:2258] T 253f164d30804e009c5375c16e4e6c58 P 139c0831ab82459c81f35ef3a323b18a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:27:29.721783 30078 ts_tablet_manager.cc:1905] T 253f164d30804e009c5375c16e4e6c58 P fe1a5faed6c74e03a4fec4c8a5e17a2b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:27:29.721999 30079 ts_tablet_manager.cc:1905] T 253f164d30804e009c5375c16e4e6c58 P 139c0831ab82459c81f35ef3a323b18a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:27:29.730852 30122 tablet_replica.cc:330] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01: stopping tablet replica
I20260809 05:27:29.731319 30078 ts_tablet_manager.cc:1918] T 253f164d30804e009c5375c16e4e6c58 P fe1a5faed6c74e03a4fec4c8a5e17a2b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 05:27:29.731568 30078 log.cc:1196] T 253f164d30804e009c5375c16e4e6c58 P fe1a5faed6c74e03a4fec4c8a5e17a2b: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-0/wal/wals/253f164d30804e009c5375c16e4e6c58
I20260809 05:27:29.731568 30122 raft_consensus.cc:2229] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01 [term 1 LEADER]: Raft consensus shutting down.
I20260809 05:27:29.732025 30078 ts_tablet_manager.cc:1939] T 253f164d30804e009c5375c16e4e6c58 P fe1a5faed6c74e03a4fec4c8a5e17a2b: Deleting consensus metadata
I20260809 05:27:29.733067 30122 raft_consensus.cc:2258] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:27:29.734496 30122 ts_tablet_manager.cc:1905] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:27:29.738023 29167 catalog_manager.cc:4841] TS fe1a5faed6c74e03a4fec4c8a5e17a2b (127.26.185.1:33033): tablet 253f164d30804e009c5375c16e4e6c58 (table test-table [id=1ec4d08640854f8191c4615267ee1586]) successfully deleted
I20260809 05:27:29.744153 30122 ts_tablet_manager.cc:1918] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 05:27:29.744500 30122 log.cc:1196] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-2/wal/wals/253f164d30804e009c5375c16e4e6c58
I20260809 05:27:29.745247 30122 ts_tablet_manager.cc:1939] T 253f164d30804e009c5375c16e4e6c58 P 2a6a591aa5ee4435bffaa140bf8d2d01: Deleting consensus metadata
I20260809 05:27:29.746960 29166 catalog_manager.cc:4841] TS 2a6a591aa5ee4435bffaa140bf8d2d01 (127.26.185.3:40843): tablet 253f164d30804e009c5375c16e4e6c58 (table test-table [id=1ec4d08640854f8191c4615267ee1586]) successfully deleted
I20260809 05:27:29.753880 30079 ts_tablet_manager.cc:1918] T 253f164d30804e009c5375c16e4e6c58 P 139c0831ab82459c81f35ef3a323b18a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 05:27:29.754206 30079 log.cc:1196] T 253f164d30804e009c5375c16e4e6c58 P 139c0831ab82459c81f35ef3a323b18a: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786253234117492-27364-0/minicluster-data/ts-1/wal/wals/253f164d30804e009c5375c16e4e6c58
I20260809 05:27:29.754827 30079 ts_tablet_manager.cc:1939] T 253f164d30804e009c5375c16e4e6c58 P 139c0831ab82459c81f35ef3a323b18a: Deleting consensus metadata
I20260809 05:27:29.756393 29166 catalog_manager.cc:4841] TS 139c0831ab82459c81f35ef3a323b18a (127.26.185.2:39703): tablet 253f164d30804e009c5375c16e4e6c58 (table test-table [id=1ec4d08640854f8191c4615267ee1586]) successfully deleted
Aug 09 05:27:29 dist-test-slave-h3ft krb5kdc[29120](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253248, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.185.1@KRBTEST.COM
I20260809 05:27:29.781581 30040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:29.743482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56564 (local address 127.26.185.1:33033)
0809 05:27:29.743750 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:29.743758 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:29.751373 (+ 7615us) server_negotiation.cc:407] Connection header received
0809 05:27:29.751796 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:29.751803 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:29.751955 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:29.752097 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:29.754827 (+ 2730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.756233 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.758738 (+ 2505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.759530 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.759683 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:29.771733 (+ 12050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:29.771754 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:29.771783 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:29.771855 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:29.777110 (+ 5255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:29.778334 (+ 1224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:29.778348 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:29.778356 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:29.778584 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:29.779152 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:29.779157 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:29.779161 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:29.779752 (+ 591us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:29.780127 (+ 375us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:29.780836 (+ 709us) server_negotiation.cc:299] Negotiation successful
0809 05:27:29.781145 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
W20260809 05:27:29.782599 29524 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56564
I20260809 05:27:29.807320 29813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:29.788523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48478 (local address 127.26.185.62:45493)
0809 05:27:29.788830 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:29.788837 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:29.789151 (+ 314us) server_negotiation.cc:407] Connection header received
0809 05:27:29.789496 (+ 345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:29.789503 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:29.789608 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:29.789724 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:29.791686 (+ 1962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.793025 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.794917 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.795699 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.795837 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:29.799290 (+ 3453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:29.799297 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:29.799302 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:29.799350 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:29.803238 (+ 3888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:29.804172 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:29.804178 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:29.804182 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:29.804364 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:29.804812 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:29.804817 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:29.804820 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:29.805226 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:29.805474 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:29.806660 (+ 1186us) server_negotiation.cc:299] Negotiation successful
0809 05:27:29.806911 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
W20260809 05:27:29.811797 29184 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48478
I20260809 05:27:29.817770 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 29323
I20260809 05:27:29.856671 30040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:29.819368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56580 (local address 127.26.185.1:33033)
0809 05:27:29.819611 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:29.819618 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:29.836903 (+ 17285us) server_negotiation.cc:407] Connection header received
0809 05:27:29.837179 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:29.837186 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:29.837299 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:29.837415 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:29.839599 (+ 2184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.840913 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.843236 (+ 2323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.844055 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.844194 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:29.848284 (+ 4090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:29.848292 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:29.848297 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:29.848351 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:29.852676 (+ 4325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:29.853675 (+ 999us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:29.853686 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:29.853690 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:29.853908 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:29.854423 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:29.854428 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:29.854432 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:29.854845 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:29.855189 (+ 344us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:29.855818 (+ 629us) server_negotiation.cc:299] Negotiation successful
0809 05:27:29.856178 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260809 05:27:29.858743 29524 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56580
W20260809 05:27:29.859555 27364 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 29323: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 05:27:29.859807 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 29323
I20260809 05:27:29.904647 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 29539
Aug 09 05:27:29 dist-test-slave-h3ft krb5kdc[29120](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253248, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.185.2@KRBTEST.COM
I20260809 05:27:29.925408 30133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:29.905755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33454 (local address 127.26.185.2:39703)
0809 05:27:29.906485 (+ 730us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:29.906490 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:29.906510 (+ 20us) server_negotiation.cc:407] Connection header received
0809 05:27:29.906588 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:29.906593 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:29.906668 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:29.906801 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:29.908820 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.909740 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.911742 (+ 2002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.912294 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.913092 (+ 798us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:29.917867 (+ 4775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:29.917887 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:29.917917 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:29.917961 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:29.921895 (+ 3934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:29.922952 (+ 1057us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:29.922962 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:29.922964 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:29.923190 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:29.923662 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:29.923666 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:29.923668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:29.924144 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:29.924404 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:29.924777 (+ 373us) server_negotiation.cc:299] Negotiation successful
0809 05:27:29.925019 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":616,"thread_start_us":444,"threads_started":1}
W20260809 05:27:29.926287 29756 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33454
W20260809 05:27:29.927088 27364 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 29539: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 05:27:29.927309 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 29539
I20260809 05:27:29.957443 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 29769
Aug 09 05:27:29 dist-test-slave-h3ft krb5kdc[29120](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253248, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.185.3@KRBTEST.COM
I20260809 05:27:29.977568 30110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:29.958524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52898 (local address 127.26.185.3:40843)
0809 05:27:29.958798 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:29.958806 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:29.958834 (+ 28us) server_negotiation.cc:407] Connection header received
0809 05:27:29.959132 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:29.959140 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:29.959238 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:29.959371 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:29.960852 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.961752 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.963255 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:29.963813 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:29.963978 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:29.969347 (+ 5369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:29.969372 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:29.969402 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:29.969467 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:29.973933 (+ 4466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:29.974889 (+ 956us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:29.974901 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:29.974905 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:29.975219 (+ 314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:29.975731 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:29.975738 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:29.975746 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:29.976180 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:29.976619 (+ 439us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:29.976897 (+ 278us) server_negotiation.cc:299] Negotiation successful
0809 05:27:29.977153 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
W20260809 05:27:29.978440 29996 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52898
W20260809 05:27:29.979288 27364 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 29769: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 05:27:29.979487 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 29769
I20260809 05:27:30.014876 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 29142
I20260809 05:27:30.016573 29262 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:27:30.154521 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 29142
2026-08-09T05:27:30Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (5612 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:27:30 dist-test-slave-h3ft krb5kdc[30138](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:27:30 dist-test-slave-h3ft krb5kdc[30138](info): set up 2 sockets
Aug 09 05:27:30 dist-test-slave-h3ft krb5kdc[30138](info): commencing operation
krb5kdc: starting...
W20260809 05:27:31.521561 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.303s user 0.003s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:27:31 dist-test-slave-h3ft krb5kdc[30138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253251, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:27:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:27:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
I20260809 05:27:31.803408 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:41541
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:33191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:41541
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:27:32.207450 30157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:27:32.207854 30157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:27:32.208070 30157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:27:32.216327 30157 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:27:32.216467 30157 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 05:27:32.216548 30157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:27:32.216650 30157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:27:32.216746 30157 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:27:32.216863 30157 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:27:32.228169 30157 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:33191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:41541
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:41541
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:27:32.229890 30157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:27:32.231714 30157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:27:32.246095 30167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:32.246208 30171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:32.246604 30173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:32.247474 30157 server_base.cc:1034] running on GCE node
I20260809 05:27:32.248677 30157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:27:32.250640 30157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:27:32.251978 30157 hybrid_clock.cc:648] HybridClock initialized: now 1786253252251833 us; error 90 us; skew 500 ppm
I20260809 05:27:32.252471 30157 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:27:32 dist-test-slave-h3ft krb5kdc[30138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253252, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:27:32.256748 30157 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:27:32.258745 30157 webserver.cc:460] Webserver started at http://127.26.185.62:41587/ using document root <none> and password file <none>
I20260809 05:27:32.259824 30157 fs_manager.cc:359] Metadata directory not provided
I20260809 05:27:32.259986 30157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:27:32.260413 30157 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:27:32.264644 30157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "fc1ef37618a8471ebe8761ca1fdaebcb"
format_stamp: "Formatted at 2026-08-09 05:27:32 on dist-test-slave-h3ft"
server_key: "8652a5c07f904520084122a7687c32ee"
server_key_iv: "60e9573a33bf1f8cbd7846f373d207f5"
server_key_version: "encryptionkey@0"
I20260809 05:27:32.265647 30157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "fc1ef37618a8471ebe8761ca1fdaebcb"
format_stamp: "Formatted at 2026-08-09 05:27:32 on dist-test-slave-h3ft"
server_key: "8652a5c07f904520084122a7687c32ee"
server_key_iv: "60e9573a33bf1f8cbd7846f373d207f5"
server_key_version: "encryptionkey@0"
I20260809 05:27:32.272943 30157 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260809 05:27:32.277868 30187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:32.279824 30157 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.001s
I20260809 05:27:32.280074 30157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "fc1ef37618a8471ebe8761ca1fdaebcb"
format_stamp: "Formatted at 2026-08-09 05:27:32 on dist-test-slave-h3ft"
server_key: "8652a5c07f904520084122a7687c32ee"
server_key_iv: "60e9573a33bf1f8cbd7846f373d207f5"
server_key_version: "encryptionkey@0"
I20260809 05:27:32.280380 30157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:27:32.305321 30157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:27:32.310992 30157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:27:32.311412 30157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:27:32.337200 30157 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:41541
I20260809 05:27:32.337229 30285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:41541 every 8 connection(s)
I20260809 05:27:32.339118 30157 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:27:32.344189 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 30157
I20260809 05:27:32.344465 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:27:32.344465 30286 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:32.345433 27364 external_mini_cluster.cc:1428] Setting key ac788fea55ba6f0a226b088d425618c4
I20260809 05:27:32.361172 30286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc1ef37618a8471ebe8761ca1fdaebcb: Bootstrap starting.
Aug 09 05:27:32 dist-test-slave-h3ft krb5kdc[30138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253251, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:32.365901 30286 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc1ef37618a8471ebe8761ca1fdaebcb: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:32.367437 30286 log.cc:824] T 00000000000000000000000000000000 P fc1ef37618a8471ebe8761ca1fdaebcb: Log is configured to *not* fsync() on all Append() calls
I20260809 05:27:32.371649 30286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc1ef37618a8471ebe8761ca1fdaebcb: No bootstrap required, opened a new log
I20260809 05:27:32.374518 30291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:32.348204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51350 (local address 127.26.185.62:41541)
0809 05:27:32.349215 (+ 1011us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:32.349230 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:32.349283 (+ 53us) server_negotiation.cc:407] Connection header received
0809 05:27:32.351907 (+ 2624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:32.351938 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:32.352482 (+ 544us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:32.352919 (+ 437us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:32.355172 (+ 2253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:32.356718 (+ 1546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:32.358682 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:32.359571 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:32.359723 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:32.365127 (+ 5404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:32.365136 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:32.365156 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:32.365202 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:32.368891 (+ 3689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:32.369751 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:32.369761 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:32.369771 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:32.370036 (+ 265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:32.370485 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:32.370494 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:32.370499 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:32.371394 (+ 895us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:32.371745 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:32.372265 (+ 520us) server_negotiation.cc:299] Negotiation successful
0809 05:27:32.372859 (+ 594us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":741,"thread_start_us":492,"threads_started":1}
I20260809 05:27:32.381587 30286 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc1ef37618a8471ebe8761ca1fdaebcb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc1ef37618a8471ebe8761ca1fdaebcb" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 41541 } }
I20260809 05:27:32.382050 30286 raft_consensus.cc:374] T 00000000000000000000000000000000 P fc1ef37618a8471ebe8761ca1fdaebcb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:32.382190 30286 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc1ef37618a8471ebe8761ca1fdaebcb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc1ef37618a8471ebe8761ca1fdaebcb, State: Initialized, Role: FOLLOWER
I20260809 05:27:32.383044 30286 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc1ef37618a8471ebe8761ca1fdaebcb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc1ef37618a8471ebe8761ca1fdaebcb" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 41541 } }
I20260809 05:27:32.383344 30286 raft_consensus.cc:388] T 00000000000000000000000000000000 P fc1ef37618a8471ebe8761ca1fdaebcb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:27:32.383530 30286 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc1ef37618a8471ebe8761ca1fdaebcb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:27:32.383728 30286 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc1ef37618a8471ebe8761ca1fdaebcb [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:32.387066 30286 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc1ef37618a8471ebe8761ca1fdaebcb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc1ef37618a8471ebe8761ca1fdaebcb" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 41541 } }
I20260809 05:27:32.387713 30286 leader_election.cc:302] T 00000000000000000000000000000000 P fc1ef37618a8471ebe8761ca1fdaebcb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc1ef37618a8471ebe8761ca1fdaebcb; no voters:
I20260809 05:27:32.388422 30286 leader_election.cc:288] T 00000000000000000000000000000000 P fc1ef37618a8471ebe8761ca1fdaebcb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:27:32.388592 30295 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc1ef37618a8471ebe8761ca1fdaebcb [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:27:32.389454 30295 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc1ef37618a8471ebe8761ca1fdaebcb [term 1 LEADER]: Becoming Leader. State: Replica: fc1ef37618a8471ebe8761ca1fdaebcb, State: Running, Role: LEADER
I20260809 05:27:32.390141 30295 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc1ef37618a8471ebe8761ca1fdaebcb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc1ef37618a8471ebe8761ca1fdaebcb" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 41541 } }
I20260809 05:27:32.391098 30286 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc1ef37618a8471ebe8761ca1fdaebcb [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:27:32.393705 30296 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc1ef37618a8471ebe8761ca1fdaebcb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc1ef37618a8471ebe8761ca1fdaebcb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc1ef37618a8471ebe8761ca1fdaebcb" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 41541 } } }
I20260809 05:27:32.394227 30296 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc1ef37618a8471ebe8761ca1fdaebcb [sys.catalog]: This master's current role is: LEADER
I20260809 05:27:32.398551 30297 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc1ef37618a8471ebe8761ca1fdaebcb [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc1ef37618a8471ebe8761ca1fdaebcb. Latest consensus state: current_term: 1 leader_uuid: "fc1ef37618a8471ebe8761ca1fdaebcb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc1ef37618a8471ebe8761ca1fdaebcb" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 41541 } } }
I20260809 05:27:32.399055 30297 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc1ef37618a8471ebe8761ca1fdaebcb [sys.catalog]: This master's current role is: LEADER
I20260809 05:27:32.399334 30303 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:27:32.405157 30303 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:27:32.416308 30303 catalog_manager.cc:1347] Generated new cluster ID: 3a70e628346e4a99b4522cadf7647802
I20260809 05:27:32.416468 30303 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:27:32.425930 30303 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:27:32.427619 30303 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:27:32.445955 30303 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fc1ef37618a8471ebe8761ca1fdaebcb: Generated new TSK 0
I20260809 05:27:32.447227 30303 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.185.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
I20260809 05:27:32.516326 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:0
--local_ip_for_outbound_sockets=127.26.185.1
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:41541
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:33191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:27:32.946237 30323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:27:32.946673 30323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:27:32.946877 30323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:27:32.955375 30323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:27:32.955582 30323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:27:32.955753 30323 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 05:27:32.955849 30323 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 05:27:32.955996 30323 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:27:32.967831 30323 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:33191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.185.62:41541
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:27:32.969760 30323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:27:32.971588 30323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:27:32.987823 30329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:32.987859 30332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:32.987799 30330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:32.989439 30323 server_base.cc:1034] running on GCE node
I20260809 05:27:32.990334 30323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:27:32.991731 30323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:27:32.992969 30323 hybrid_clock.cc:648] HybridClock initialized: now 1786253252992921 us; error 43 us; skew 500 ppm
I20260809 05:27:32.993367 30323 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:27:32 dist-test-slave-h3ft krb5kdc[30138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253252, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:27:32.997310 30323 init.cc:377] Logged in from keytab as kudu/127.26.185.1@KRBTEST.COM (short username kudu)
I20260809 05:27:32.999284 30323 webserver.cc:460] Webserver started at http://127.26.185.1:46389/ using document root <none> and password file <none>
I20260809 05:27:33.000145 30323 fs_manager.cc:359] Metadata directory not provided
I20260809 05:27:33.000265 30323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:27:33.000589 30323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:27:33.004278 30323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-0/data/instance:
uuid: "422b69f54b1344ad8d69570c9c6ade69"
format_stamp: "Formatted at 2026-08-09 05:27:32 on dist-test-slave-h3ft"
server_key: "2c7ab39cc88b9528bb2ac5c746d94b51"
server_key_iv: "08e3368e5c5a2ece90c904aa04adfc10"
server_key_version: "encryptionkey@0"
I20260809 05:27:33.005122 30323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance:
uuid: "422b69f54b1344ad8d69570c9c6ade69"
format_stamp: "Formatted at 2026-08-09 05:27:32 on dist-test-slave-h3ft"
server_key: "2c7ab39cc88b9528bb2ac5c746d94b51"
server_key_iv: "08e3368e5c5a2ece90c904aa04adfc10"
server_key_version: "encryptionkey@0"
I20260809 05:27:33.011602 30323 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260809 05:27:33.016016 30346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:33.017802 30323 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 05:27:33.018011 30323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "422b69f54b1344ad8d69570c9c6ade69"
format_stamp: "Formatted at 2026-08-09 05:27:32 on dist-test-slave-h3ft"
server_key: "2c7ab39cc88b9528bb2ac5c746d94b51"
server_key_iv: "08e3368e5c5a2ece90c904aa04adfc10"
server_key_version: "encryptionkey@0"
I20260809 05:27:33.018290 30323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:27:33.039227 30323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:27:33.044356 30323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:27:33.044708 30323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:27:33.047920 30323 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:27:33.048072 30323 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:33.048243 30323 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:27:33.048345 30323 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 05:27:33 dist-test-slave-h3ft krb5kdc[30138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253252, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:33.080766 30359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:33.048953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:52525 (local address 127.26.185.62:41541)
0809 05:27:33.049581 (+ 628us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:33.049591 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:33.050911 (+ 1320us) server_negotiation.cc:407] Connection header received
0809 05:27:33.053408 (+ 2497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:33.053422 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:33.053550 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:33.053716 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:33.057432 (+ 3716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:33.058904 (+ 1472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:33.062494 (+ 3590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:33.063332 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:33.063515 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:33.070418 (+ 6903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:33.070430 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:33.070439 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:33.070508 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:33.074826 (+ 4318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:33.076417 (+ 1591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:33.076423 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:33.076427 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:33.076653 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:33.077413 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:33.077422 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:33.077428 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:33.077926 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:33.078136 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:33.079829 (+ 1693us) server_negotiation.cc:299] Negotiation successful
0809 05:27:33.080197 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":464,"thread_start_us":315,"threads_started":1}
I20260809 05:27:33.083170 30361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:33.049678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:41541 (local address 127.26.185.1:52525)
0809 05:27:33.050680 (+ 1002us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:33.050749 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:33.053047 (+ 2298us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:33.054307 (+ 1260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:33.054325 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:33.055652 (+ 1327us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:27:33.057084 (+ 1432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:33.057124 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:33.059243 (+ 2119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:33.059251 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:33.062249 (+ 2998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:33.062274 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:33.063685 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:33.063696 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:33.064163 (+ 467us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:33.065457 (+ 1294us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:27:33.065507 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:27:33.070008 (+ 4501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:27:33.075186 (+ 5178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:33.075198 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:33.075231 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:33.076195 (+ 964us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:33.076828 (+ 633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:33.076834 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:33.076845 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:33.077239 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:33.078254 (+ 1015us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:27:33.078272 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:27:33.079185 (+ 913us) client_negotiation.cc:769] Sending connection context
0809 05:27:33.079673 (+ 488us) client_negotiation.cc:240] Negotiation successful
0809 05:27:33.080656 (+ 983us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":680,"thread_start_us":439,"threads_started":1}
I20260809 05:27:33.104172 30323 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:43181
I20260809 05:27:33.104223 30531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:43181 every 8 connection(s)
I20260809 05:27:33.105973 30323 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:27:33.108989 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 30323
I20260809 05:27:33.109236 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance
I20260809 05:27:33.110006 27364 external_mini_cluster.cc:1428] Setting key 065099b6e2a1bf029100efed6cf3617b
I20260809 05:27:33.111137 30359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:33.092668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:47541 (local address 127.26.185.62:41541)
0809 05:27:33.092927 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:33.092938 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:33.095844 (+ 2906us) server_negotiation.cc:407] Connection header received
0809 05:27:33.096126 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:33.096130 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:33.096249 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:33.096374 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:33.097712 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:33.098933 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:33.100395 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:33.101050 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:33.101220 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:33.104301 (+ 3081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:33.104309 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:33.104315 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:33.104371 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:33.107802 (+ 3431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:33.108700 (+ 898us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:33.108706 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:33.108715 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:33.108864 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:33.109377 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:33.109381 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:33.109383 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:33.109747 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:33.109933 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:33.110427 (+ 494us) server_negotiation.cc:299] Negotiation successful
0809 05:27:33.110705 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 05:27:33.112135 30532 heartbeater.cc:347] Connected to a master server at 127.26.185.62:41541
I20260809 05:27:33.112335 30512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:33.092132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:41541 (local address 127.26.185.1:47541)
0809 05:27:33.095677 (+ 3545us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:33.095709 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:33.095954 (+ 245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:33.096417 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:33.096426 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:33.097114 (+ 688us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:27:33.097548 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:33.097561 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:33.099135 (+ 1574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:33.099146 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:33.100238 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:33.100251 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:33.101308 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:33.101320 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:33.101544 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:33.102389 (+ 845us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:27:33.102429 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:27:33.104042 (+ 1613us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:27:33.107957 (+ 3915us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:33.107962 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:33.107965 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:33.108566 (+ 601us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:33.109011 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:33.109016 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:33.109020 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:33.109229 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:33.109872 (+ 643us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:27:33.109877 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:27:33.110134 (+ 257us) client_negotiation.cc:769] Sending connection context
0809 05:27:33.110300 (+ 166us) client_negotiation.cc:240] Negotiation successful
0809 05:27:33.110697 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3304,"thread_start_us":3102,"threads_started":1}
I20260809 05:27:33.112484 30532 heartbeater.cc:464] Registering TS with master...
I20260809 05:27:33.116180 30532 heartbeater.cc:511] Master 127.26.185.62:41541 requested a full tablet report, sending...
I20260809 05:27:33.119067 30212 ts_manager.cc:194] Registered new tserver with Master: 422b69f54b1344ad8d69570c9c6ade69 (127.26.185.1:43181)
I20260809 05:27:33.121671 30212 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.1@KRBTEST.COM'} at 127.26.185.1:52525
WARNING: no policy specified for kudu/127.26.185.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
I20260809 05:27:33.171803 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:0
--local_ip_for_outbound_sockets=127.26.185.2
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:41541
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:33191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:27:33.579447 30536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:27:33.579934 30536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:27:33.580145 30536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:27:33.588869 30536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:27:33.589064 30536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:27:33.589238 30536 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 05:27:33.589334 30536 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 05:27:33.589483 30536 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:27:33.600750 30536 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:33191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.185.62:41541
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:27:33.602519 30536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:27:33.604329 30536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:27:33.620599 30544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:33.620756 30545 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:33.620708 30548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:33.622236 30536 server_base.cc:1034] running on GCE node
I20260809 05:27:33.623176 30536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:27:33.624470 30536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:27:33.625730 30536 hybrid_clock.cc:648] HybridClock initialized: now 1786253253625651 us; error 66 us; skew 500 ppm
I20260809 05:27:33.626137 30536 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:27:33 dist-test-slave-h3ft krb5kdc[30138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253253, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:27:33.630120 30536 init.cc:377] Logged in from keytab as kudu/127.26.185.2@KRBTEST.COM (short username kudu)
I20260809 05:27:33.631971 30536 webserver.cc:460] Webserver started at http://127.26.185.2:42551/ using document root <none> and password file <none>
I20260809 05:27:33.632869 30536 fs_manager.cc:359] Metadata directory not provided
I20260809 05:27:33.633039 30536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:27:33.633432 30536 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:27:33.637027 30536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-1/data/instance:
uuid: "23dd6c70f2194912960e427740868aa3"
format_stamp: "Formatted at 2026-08-09 05:27:33 on dist-test-slave-h3ft"
server_key: "8a78e378dfa3df57181d77914ee782a8"
server_key_iv: "c1d0f00ac723a8ee39b0b9ae0f56c877"
server_key_version: "encryptionkey@0"
I20260809 05:27:33.637917 30536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance:
uuid: "23dd6c70f2194912960e427740868aa3"
format_stamp: "Formatted at 2026-08-09 05:27:33 on dist-test-slave-h3ft"
server_key: "8a78e378dfa3df57181d77914ee782a8"
server_key_iv: "c1d0f00ac723a8ee39b0b9ae0f56c877"
server_key_version: "encryptionkey@0"
I20260809 05:27:33.644344 30536 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260809 05:27:33.648854 30557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:33.650641 30536 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.004s
I20260809 05:27:33.650859 30536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "23dd6c70f2194912960e427740868aa3"
format_stamp: "Formatted at 2026-08-09 05:27:33 on dist-test-slave-h3ft"
server_key: "8a78e378dfa3df57181d77914ee782a8"
server_key_iv: "c1d0f00ac723a8ee39b0b9ae0f56c877"
server_key_version: "encryptionkey@0"
I20260809 05:27:33.651211 30536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:27:33.666647 30536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:27:33.671852 30536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:27:33.672235 30536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:27:33.675558 30536 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:27:33.675731 30536 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:33.675892 30536 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:27:33.676007 30536 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 05:27:33 dist-test-slave-h3ft krb5kdc[30138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253253, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:33.708153 30571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:33.676285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:44847 (local address 127.26.185.62:41541)
0809 05:27:33.677136 (+ 851us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:33.677145 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:33.678461 (+ 1316us) server_negotiation.cc:407] Connection header received
0809 05:27:33.682134 (+ 3673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:33.682143 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:33.682355 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:33.682505 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:33.686843 (+ 4338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:33.688145 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:33.690646 (+ 2501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:33.691287 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:33.691484 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:33.698069 (+ 6585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:33.698074 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:33.698079 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:33.698129 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:33.702983 (+ 4854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:33.704739 (+ 1756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:33.704746 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:33.704750 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:33.705006 (+ 256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:33.705719 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:33.705727 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:33.705730 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:33.706120 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:33.706321 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:33.707352 (+ 1031us) server_negotiation.cc:299] Negotiation successful
0809 05:27:33.707668 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":697,"thread_start_us":556,"threads_started":1}
I20260809 05:27:33.709594 30572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:33.677149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:41541 (local address 127.26.185.2:44847)
0809 05:27:33.678207 (+ 1058us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:33.678276 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:33.681632 (+ 3356us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:33.683374 (+ 1742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:33.683398 (+ 24us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:33.684902 (+ 1504us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:27:33.686503 (+ 1601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:33.686548 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:33.688342 (+ 1794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:33.688349 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:33.690459 (+ 2110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:33.690477 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:33.691902 (+ 1425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:33.691911 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:33.692298 (+ 387us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:33.693383 (+ 1085us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:27:33.693433 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:27:33.697630 (+ 4197us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:27:33.703307 (+ 5677us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:33.703324 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:33.703358 (+ 34us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:33.704515 (+ 1157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:33.705189 (+ 674us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:33.705192 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:33.705195 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:33.705520 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:33.706307 (+ 787us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:27:33.706317 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:27:33.706839 (+ 522us) client_negotiation.cc:769] Sending connection context
0809 05:27:33.707237 (+ 398us) client_negotiation.cc:240] Negotiation successful
0809 05:27:33.707988 (+ 751us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":702,"thread_start_us":440,"threads_started":1}
I20260809 05:27:33.738516 30536 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:46449
I20260809 05:27:33.738685 30571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:33.718897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:53441 (local address 127.26.185.62:41541)
0809 05:27:33.719250 (+ 353us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:33.719263 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:33.720088 (+ 825us) server_negotiation.cc:407] Connection header received
0809 05:27:33.720384 (+ 296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:33.720389 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:33.720476 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:33.720581 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:33.722508 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:33.723902 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:33.726739 (+ 2837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:33.727290 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:33.727403 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:33.730457 (+ 3054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:33.730466 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:33.730475 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:33.730517 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:33.734433 (+ 3916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:33.735838 (+ 1405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:33.735847 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:33.735853 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:33.736049 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:33.736499 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:33.736503 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:33.736505 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:33.736930 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:33.737106 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:33.737863 (+ 757us) server_negotiation.cc:299] Negotiation successful
0809 05:27:33.738226 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140}
I20260809 05:27:33.738956 30693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:33.718994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:41541 (local address 127.26.185.2:53441)
0809 05:27:33.719911 (+ 917us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:33.719940 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:33.720187 (+ 247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:33.720653 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:33.720661 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:33.721608 (+ 947us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:27:33.722181 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:33.722204 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:33.724109 (+ 1905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:33.724116 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:33.726544 (+ 2428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:33.726565 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:33.727526 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:33.727536 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:33.727739 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:33.728777 (+ 1038us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:27:33.728797 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:27:33.730223 (+ 1426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:27:33.734649 (+ 4426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:33.734659 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:33.734666 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:33.735640 (+ 974us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:33.736193 (+ 553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:33.736198 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:33.736202 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:33.736384 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:33.737090 (+ 706us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:27:33.737096 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:27:33.737472 (+ 376us) client_negotiation.cc:769] Sending connection context
0809 05:27:33.737683 (+ 211us) client_negotiation.cc:240] Negotiation successful
0809 05:27:33.738289 (+ 606us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":668,"thread_start_us":449,"threads_started":1}
I20260809 05:27:33.738634 30742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:46449 every 8 connection(s)
I20260809 05:27:33.740733 30536 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:27:33.741837 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 30536
I20260809 05:27:33.742062 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance
I20260809 05:27:33.742736 27364 external_mini_cluster.cc:1428] Setting key a052c952f589f57d32375dbb64cda882
I20260809 05:27:33.744870 30743 heartbeater.cc:347] Connected to a master server at 127.26.185.62:41541
I20260809 05:27:33.745216 30743 heartbeater.cc:464] Registering TS with master...
I20260809 05:27:33.746136 30743 heartbeater.cc:511] Master 127.26.185.62:41541 requested a full tablet report, sending...
I20260809 05:27:33.748101 30212 ts_manager.cc:194] Registered new tserver with Master: 23dd6c70f2194912960e427740868aa3 (127.26.185.2:46449)
I20260809 05:27:33.749141 30212 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.2@KRBTEST.COM'} at 127.26.185.2:44847
WARNING: no policy specified for kudu/127.26.185.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
I20260809 05:27:33.809175 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:0
--local_ip_for_outbound_sockets=127.26.185.3
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:41541
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:33191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:27:34.125717 30532 heartbeater.cc:503] Master 127.26.185.62:41541 was elected leader, sending a full tablet report...
W20260809 05:27:34.261540 30749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:27:34.261909 30749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:27:34.262140 30749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:27:34.270134 30749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:27:34.270296 30749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:27:34.270488 30749 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 05:27:34.270577 30749 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 05:27:34.270727 30749 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:27:34.282047 30749 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:33191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.185.62:41541
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:27:34.284005 30749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:27:34.285987 30749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:27:34.302709 30755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:34.302613 30760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:34.302686 30756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:34.304075 30749 server_base.cc:1034] running on GCE node
I20260809 05:27:34.304984 30749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:27:34.306341 30749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:27:34.307673 30749 hybrid_clock.cc:648] HybridClock initialized: now 1786253254307613 us; error 62 us; skew 500 ppm
I20260809 05:27:34.308156 30749 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:27:34 dist-test-slave-h3ft krb5kdc[30138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253254, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:27:34.312448 30749 init.cc:377] Logged in from keytab as kudu/127.26.185.3@KRBTEST.COM (short username kudu)
I20260809 05:27:34.314489 30749 webserver.cc:460] Webserver started at http://127.26.185.3:38421/ using document root <none> and password file <none>
I20260809 05:27:34.315470 30749 fs_manager.cc:359] Metadata directory not provided
I20260809 05:27:34.315618 30749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:27:34.316023 30749 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:27:34.319880 30749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-2/data/instance:
uuid: "3c95ebabe2cf4a8b834182865088c360"
format_stamp: "Formatted at 2026-08-09 05:27:34 on dist-test-slave-h3ft"
server_key: "2d94b8daca26f82fbead541799682702"
server_key_iv: "3789305c37d1ecddae5e965f3309002b"
server_key_version: "encryptionkey@0"
I20260809 05:27:34.320785 30749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance:
uuid: "3c95ebabe2cf4a8b834182865088c360"
format_stamp: "Formatted at 2026-08-09 05:27:34 on dist-test-slave-h3ft"
server_key: "2d94b8daca26f82fbead541799682702"
server_key_iv: "3789305c37d1ecddae5e965f3309002b"
server_key_version: "encryptionkey@0"
I20260809 05:27:34.327163 30749 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260809 05:27:34.331265 30775 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:34.332912 30749 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 05:27:34.333127 30749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "3c95ebabe2cf4a8b834182865088c360"
format_stamp: "Formatted at 2026-08-09 05:27:34 on dist-test-slave-h3ft"
server_key: "2d94b8daca26f82fbead541799682702"
server_key_iv: "3789305c37d1ecddae5e965f3309002b"
server_key_version: "encryptionkey@0"
I20260809 05:27:34.333374 30749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:27:34.351110 30749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:27:34.356114 30749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:27:34.356492 30749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:27:34.360018 30749 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:27:34.360157 30749 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:34.360317 30749 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:27:34.360431 30749 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 05:27:34 dist-test-slave-h3ft krb5kdc[30138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253254, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:34.387030 30786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:34.360691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:54329 (local address 127.26.185.62:41541)
0809 05:27:34.361357 (+ 666us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:34.361368 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:34.362518 (+ 1150us) server_negotiation.cc:407] Connection header received
0809 05:27:34.364883 (+ 2365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:34.364890 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:34.365010 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:34.365152 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:34.367829 (+ 2677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.369119 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.372064 (+ 2945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.372702 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.372853 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:34.379387 (+ 6534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:34.379393 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:34.379397 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:34.379439 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:34.382530 (+ 3091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:34.383518 (+ 988us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:34.383526 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:34.383535 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:34.383679 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:34.384328 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:34.384333 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:34.384336 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:34.384896 (+ 560us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:34.385119 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:34.386237 (+ 1118us) server_negotiation.cc:299] Negotiation successful
0809 05:27:34.386510 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":479,"thread_start_us":297,"threads_started":1}
I20260809 05:27:34.388746 30788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:34.361416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:41541 (local address 127.26.185.3:54329)
0809 05:27:34.362328 (+ 912us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:34.362383 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:34.364543 (+ 2160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:34.365451 (+ 908us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:34.365461 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:34.366384 (+ 923us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:27:34.367604 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:34.367641 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.369368 (+ 1727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.369375 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:34.371890 (+ 2515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:34.371912 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.372989 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.373000 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:34.373411 (+ 411us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:34.374609 (+ 1198us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:27:34.374659 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:27:34.378981 (+ 4322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:27:34.382705 (+ 3724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:34.382718 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:34.382739 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:34.383367 (+ 628us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:34.383810 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:34.383815 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:34.383819 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:34.384155 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:34.385111 (+ 956us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:27:34.385123 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:27:34.385684 (+ 561us) client_negotiation.cc:769] Sending connection context
0809 05:27:34.386136 (+ 452us) client_negotiation.cc:240] Negotiation successful
0809 05:27:34.386852 (+ 716us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"thread_start_us":385,"threads_started":1}
I20260809 05:27:34.412747 30786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:34.397024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:36289 (local address 127.26.185.62:41541)
0809 05:27:34.397223 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:34.397228 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:34.397975 (+ 747us) server_negotiation.cc:407] Connection header received
0809 05:27:34.398200 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:34.398206 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:34.398293 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:34.398411 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:34.399653 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.400737 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.402163 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.402645 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.402797 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:34.405584 (+ 2787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:34.405589 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:34.405593 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:34.405627 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:34.409056 (+ 3429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:34.410119 (+ 1063us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:34.410126 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:34.410130 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:34.410342 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:34.410850 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:34.410854 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:34.410856 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:34.411255 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:34.411438 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:34.412114 (+ 676us) server_negotiation.cc:299] Negotiation successful
0809 05:27:34.412363 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 05:27:34.413177 30894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:34.397186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:41541 (local address 127.26.185.3:36289)
0809 05:27:34.397845 (+ 659us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:34.397866 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:34.398055 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:34.398439 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:34.398443 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:34.399055 (+ 612us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:27:34.399507 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:34.399525 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.400904 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.400910 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:34.402017 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:34.402029 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.402849 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.402855 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:34.403115 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:34.403994 (+ 879us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:27:34.404016 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:27:34.405375 (+ 1359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:27:34.409191 (+ 3816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:34.409198 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:34.409202 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:34.409973 (+ 771us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:34.410498 (+ 525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:34.410503 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:34.410507 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:34.410685 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:34.411406 (+ 721us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:27:34.411415 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:27:34.411692 (+ 277us) client_negotiation.cc:769] Sending connection context
0809 05:27:34.411922 (+ 230us) client_negotiation.cc:240] Negotiation successful
0809 05:27:34.412463 (+ 541us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":369,"threads_started":1}
I20260809 05:27:34.427115 30749 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:33997
I20260809 05:27:34.427179 30980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:33997 every 8 connection(s)
I20260809 05:27:34.428660 30749 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:27:34.430508 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 30749
I20260809 05:27:34.430738 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance
I20260809 05:27:34.431368 30981 heartbeater.cc:347] Connected to a master server at 127.26.185.62:41541
I20260809 05:27:34.431488 27364 external_mini_cluster.cc:1428] Setting key 07be92f0e00cd20594877e3db3420d28
I20260809 05:27:34.431669 30981 heartbeater.cc:464] Registering TS with master...
I20260809 05:27:34.432749 30981 heartbeater.cc:511] Master 127.26.185.62:41541 requested a full tablet report, sending...
I20260809 05:27:34.435091 30210 ts_manager.cc:194] Registered new tserver with Master: 3c95ebabe2cf4a8b834182865088c360 (127.26.185.3:33997)
I20260809 05:27:34.436352 30210 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.3@KRBTEST.COM'} at 127.26.185.3:54329
I20260809 05:27:34.456284 27364 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 05:27:34 dist-test-slave-h3ft krb5kdc[30138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253254, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 05:27:34 dist-test-slave-h3ft krb5kdc[30138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253254, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:34.530449 30786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:34.511087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51366 (local address 127.26.185.62:41541)
0809 05:27:34.511361 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:34.511370 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:34.511526 (+ 156us) server_negotiation.cc:407] Connection header received
0809 05:27:34.511906 (+ 380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:34.511911 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:34.512040 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:34.512192 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:34.514557 (+ 2365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.515475 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.517581 (+ 2106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.518095 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.518205 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:34.524056 (+ 5851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:34.524062 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:34.524066 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:34.524107 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:34.527167 (+ 3060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:34.528112 (+ 945us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:34.528116 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:34.528119 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:34.528273 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:34.528753 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:34.528758 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:34.528760 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:34.529145 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:34.529439 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:34.529811 (+ 372us) server_negotiation.cc:299] Negotiation successful
0809 05:27:34.530059 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 05:27:34.536458 30210 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51366:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 05:27:34.544716 30210 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 05:27:34.587903 31006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:34.564257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:33997 (local address 127.0.0.1:47572)
0809 05:27:34.565705 (+ 1448us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:34.565774 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:34.572932 (+ 7158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:34.577693 (+ 4761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:34.577701 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:34.577750 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:27:34.578494 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:34.578511 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.581543 (+ 3032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.581551 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:34.584615 (+ 3064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:34.584637 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.586586 (+ 1949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.586592 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:34.586863 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:34.586931 (+ 68us) client_negotiation.cc:769] Sending connection context
0809 05:27:34.587113 (+ 182us) client_negotiation.cc:240] Negotiation successful
0809 05:27:34.587440 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1120,"thread_start_us":12736,"threads_started":1}
I20260809 05:27:34.588706 31008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:34.565613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47572 (local address 127.26.185.3:33997)
0809 05:27:34.576612 (+ 10999us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:34.576629 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:34.576690 (+ 61us) server_negotiation.cc:407] Connection header received
0809 05:27:34.576866 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:34.576881 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:34.577342 (+ 461us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:34.578765 (+ 1423us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:27:34.579273 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.581358 (+ 2085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.584809 (+ 3451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.586361 (+ 1552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.586523 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:34.586842 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:34.588130 (+ 1288us) server_negotiation.cc:299] Negotiation successful
0809 05:27:34.588355 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10761,"thread_start_us":10528,"threads_started":1}
I20260809 05:27:34.588888 31007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:34.565398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:43181 (local address 127.0.0.1:59616)
0809 05:27:34.578335 (+ 12937us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:34.578360 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:34.578518 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:34.580614 (+ 2096us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:34.580619 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:34.580644 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:27:34.581051 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:34.581064 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.582927 (+ 1863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.582931 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:34.585775 (+ 2844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:34.585791 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.588062 (+ 2271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.588071 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:34.588242 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:34.588272 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 05:27:34.588357 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 05:27:34.588502 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12784,"thread_start_us":12608,"threads_started":1}
I20260809 05:27:34.589740 31012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:34.566182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59616 (local address 127.26.185.1:43181)
0809 05:27:34.579685 (+ 13503us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:34.579697 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:34.579729 (+ 32us) server_negotiation.cc:407] Connection header received
0809 05:27:34.579837 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:34.579844 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:34.580096 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:34.580345 (+ 249us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:27:34.581251 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.582740 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.585978 (+ 3238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.587521 (+ 1543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.587659 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:34.587890 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:34.589184 (+ 1294us) server_negotiation.cc:299] Negotiation successful
0809 05:27:34.589397 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13295,"thread_start_us":13469,"threads_started":1}
I20260809 05:27:34.591046 31004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:34.564759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:46449 (local address 127.0.0.1:34618)
0809 05:27:34.576616 (+ 11857us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:34.576649 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:34.576857 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:34.579938 (+ 3081us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:34.579943 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:34.579971 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:27:34.580455 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:34.580472 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.584139 (+ 3667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.584152 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:34.586419 (+ 2267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:34.586434 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.589304 (+ 2870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.589311 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:34.589495 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:34.589531 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 05:27:34.589634 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 05:27:34.589779 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11609,"thread_start_us":1602,"threads_started":1}
I20260809 05:27:34.591308 31011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:34.566182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34618 (local address 127.26.185.2:46449)
0809 05:27:34.577948 (+ 11766us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:34.577961 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:34.578001 (+ 40us) server_negotiation.cc:407] Connection header received
0809 05:27:34.578122 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:34.578129 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:34.578416 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:34.578668 (+ 252us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:27:34.580681 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.583950 (+ 3269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.586622 (+ 2672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.588781 (+ 2159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.588938 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:34.589164 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:34.589713 (+ 549us) server_negotiation.cc:299] Negotiation successful
0809 05:27:34.590936 (+ 1223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11505,"thread_start_us":11324,"threads_started":1}
I20260809 05:27:34.593716 30423 tablet_service.cc:1467] Processing CreateTablet for tablet f358fdac632b4e878423184f04845bc9 (DEFAULT_TABLE table=test-table [id=1f4339f3acdb49bbb0988a98f0fb9b09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:27:34.593724 30855 tablet_service.cc:1467] Processing CreateTablet for tablet f358fdac632b4e878423184f04845bc9 (DEFAULT_TABLE table=test-table [id=1f4339f3acdb49bbb0988a98f0fb9b09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:27:34.595494 30423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f358fdac632b4e878423184f04845bc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:34.595520 30855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f358fdac632b4e878423184f04845bc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:34.595024 30638 tablet_service.cc:1467] Processing CreateTablet for tablet f358fdac632b4e878423184f04845bc9 (DEFAULT_TABLE table=test-table [id=1f4339f3acdb49bbb0988a98f0fb9b09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:27:34.596413 30638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f358fdac632b4e878423184f04845bc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:34.610821 31013 tablet_bootstrap.cc:492] T f358fdac632b4e878423184f04845bc9 P 422b69f54b1344ad8d69570c9c6ade69: Bootstrap starting.
I20260809 05:27:34.615459 31013 tablet_bootstrap.cc:654] T f358fdac632b4e878423184f04845bc9 P 422b69f54b1344ad8d69570c9c6ade69: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:34.615949 31014 tablet_bootstrap.cc:492] T f358fdac632b4e878423184f04845bc9 P 23dd6c70f2194912960e427740868aa3: Bootstrap starting.
I20260809 05:27:34.618259 31015 tablet_bootstrap.cc:492] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360: Bootstrap starting.
I20260809 05:27:34.618678 31013 log.cc:824] T f358fdac632b4e878423184f04845bc9 P 422b69f54b1344ad8d69570c9c6ade69: Log is configured to *not* fsync() on all Append() calls
I20260809 05:27:34.621639 31014 tablet_bootstrap.cc:654] T f358fdac632b4e878423184f04845bc9 P 23dd6c70f2194912960e427740868aa3: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:34.622200 31015 tablet_bootstrap.cc:654] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:34.623221 31013 tablet_bootstrap.cc:492] T f358fdac632b4e878423184f04845bc9 P 422b69f54b1344ad8d69570c9c6ade69: No bootstrap required, opened a new log
I20260809 05:27:34.623428 31014 log.cc:824] T f358fdac632b4e878423184f04845bc9 P 23dd6c70f2194912960e427740868aa3: Log is configured to *not* fsync() on all Append() calls
I20260809 05:27:34.623585 31013 ts_tablet_manager.cc:1397] T f358fdac632b4e878423184f04845bc9 P 422b69f54b1344ad8d69570c9c6ade69: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.004s
I20260809 05:27:34.623589 31015 log.cc:824] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360: Log is configured to *not* fsync() on all Append() calls
I20260809 05:27:34.626982 31014 tablet_bootstrap.cc:492] T f358fdac632b4e878423184f04845bc9 P 23dd6c70f2194912960e427740868aa3: No bootstrap required, opened a new log
I20260809 05:27:34.627022 31015 tablet_bootstrap.cc:492] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360: No bootstrap required, opened a new log
I20260809 05:27:34.627342 31015 ts_tablet_manager.cc:1397] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360: Time spent bootstrapping tablet: real 0.009s user 0.009s sys 0.000s
I20260809 05:27:34.627336 31014 ts_tablet_manager.cc:1397] T f358fdac632b4e878423184f04845bc9 P 23dd6c70f2194912960e427740868aa3: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.002s
I20260809 05:27:34.632949 31013 raft_consensus.cc:348] T f358fdac632b4e878423184f04845bc9 P 422b69f54b1344ad8d69570c9c6ade69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } }
I20260809 05:27:34.633495 31013 raft_consensus.cc:374] T f358fdac632b4e878423184f04845bc9 P 422b69f54b1344ad8d69570c9c6ade69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:34.633605 31013 raft_consensus.cc:729] T f358fdac632b4e878423184f04845bc9 P 422b69f54b1344ad8d69570c9c6ade69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 422b69f54b1344ad8d69570c9c6ade69, State: Initialized, Role: FOLLOWER
I20260809 05:27:34.634387 31013 consensus_queue.cc:260] T f358fdac632b4e878423184f04845bc9 P 422b69f54b1344ad8d69570c9c6ade69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } }
I20260809 05:27:34.638163 31013 ts_tablet_manager.cc:1428] T f358fdac632b4e878423184f04845bc9 P 422b69f54b1344ad8d69570c9c6ade69: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
I20260809 05:27:34.639269 31015 raft_consensus.cc:348] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } }
I20260809 05:27:34.639217 31014 raft_consensus.cc:348] T f358fdac632b4e878423184f04845bc9 P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } }
I20260809 05:27:34.639779 31014 raft_consensus.cc:374] T f358fdac632b4e878423184f04845bc9 P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:34.639783 31015 raft_consensus.cc:374] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:34.639904 31014 raft_consensus.cc:729] T f358fdac632b4e878423184f04845bc9 P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23dd6c70f2194912960e427740868aa3, State: Initialized, Role: FOLLOWER
I20260809 05:27:34.639904 31015 raft_consensus.cc:729] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c95ebabe2cf4a8b834182865088c360, State: Initialized, Role: FOLLOWER
I20260809 05:27:34.640683 31014 consensus_queue.cc:260] T f358fdac632b4e878423184f04845bc9 P 23dd6c70f2194912960e427740868aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } }
I20260809 05:27:34.640683 31015 consensus_queue.cc:260] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } }
I20260809 05:27:34.642596 30743 heartbeater.cc:503] Master 127.26.185.62:41541 was elected leader, sending a full tablet report...
I20260809 05:27:34.642567 30981 heartbeater.cc:503] Master 127.26.185.62:41541 was elected leader, sending a full tablet report...
I20260809 05:27:34.642944 31014 ts_tablet_manager.cc:1428] T f358fdac632b4e878423184f04845bc9 P 23dd6c70f2194912960e427740868aa3: Time spent starting tablet: real 0.015s user 0.012s sys 0.003s
I20260809 05:27:34.643155 31015 ts_tablet_manager.cc:1428] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360: Time spent starting tablet: real 0.016s user 0.015s sys 0.001s
W20260809 05:27:34.680649 30982 tablet.cc:2369] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:27:34.706257 31027 raft_consensus.cc:482] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:27:34.706791 31027 raft_consensus.cc:504] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } }
I20260809 05:27:34.709672 31027 leader_election.cc:288] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23dd6c70f2194912960e427740868aa3 (127.26.185.2:46449), 422b69f54b1344ad8d69570c9c6ade69 (127.26.185.1:43181)
I20260809 05:27:34.717687 30788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:34.710022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:43181 (local address 127.26.185.3:60851)
0809 05:27:34.710540 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:34.710572 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:34.710770 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:34.711277 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:34.711282 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:34.711312 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:27:34.711721 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:34.711735 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.713166 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.713174 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:34.715174 (+ 2000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:34.715189 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.716655 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.716665 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:34.716896 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:34.716940 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 05:27:34.717061 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 05:27:34.717235 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"mutex_wait_us":1,"spinlock_wait_cycles":35200}
I20260809 05:27:34.717687 31012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:34.710546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:60851 (local address 127.26.185.1:43181)
0809 05:27:34.710813 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:34.710822 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:34.710849 (+ 27us) server_negotiation.cc:407] Connection header received
0809 05:27:34.710954 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:34.710960 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:34.711106 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:34.711224 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:27:34.711913 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.713015 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.715346 (+ 2331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.716477 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.716610 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:34.716675 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:34.717196 (+ 521us) server_negotiation.cc:299] Negotiation successful
0809 05:27:34.717337 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 05:27:34.718586 31011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:34.710208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:43757 (local address 127.26.185.2:46449)
0809 05:27:34.710489 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:34.710499 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:34.711410 (+ 911us) server_negotiation.cc:407] Connection header received
0809 05:27:34.711625 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:34.711634 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:34.711733 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:34.711849 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:27:34.712560 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.713889 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.716130 (+ 2241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.717347 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.717529 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:34.717609 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:34.718127 (+ 518us) server_negotiation.cc:299] Negotiation successful
0809 05:27:34.718336 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 05:27:34.719373 31028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:34.710272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:46449 (local address 127.26.185.3:43757)
0809 05:27:34.711273 (+ 1001us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:34.711295 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:34.711459 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:34.711915 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:34.711920 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:34.711946 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:27:34.712376 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:34.712389 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.714065 (+ 1676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.714070 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:34.715943 (+ 1873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:34.715960 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.717628 (+ 1668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.717635 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:34.717876 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:34.717922 (+ 46us) client_negotiation.cc:769] Sending connection context
0809 05:27:34.718622 (+ 700us) client_negotiation.cc:240] Negotiation successful
0809 05:27:34.718890 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":855,"mutex_wait_us":1,"thread_start_us":588,"threads_started":1}
I20260809 05:27:34.719259 30458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f358fdac632b4e878423184f04845bc9" candidate_uuid: "3c95ebabe2cf4a8b834182865088c360" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "422b69f54b1344ad8d69570c9c6ade69" is_pre_election: true
I20260809 05:27:34.720084 30458 raft_consensus.cc:2454] T f358fdac632b4e878423184f04845bc9 P 422b69f54b1344ad8d69570c9c6ade69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c95ebabe2cf4a8b834182865088c360 in term 0.
I20260809 05:27:34.720662 30677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f358fdac632b4e878423184f04845bc9" candidate_uuid: "3c95ebabe2cf4a8b834182865088c360" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23dd6c70f2194912960e427740868aa3" is_pre_election: true
I20260809 05:27:34.721151 30776 leader_election.cc:302] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c95ebabe2cf4a8b834182865088c360, 422b69f54b1344ad8d69570c9c6ade69; no voters:
I20260809 05:27:34.721266 30677 raft_consensus.cc:2454] T f358fdac632b4e878423184f04845bc9 P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c95ebabe2cf4a8b834182865088c360 in term 0.
I20260809 05:27:34.721683 31027 raft_consensus.cc:2781] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:27:34.721925 31027 raft_consensus.cc:482] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:27:34.722100 31027 raft_consensus.cc:3037] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:34.725220 31027 raft_consensus.cc:504] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } }
I20260809 05:27:34.726061 31027 leader_election.cc:288] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360 [CANDIDATE]: Term 1 election: Requested vote from peers 23dd6c70f2194912960e427740868aa3 (127.26.185.2:46449), 422b69f54b1344ad8d69570c9c6ade69 (127.26.185.1:43181)
I20260809 05:27:34.726646 30677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f358fdac632b4e878423184f04845bc9" candidate_uuid: "3c95ebabe2cf4a8b834182865088c360" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23dd6c70f2194912960e427740868aa3"
I20260809 05:27:34.726672 30458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f358fdac632b4e878423184f04845bc9" candidate_uuid: "3c95ebabe2cf4a8b834182865088c360" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "422b69f54b1344ad8d69570c9c6ade69"
I20260809 05:27:34.726913 30677 raft_consensus.cc:3037] T f358fdac632b4e878423184f04845bc9 P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:34.726929 30458 raft_consensus.cc:3037] T f358fdac632b4e878423184f04845bc9 P 422b69f54b1344ad8d69570c9c6ade69 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:34.730360 30677 raft_consensus.cc:2454] T f358fdac632b4e878423184f04845bc9 P 23dd6c70f2194912960e427740868aa3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c95ebabe2cf4a8b834182865088c360 in term 1.
I20260809 05:27:34.730373 30458 raft_consensus.cc:2454] T f358fdac632b4e878423184f04845bc9 P 422b69f54b1344ad8d69570c9c6ade69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c95ebabe2cf4a8b834182865088c360 in term 1.
I20260809 05:27:34.730916 30776 leader_election.cc:302] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c95ebabe2cf4a8b834182865088c360, 422b69f54b1344ad8d69570c9c6ade69; no voters:
I20260809 05:27:34.731323 31027 raft_consensus.cc:2781] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:27:34.731905 31027 raft_consensus.cc:686] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360 [term 1 LEADER]: Becoming Leader. State: Replica: 3c95ebabe2cf4a8b834182865088c360, State: Running, Role: LEADER
I20260809 05:27:34.732666 31027 consensus_queue.cc:237] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } }
I20260809 05:27:34.738899 30212 catalog_manager.cc:5495] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c95ebabe2cf4a8b834182865088c360 (127.26.185.3). New cstate: current_term: 1 leader_uuid: "3c95ebabe2cf4a8b834182865088c360" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } health_report { overall_health: UNKNOWN } } }
W20260809 05:27:34.746717 30744 tablet.cc:2369] T f358fdac632b4e878423184f04845bc9 P 23dd6c70f2194912960e427740868aa3: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 05:27:34 dist-test-slave-h3ft krb5kdc[30138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253252, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:34.835444 30786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:34.814733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51368 (local address 127.26.185.62:41541)
0809 05:27:34.814957 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:34.814963 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:34.815754 (+ 791us) server_negotiation.cc:407] Connection header received
0809 05:27:34.815959 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:34.815965 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:34.816055 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:34.816159 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:34.817553 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.818382 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.819807 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.820270 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.820373 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:34.829470 (+ 9097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:34.829475 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:34.829479 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:34.829520 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:34.832433 (+ 2913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:34.833291 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:34.833296 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:34.833298 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:34.833428 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:34.833853 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:34.833856 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:34.833858 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:34.834152 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:34.834269 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:34.834755 (+ 486us) server_negotiation.cc:299] Negotiation successful
0809 05:27:34.835156 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":128,"server-negotiator.queue_time_us":74}
I20260809 05:27:34.835486 31042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:34.814748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:41541 (local address 127.0.0.1:51368)
0809 05:27:34.815617 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:34.815636 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:34.815797 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:34.816209 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:34.816213 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:34.817080 (+ 867us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:27:34.817404 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:34.817414 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.818540 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.818544 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:34.819673 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:34.819685 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:34.820442 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:34.820446 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:34.820572 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:34.826401 (+ 5829us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:27:34.826424 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:27:34.829240 (+ 2816us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:27:34.832606 (+ 3366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:34.832620 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:34.832628 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:34.833149 (+ 521us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:34.833544 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:34.833548 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:34.833551 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:34.833741 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:34.834274 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:27:34.834282 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:27:34.834482 (+ 200us) client_negotiation.cc:769] Sending connection context
0809 05:27:34.834657 (+ 175us) client_negotiation.cc:240] Negotiation successful
0809 05:27:34.834955 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":682,"thread_start_us":458,"threads_started":1}
I20260809 05:27:34.842734 30212 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:51368:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 05:27:34.844792 30212 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 05:27:34.854267 30423 tablet_service.cc:1467] Processing CreateTablet for tablet c69c95330f0b4bfb97c1dfdb88451856 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b4e2d2b79f394450b31827762b13993f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 05:27:34.854393 30638 tablet_service.cc:1467] Processing CreateTablet for tablet c69c95330f0b4bfb97c1dfdb88451856 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b4e2d2b79f394450b31827762b13993f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 05:27:34.855682 30638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c69c95330f0b4bfb97c1dfdb88451856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:34.855683 30423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c69c95330f0b4bfb97c1dfdb88451856. 1 dirs total, 0 dirs full, 0 dirs failed
W20260809 05:27:34.859419 30533 tablet.cc:2369] T f358fdac632b4e878423184f04845bc9 P 422b69f54b1344ad8d69570c9c6ade69: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:27:34.864413 31014 tablet_bootstrap.cc:492] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3: Bootstrap starting.
I20260809 05:27:34.864455 31013 tablet_bootstrap.cc:492] T c69c95330f0b4bfb97c1dfdb88451856 P 422b69f54b1344ad8d69570c9c6ade69: Bootstrap starting.
I20260809 05:27:34.864123 30855 tablet_service.cc:1467] Processing CreateTablet for tablet c69c95330f0b4bfb97c1dfdb88451856 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b4e2d2b79f394450b31827762b13993f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 05:27:34.865568 30855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c69c95330f0b4bfb97c1dfdb88451856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:34.866271 31014 tablet_bootstrap.cc:654] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:34.866465 31013 tablet_bootstrap.cc:654] T c69c95330f0b4bfb97c1dfdb88451856 P 422b69f54b1344ad8d69570c9c6ade69: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:34.869230 31014 tablet_bootstrap.cc:492] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3: No bootstrap required, opened a new log
I20260809 05:27:34.869427 31014 ts_tablet_manager.cc:1397] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 05:27:34.870241 31014 raft_consensus.cc:348] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:34.870541 31014 raft_consensus.cc:374] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:34.870647 31014 raft_consensus.cc:729] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23dd6c70f2194912960e427740868aa3, State: Initialized, Role: FOLLOWER
I20260809 05:27:34.870982 31014 consensus_queue.cc:260] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:34.871675 31024 tablet_replica.cc:439] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } } }
I20260809 05:27:34.872211 31024 tablet_replica.cc:442] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 05:27:34.873075 31014 ts_tablet_manager.cc:1428] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 05:27:34.873425 31013 tablet_bootstrap.cc:492] T c69c95330f0b4bfb97c1dfdb88451856 P 422b69f54b1344ad8d69570c9c6ade69: No bootstrap required, opened a new log
I20260809 05:27:34.873610 31013 ts_tablet_manager.cc:1397] T c69c95330f0b4bfb97c1dfdb88451856 P 422b69f54b1344ad8d69570c9c6ade69: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.001s
I20260809 05:27:34.875118 31013 raft_consensus.cc:348] T c69c95330f0b4bfb97c1dfdb88451856 P 422b69f54b1344ad8d69570c9c6ade69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:34.875589 31015 tablet_bootstrap.cc:492] T c69c95330f0b4bfb97c1dfdb88451856 P 3c95ebabe2cf4a8b834182865088c360: Bootstrap starting.
I20260809 05:27:34.875588 31013 raft_consensus.cc:374] T c69c95330f0b4bfb97c1dfdb88451856 P 422b69f54b1344ad8d69570c9c6ade69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:34.876891 31013 raft_consensus.cc:729] T c69c95330f0b4bfb97c1dfdb88451856 P 422b69f54b1344ad8d69570c9c6ade69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 422b69f54b1344ad8d69570c9c6ade69, State: Initialized, Role: FOLLOWER
I20260809 05:27:34.877249 31013 consensus_queue.cc:260] T c69c95330f0b4bfb97c1dfdb88451856 P 422b69f54b1344ad8d69570c9c6ade69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:34.877843 31015 tablet_bootstrap.cc:654] T c69c95330f0b4bfb97c1dfdb88451856 P 3c95ebabe2cf4a8b834182865088c360: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:34.877841 31022 tablet_replica.cc:439] T c69c95330f0b4bfb97c1dfdb88451856 P 422b69f54b1344ad8d69570c9c6ade69: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } } }
I20260809 05:27:34.878283 31022 tablet_replica.cc:442] T c69c95330f0b4bfb97c1dfdb88451856 P 422b69f54b1344ad8d69570c9c6ade69: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 05:27:34.878813 31013 ts_tablet_manager.cc:1428] T c69c95330f0b4bfb97c1dfdb88451856 P 422b69f54b1344ad8d69570c9c6ade69: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20260809 05:27:34.880878 31015 tablet_bootstrap.cc:492] T c69c95330f0b4bfb97c1dfdb88451856 P 3c95ebabe2cf4a8b834182865088c360: No bootstrap required, opened a new log
I20260809 05:27:34.881093 31015 ts_tablet_manager.cc:1397] T c69c95330f0b4bfb97c1dfdb88451856 P 3c95ebabe2cf4a8b834182865088c360: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260809 05:27:34.882241 31015 raft_consensus.cc:348] T c69c95330f0b4bfb97c1dfdb88451856 P 3c95ebabe2cf4a8b834182865088c360 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:34.882501 31015 raft_consensus.cc:374] T c69c95330f0b4bfb97c1dfdb88451856 P 3c95ebabe2cf4a8b834182865088c360 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:34.882596 31015 raft_consensus.cc:729] T c69c95330f0b4bfb97c1dfdb88451856 P 3c95ebabe2cf4a8b834182865088c360 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c95ebabe2cf4a8b834182865088c360, State: Initialized, Role: FOLLOWER
I20260809 05:27:34.882853 31015 consensus_queue.cc:260] T c69c95330f0b4bfb97c1dfdb88451856 P 3c95ebabe2cf4a8b834182865088c360 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:34.883478 31015 ts_tablet_manager.cc:1428] T c69c95330f0b4bfb97c1dfdb88451856 P 3c95ebabe2cf4a8b834182865088c360: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260809 05:27:34.883466 31027 tablet_replica.cc:439] T c69c95330f0b4bfb97c1dfdb88451856 P 3c95ebabe2cf4a8b834182865088c360: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } } }
I20260809 05:27:34.883862 31027 tablet_replica.cc:442] T c69c95330f0b4bfb97c1dfdb88451856 P 3c95ebabe2cf4a8b834182865088c360: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 05:27:35.169297 31024 raft_consensus.cc:482] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:27:35.169642 31024 raft_consensus.cc:504] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:35.171864 31024 leader_election.cc:288] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 422b69f54b1344ad8d69570c9c6ade69 (127.26.185.1:43181), 3c95ebabe2cf4a8b834182865088c360 (127.26.185.3:33997)
I20260809 05:27:35.179992 31012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:35.172369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:44745 (local address 127.26.185.1:43181)
0809 05:27:35.172703 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:35.172715 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:35.173435 (+ 720us) server_negotiation.cc:407] Connection header received
0809 05:27:35.173814 (+ 379us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:35.173820 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:35.173907 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:35.174032 (+ 125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:27:35.174696 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:35.175676 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:35.177864 (+ 2188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:35.178782 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:35.179052 (+ 270us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:35.179152 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:35.179460 (+ 308us) server_negotiation.cc:299] Negotiation successful
0809 05:27:35.179629 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260809 05:27:35.180138 31047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:35.172194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:43181 (local address 127.26.185.2:44745)
0809 05:27:35.173263 (+ 1069us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:35.173292 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:35.173611 (+ 319us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:35.174062 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:35.174067 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:35.174098 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:27:35.174508 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:35.174519 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:35.175839 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:35.175845 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:35.177674 (+ 1829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:35.177688 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:35.179068 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:35.179074 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:35.179260 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:35.179289 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 05:27:35.179427 (+ 138us) client_negotiation.cc:240] Negotiation successful
0809 05:27:35.179604 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":898,"mutex_wait_us":26,"thread_start_us":707,"threads_started":1}
I20260809 05:27:35.180474 31052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:35.172546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:55919 (local address 127.26.185.3:33997)
0809 05:27:35.173587 (+ 1041us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:35.173596 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:35.174179 (+ 583us) server_negotiation.cc:407] Connection header received
0809 05:27:35.174525 (+ 346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:35.174530 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:35.174605 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:35.174738 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:27:35.175507 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:35.176288 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:35.178289 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:35.179302 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:35.179563 (+ 261us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:35.179657 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:35.179974 (+ 317us) server_negotiation.cc:299] Negotiation successful
0809 05:27:35.180152 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":895,"thread_start_us":725,"threads_started":1}
I20260809 05:27:35.181020 31051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:35.172376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:33997 (local address 127.26.185.2:55919)
0809 05:27:35.174039 (+ 1663us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:35.174057 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:35.174325 (+ 268us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:35.174752 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:35.174757 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:35.174782 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:27:35.175286 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:35.175297 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:35.176449 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:35.176458 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:35.178091 (+ 1633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:35.178104 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:35.179588 (+ 1484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:35.179596 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:35.179778 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:35.179805 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 05:27:35.179938 (+ 133us) client_negotiation.cc:240] Negotiation successful
0809 05:27:35.180090 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1500,"mutex_wait_us":3,"spinlock_wait_cycles":36096,"thread_start_us":1238,"threads_started":1}
I20260809 05:27:35.181195 30458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c69c95330f0b4bfb97c1dfdb88451856" candidate_uuid: "23dd6c70f2194912960e427740868aa3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "422b69f54b1344ad8d69570c9c6ade69" is_pre_election: true
I20260809 05:27:35.181617 30458 raft_consensus.cc:2454] T c69c95330f0b4bfb97c1dfdb88451856 P 422b69f54b1344ad8d69570c9c6ade69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23dd6c70f2194912960e427740868aa3 in term 0.
I20260809 05:27:35.182297 30559 leader_election.cc:302] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23dd6c70f2194912960e427740868aa3, 422b69f54b1344ad8d69570c9c6ade69; no voters:
I20260809 05:27:35.182341 30892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c69c95330f0b4bfb97c1dfdb88451856" candidate_uuid: "23dd6c70f2194912960e427740868aa3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c95ebabe2cf4a8b834182865088c360" is_pre_election: true
I20260809 05:27:35.182847 31024 raft_consensus.cc:2781] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:27:35.182945 30892 raft_consensus.cc:2454] T c69c95330f0b4bfb97c1dfdb88451856 P 3c95ebabe2cf4a8b834182865088c360 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23dd6c70f2194912960e427740868aa3 in term 0.
I20260809 05:27:35.183061 31024 raft_consensus.cc:482] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:27:35.183205 31024 raft_consensus.cc:3037] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:35.186269 31024 raft_consensus.cc:504] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:35.187146 31024 leader_election.cc:288] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3 [CANDIDATE]: Term 1 election: Requested vote from peers 422b69f54b1344ad8d69570c9c6ade69 (127.26.185.1:43181), 3c95ebabe2cf4a8b834182865088c360 (127.26.185.3:33997)
I20260809 05:27:35.187871 30458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c69c95330f0b4bfb97c1dfdb88451856" candidate_uuid: "23dd6c70f2194912960e427740868aa3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "422b69f54b1344ad8d69570c9c6ade69"
I20260809 05:27:35.187937 30892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c69c95330f0b4bfb97c1dfdb88451856" candidate_uuid: "23dd6c70f2194912960e427740868aa3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c95ebabe2cf4a8b834182865088c360"
I20260809 05:27:35.188208 30892 raft_consensus.cc:3037] T c69c95330f0b4bfb97c1dfdb88451856 P 3c95ebabe2cf4a8b834182865088c360 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:35.188231 30458 raft_consensus.cc:3037] T c69c95330f0b4bfb97c1dfdb88451856 P 422b69f54b1344ad8d69570c9c6ade69 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:35.191958 30458 raft_consensus.cc:2454] T c69c95330f0b4bfb97c1dfdb88451856 P 422b69f54b1344ad8d69570c9c6ade69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23dd6c70f2194912960e427740868aa3 in term 1.
I20260809 05:27:35.191982 30892 raft_consensus.cc:2454] T c69c95330f0b4bfb97c1dfdb88451856 P 3c95ebabe2cf4a8b834182865088c360 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23dd6c70f2194912960e427740868aa3 in term 1.
I20260809 05:27:35.192655 30563 leader_election.cc:302] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23dd6c70f2194912960e427740868aa3, 3c95ebabe2cf4a8b834182865088c360; no voters:
I20260809 05:27:35.193126 31024 raft_consensus.cc:2781] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:27:35.193617 31024 raft_consensus.cc:686] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3 [term 1 LEADER]: Becoming Leader. State: Replica: 23dd6c70f2194912960e427740868aa3, State: Running, Role: LEADER
I20260809 05:27:35.194339 31024 consensus_queue.cc:237] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:35.198720 31055 tablet_replica.cc:439] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3: TxnStatusTablet state changed. Reason: New leader 23dd6c70f2194912960e427740868aa3. Latest consensus state: current_term: 1 leader_uuid: "23dd6c70f2194912960e427740868aa3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } } }
I20260809 05:27:35.199266 31055 tablet_replica.cc:442] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3: This TxnStatusTablet replica's current role is: LEADER
I20260809 05:27:35.200229 31058 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 05:27:35.200560 31058 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 05:27:35.200917 30210 catalog_manager.cc:5495] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23dd6c70f2194912960e427740868aa3 (127.26.185.2). New cstate: current_term: 1 leader_uuid: "23dd6c70f2194912960e427740868aa3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } health_report { overall_health: UNKNOWN } } }
I20260809 05:27:35.235790 31027 consensus_queue.cc:1035] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:27:35.260509 31027 consensus_queue.cc:1035] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360 [LEADER]: Connected to new peer: Peer: permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:27:35.272939 31042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:35.261193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:46449 (local address 127.0.0.1:34626)
0809 05:27:35.262193 (+ 1000us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:35.262218 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:35.262402 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:35.265400 (+ 2998us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:35.265407 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:35.265425 (+ 18us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 05:27:35.265715 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:35.265732 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:35.267645 (+ 1913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:35.267651 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:35.269450 (+ 1799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:35.269467 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:35.270371 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:35.270378 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:35.270605 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:35.270696 (+ 91us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 05:27:35.272213 (+ 1517us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 05:27:35.272250 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 05:27:35.272365 (+ 115us) client_negotiation.cc:240] Negotiation successful
0809 05:27:35.272570 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":747}
I20260809 05:27:35.273018 31067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:35.261723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34626 (local address 127.26.185.2:46449)
0809 05:27:35.264833 (+ 3110us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:35.264840 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:35.264874 (+ 34us) server_negotiation.cc:407] Connection header received
0809 05:27:35.264997 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:35.265006 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:35.265140 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:35.265354 (+ 214us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:27:35.266028 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:35.267442 (+ 1414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:35.269615 (+ 2173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:35.270163 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:35.270339 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:35.270992 (+ 653us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:27:35.272059 (+ 1067us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:27:35.272240 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:35.272446 (+ 206us) server_negotiation.cc:299] Negotiation successful
0809 05:27:35.272564 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2223,"thread_start_us":2024,"threads_started":1}
I20260809 05:27:35.282835 30458 raft_consensus.cc:1261] T c69c95330f0b4bfb97c1dfdb88451856 P 422b69f54b1344ad8d69570c9c6ade69 [term 1 FOLLOWER]: Refusing update from remote peer 23dd6c70f2194912960e427740868aa3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:27:35.283224 30892 raft_consensus.cc:1261] T c69c95330f0b4bfb97c1dfdb88451856 P 3c95ebabe2cf4a8b834182865088c360 [term 1 FOLLOWER]: Refusing update from remote peer 23dd6c70f2194912960e427740868aa3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:27:35.284116 31055 consensus_queue.cc:1035] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:27:35.284602 31024 consensus_queue.cc:1035] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:27:35.293406 31022 tablet_replica.cc:439] T c69c95330f0b4bfb97c1dfdb88451856 P 422b69f54b1344ad8d69570c9c6ade69: TxnStatusTablet state changed. Reason: New leader 23dd6c70f2194912960e427740868aa3. Latest consensus state: current_term: 1 leader_uuid: "23dd6c70f2194912960e427740868aa3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } } }
I20260809 05:27:35.293823 31022 tablet_replica.cc:442] T c69c95330f0b4bfb97c1dfdb88451856 P 422b69f54b1344ad8d69570c9c6ade69: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 05:27:35.299149 31065 mvcc.cc:205] Tried to move back new op lower bound from 7316493333627793408 to 7316493333280956416. Current Snapshot: MvccSnapshot[applied={T|T < 7316493333627793408}]
I20260809 05:27:35.311480 31062 tablet_replica.cc:439] T c69c95330f0b4bfb97c1dfdb88451856 P 3c95ebabe2cf4a8b834182865088c360: TxnStatusTablet state changed. Reason: New leader 23dd6c70f2194912960e427740868aa3. Latest consensus state: current_term: 1 leader_uuid: "23dd6c70f2194912960e427740868aa3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } } }
I20260809 05:27:35.311936 31062 tablet_replica.cc:442] T c69c95330f0b4bfb97c1dfdb88451856 P 3c95ebabe2cf4a8b834182865088c360: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 05:27:35.316636 31024 tablet_replica.cc:439] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "23dd6c70f2194912960e427740868aa3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } } }
I20260809 05:27:35.317176 31024 tablet_replica.cc:442] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3: This TxnStatusTablet replica's current role is: LEADER
I20260809 05:27:35.318746 31024 tablet_replica.cc:439] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "23dd6c70f2194912960e427740868aa3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } } }
I20260809 05:27:35.319077 31024 tablet_replica.cc:442] T c69c95330f0b4bfb97c1dfdb88451856 P 23dd6c70f2194912960e427740868aa3: This TxnStatusTablet replica's current role is: LEADER
I20260809 05:27:35.321478 31062 tablet_replica.cc:439] T c69c95330f0b4bfb97c1dfdb88451856 P 3c95ebabe2cf4a8b834182865088c360: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "23dd6c70f2194912960e427740868aa3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } } }
I20260809 05:27:35.321771 31062 tablet_replica.cc:442] T c69c95330f0b4bfb97c1dfdb88451856 P 3c95ebabe2cf4a8b834182865088c360: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 05:27:35.328256 31022 tablet_replica.cc:439] T c69c95330f0b4bfb97c1dfdb88451856 P 422b69f54b1344ad8d69570c9c6ade69: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "23dd6c70f2194912960e427740868aa3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } } }
I20260809 05:27:35.328608 31022 tablet_replica.cc:442] T c69c95330f0b4bfb97c1dfdb88451856 P 422b69f54b1344ad8d69570c9c6ade69: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 05:27:35.339761 31052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:35.331942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47580 (local address 127.26.185.3:33997)
0809 05:27:35.332207 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:35.332216 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:35.332805 (+ 589us) server_negotiation.cc:407] Connection header received
0809 05:27:35.333125 (+ 320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:35.333130 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:35.333244 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:35.333453 (+ 209us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:27:35.334005 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:35.334883 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:35.336551 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:35.337136 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:35.337310 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:35.337960 (+ 650us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:27:35.338938 (+ 978us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:27:35.339161 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:35.339253 (+ 92us) server_negotiation.cc:299] Negotiation successful
0809 05:27:35.339364 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 05:27:35.361303 31067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:35.353911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:57467 (local address 127.26.185.2:46449)
0809 05:27:35.354254 (+ 343us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:35.354265 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:35.355136 (+ 871us) server_negotiation.cc:407] Connection header received
0809 05:27:35.355532 (+ 396us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:35.355538 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:35.355625 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:35.355738 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:27:35.356380 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:35.357498 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:35.359119 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:35.359626 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:35.359786 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:35.360370 (+ 584us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:27:35.360510 (+ 140us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:27:35.360623 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:35.360788 (+ 165us) server_negotiation.cc:299] Negotiation successful
0809 05:27:35.360892 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127}
I20260809 05:27:35.361382 31081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:35.353625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:46449 (local address 127.26.185.3:57467)
0809 05:27:35.354957 (+ 1332us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:35.354977 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:35.355317 (+ 340us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:35.355756 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:35.355762 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:35.355775 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 05:27:35.356164 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:35.356182 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:35.357660 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:35.357666 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:35.358909 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:35.358924 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:35.359859 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:35.359867 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:35.360033 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:35.360107 (+ 74us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 05:27:35.360627 (+ 520us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 05:27:35.360644 (+ 17us) client_negotiation.cc:769] Sending connection context
0809 05:27:35.360761 (+ 117us) client_negotiation.cc:240] Negotiation successful
0809 05:27:35.360930 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1081,"thread_start_us":922,"threads_started":1}
I20260809 05:27:35.429459 31052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:35.419724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:45907 (local address 127.26.185.3:33997)
0809 05:27:35.419964 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:35.419972 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:35.420869 (+ 897us) server_negotiation.cc:407] Connection header received
0809 05:27:35.421293 (+ 424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:35.421302 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:35.421456 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:35.421548 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:27:35.422603 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:35.424068 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:35.426847 (+ 2779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:35.427595 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:35.427710 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:35.428478 (+ 768us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:27:35.428671 (+ 193us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:27:35.428779 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:35.428988 (+ 209us) server_negotiation.cc:299] Negotiation successful
0809 05:27:35.429115 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 05:27:35.429759 31085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:35.419799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:33997 (local address 127.26.185.2:45907)
0809 05:27:35.420735 (+ 936us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:35.420762 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:35.421036 (+ 274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:35.421852 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:35.421863 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:35.421886 (+ 23us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 05:27:35.422326 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:35.422346 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:35.424343 (+ 1997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:35.424348 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:35.426654 (+ 2306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:35.426671 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:35.427921 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:35.427928 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:35.428140 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:35.428229 (+ 89us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 05:27:35.428814 (+ 585us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 05:27:35.428833 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 05:27:35.428947 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 05:27:35.429145 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":403,"threads_started":1}
I20260809 05:27:35.512735 30212 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51366:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:27:35.513257 30212 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51366:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:27:35.517802 30212 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fc1ef37618a8471ebe8761ca1fdaebcb: Sending DeleteTablet for 3 replicas of tablet f358fdac632b4e878423184f04845bc9
I20260809 05:27:35.519336 30638 tablet_service.cc:1514] Processing DeleteTablet for tablet f358fdac632b4e878423184f04845bc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:27:35 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:34618
I20260809 05:27:35.519788 30423 tablet_service.cc:1514] Processing DeleteTablet for tablet f358fdac632b4e878423184f04845bc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:27:35 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:59616
I20260809 05:27:35.520747 31093 tablet_replica.cc:330] T f358fdac632b4e878423184f04845bc9 P 23dd6c70f2194912960e427740868aa3: stopping tablet replica
I20260809 05:27:35.521574 31093 raft_consensus.cc:2229] T f358fdac632b4e878423184f04845bc9 P 23dd6c70f2194912960e427740868aa3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:27:35.521528 30212 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51366:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 05:27:35.522330 30212 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 05:27:35.522624 31093 raft_consensus.cc:2258] T f358fdac632b4e878423184f04845bc9 P 23dd6c70f2194912960e427740868aa3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:27:35.526757 31093 ts_tablet_manager.cc:1905] T f358fdac632b4e878423184f04845bc9 P 23dd6c70f2194912960e427740868aa3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:27:35.531533 30638 tablet_service.cc:1467] Processing CreateTablet for tablet 82b4e9248a52483f8317b563e88ec3fc (DEFAULT_TABLE table=test-table [id=1306ca785a55454085d5652e9e8765c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:27:35.532092 30638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82b4e9248a52483f8317b563e88ec3fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:35.532688 30422 tablet_service.cc:1467] Processing CreateTablet for tablet 82b4e9248a52483f8317b563e88ec3fc (DEFAULT_TABLE table=test-table [id=1306ca785a55454085d5652e9e8765c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:27:35.533497 30422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82b4e9248a52483f8317b563e88ec3fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:35.539479 30855 tablet_service.cc:1514] Processing DeleteTablet for tablet f358fdac632b4e878423184f04845bc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:27:35 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:47572
I20260809 05:27:35.541074 30854 tablet_service.cc:1467] Processing CreateTablet for tablet 82b4e9248a52483f8317b563e88ec3fc (DEFAULT_TABLE table=test-table [id=1306ca785a55454085d5652e9e8765c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:27:35.541916 30854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82b4e9248a52483f8317b563e88ec3fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:35.542757 31095 tablet_replica.cc:330] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360: stopping tablet replica
I20260809 05:27:35.544713 31095 raft_consensus.cc:2229] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360 [term 1 LEADER]: Raft consensus shutting down.
I20260809 05:27:35.552162 31096 tablet_bootstrap.cc:492] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3: Bootstrap starting.
I20260809 05:27:35.554446 31096 tablet_bootstrap.cc:654] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:35.563925 31096 tablet_bootstrap.cc:492] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3: No bootstrap required, opened a new log
I20260809 05:27:35.564136 31096 ts_tablet_manager.cc:1397] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.005s
I20260809 05:27:35.565219 31096 raft_consensus.cc:348] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:35.565562 31096 raft_consensus.cc:374] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:35.565672 31096 raft_consensus.cc:729] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23dd6c70f2194912960e427740868aa3, State: Initialized, Role: FOLLOWER
I20260809 05:27:35.566017 31096 consensus_queue.cc:260] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:35.571565 31096 ts_tablet_manager.cc:1428] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260809 05:27:35.573452 31094 tablet_replica.cc:330] T f358fdac632b4e878423184f04845bc9 P 422b69f54b1344ad8d69570c9c6ade69: stopping tablet replica
I20260809 05:27:35.574146 31094 raft_consensus.cc:2229] T f358fdac632b4e878423184f04845bc9 P 422b69f54b1344ad8d69570c9c6ade69 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:27:35.574677 31094 raft_consensus.cc:2258] T f358fdac632b4e878423184f04845bc9 P 422b69f54b1344ad8d69570c9c6ade69 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:27:35.576516 31095 raft_consensus.cc:2258] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:27:35.580842 31093 ts_tablet_manager.cc:1918] T f358fdac632b4e878423184f04845bc9 P 23dd6c70f2194912960e427740868aa3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 05:27:35.583746 31093 log.cc:1196] T f358fdac632b4e878423184f04845bc9 P 23dd6c70f2194912960e427740868aa3: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-1/wal/wals/f358fdac632b4e878423184f04845bc9
I20260809 05:27:35.585501 31093 ts_tablet_manager.cc:1939] T f358fdac632b4e878423184f04845bc9 P 23dd6c70f2194912960e427740868aa3: Deleting consensus metadata
I20260809 05:27:35.586176 31095 ts_tablet_manager.cc:1905] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:27:35.589506 30191 catalog_manager.cc:4841] TS 23dd6c70f2194912960e427740868aa3 (127.26.185.2:46449): tablet f358fdac632b4e878423184f04845bc9 (table test-table [id=1f4339f3acdb49bbb0988a98f0fb9b09]) successfully deleted
I20260809 05:27:35.593381 31094 ts_tablet_manager.cc:1905] T f358fdac632b4e878423184f04845bc9 P 422b69f54b1344ad8d69570c9c6ade69: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:27:35.600814 31099 tablet_bootstrap.cc:492] T 82b4e9248a52483f8317b563e88ec3fc P 3c95ebabe2cf4a8b834182865088c360: Bootstrap starting.
I20260809 05:27:35.607101 31098 tablet_bootstrap.cc:492] T 82b4e9248a52483f8317b563e88ec3fc P 422b69f54b1344ad8d69570c9c6ade69: Bootstrap starting.
I20260809 05:27:35.613196 31094 ts_tablet_manager.cc:1918] T f358fdac632b4e878423184f04845bc9 P 422b69f54b1344ad8d69570c9c6ade69: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 05:27:35.613466 31094 log.cc:1196] T f358fdac632b4e878423184f04845bc9 P 422b69f54b1344ad8d69570c9c6ade69: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-0/wal/wals/f358fdac632b4e878423184f04845bc9
I20260809 05:27:35.613988 31098 tablet_bootstrap.cc:654] T 82b4e9248a52483f8317b563e88ec3fc P 422b69f54b1344ad8d69570c9c6ade69: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:35.614195 31094 ts_tablet_manager.cc:1939] T f358fdac632b4e878423184f04845bc9 P 422b69f54b1344ad8d69570c9c6ade69: Deleting consensus metadata
I20260809 05:27:35.617547 30188 catalog_manager.cc:4841] TS 422b69f54b1344ad8d69570c9c6ade69 (127.26.185.1:43181): tablet f358fdac632b4e878423184f04845bc9 (table test-table [id=1f4339f3acdb49bbb0988a98f0fb9b09]) successfully deleted
I20260809 05:27:35.620124 31099 tablet_bootstrap.cc:654] T 82b4e9248a52483f8317b563e88ec3fc P 3c95ebabe2cf4a8b834182865088c360: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:35.620519 31098 tablet_bootstrap.cc:492] T 82b4e9248a52483f8317b563e88ec3fc P 422b69f54b1344ad8d69570c9c6ade69: No bootstrap required, opened a new log
I20260809 05:27:35.620735 31098 ts_tablet_manager.cc:1397] T 82b4e9248a52483f8317b563e88ec3fc P 422b69f54b1344ad8d69570c9c6ade69: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.004s
I20260809 05:27:35.620859 31095 ts_tablet_manager.cc:1918] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 05:27:35.621107 31095 log.cc:1196] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-2/wal/wals/f358fdac632b4e878423184f04845bc9
I20260809 05:27:35.621789 31095 ts_tablet_manager.cc:1939] T f358fdac632b4e878423184f04845bc9 P 3c95ebabe2cf4a8b834182865088c360: Deleting consensus metadata
I20260809 05:27:35.621834 31098 raft_consensus.cc:348] T 82b4e9248a52483f8317b563e88ec3fc P 422b69f54b1344ad8d69570c9c6ade69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:35.622200 31098 raft_consensus.cc:374] T 82b4e9248a52483f8317b563e88ec3fc P 422b69f54b1344ad8d69570c9c6ade69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:35.622390 31098 raft_consensus.cc:729] T 82b4e9248a52483f8317b563e88ec3fc P 422b69f54b1344ad8d69570c9c6ade69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 422b69f54b1344ad8d69570c9c6ade69, State: Initialized, Role: FOLLOWER
I20260809 05:27:35.622855 31098 consensus_queue.cc:260] T 82b4e9248a52483f8317b563e88ec3fc P 422b69f54b1344ad8d69570c9c6ade69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:35.624975 31098 ts_tablet_manager.cc:1428] T 82b4e9248a52483f8317b563e88ec3fc P 422b69f54b1344ad8d69570c9c6ade69: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260809 05:27:35.627211 31099 tablet_bootstrap.cc:492] T 82b4e9248a52483f8317b563e88ec3fc P 3c95ebabe2cf4a8b834182865088c360: No bootstrap required, opened a new log
I20260809 05:27:35.627427 31099 ts_tablet_manager.cc:1397] T 82b4e9248a52483f8317b563e88ec3fc P 3c95ebabe2cf4a8b834182865088c360: Time spent bootstrapping tablet: real 0.027s user 0.005s sys 0.005s
I20260809 05:27:35.628752 30194 catalog_manager.cc:4841] TS 3c95ebabe2cf4a8b834182865088c360 (127.26.185.3:33997): tablet f358fdac632b4e878423184f04845bc9 (table test-table [id=1f4339f3acdb49bbb0988a98f0fb9b09]) successfully deleted
I20260809 05:27:35.629194 31099 raft_consensus.cc:348] T 82b4e9248a52483f8317b563e88ec3fc P 3c95ebabe2cf4a8b834182865088c360 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:35.629518 31099 raft_consensus.cc:374] T 82b4e9248a52483f8317b563e88ec3fc P 3c95ebabe2cf4a8b834182865088c360 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:35.629712 31099 raft_consensus.cc:729] T 82b4e9248a52483f8317b563e88ec3fc P 3c95ebabe2cf4a8b834182865088c360 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c95ebabe2cf4a8b834182865088c360, State: Initialized, Role: FOLLOWER
I20260809 05:27:35.630035 31099 consensus_queue.cc:260] T 82b4e9248a52483f8317b563e88ec3fc P 3c95ebabe2cf4a8b834182865088c360 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:35.630609 31024 raft_consensus.cc:482] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:27:35.630843 31099 ts_tablet_manager.cc:1428] T 82b4e9248a52483f8317b563e88ec3fc P 3c95ebabe2cf4a8b834182865088c360: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260809 05:27:35.630831 31024 raft_consensus.cc:504] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:35.631743 31024 leader_election.cc:288] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 422b69f54b1344ad8d69570c9c6ade69 (127.26.185.1:43181), 3c95ebabe2cf4a8b834182865088c360 (127.26.185.3:33997)
I20260809 05:27:35.632526 30457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82b4e9248a52483f8317b563e88ec3fc" candidate_uuid: "23dd6c70f2194912960e427740868aa3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "422b69f54b1344ad8d69570c9c6ade69" is_pre_election: true
I20260809 05:27:35.632833 30892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82b4e9248a52483f8317b563e88ec3fc" candidate_uuid: "23dd6c70f2194912960e427740868aa3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c95ebabe2cf4a8b834182865088c360" is_pre_election: true
I20260809 05:27:35.632898 30457 raft_consensus.cc:2454] T 82b4e9248a52483f8317b563e88ec3fc P 422b69f54b1344ad8d69570c9c6ade69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23dd6c70f2194912960e427740868aa3 in term 0.
I20260809 05:27:35.633096 30892 raft_consensus.cc:2454] T 82b4e9248a52483f8317b563e88ec3fc P 3c95ebabe2cf4a8b834182865088c360 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23dd6c70f2194912960e427740868aa3 in term 0.
I20260809 05:27:35.633479 30559 leader_election.cc:302] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23dd6c70f2194912960e427740868aa3, 422b69f54b1344ad8d69570c9c6ade69; no voters:
I20260809 05:27:35.633908 31024 raft_consensus.cc:2781] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:27:35.634066 31024 raft_consensus.cc:482] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:27:35.634181 31024 raft_consensus.cc:3037] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:35.637988 31024 raft_consensus.cc:504] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:35.639617 30457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82b4e9248a52483f8317b563e88ec3fc" candidate_uuid: "23dd6c70f2194912960e427740868aa3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "422b69f54b1344ad8d69570c9c6ade69"
I20260809 05:27:35.639626 30892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82b4e9248a52483f8317b563e88ec3fc" candidate_uuid: "23dd6c70f2194912960e427740868aa3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c95ebabe2cf4a8b834182865088c360"
I20260809 05:27:35.639912 30892 raft_consensus.cc:3037] T 82b4e9248a52483f8317b563e88ec3fc P 3c95ebabe2cf4a8b834182865088c360 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:35.639897 30457 raft_consensus.cc:3037] T 82b4e9248a52483f8317b563e88ec3fc P 422b69f54b1344ad8d69570c9c6ade69 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:35.643666 30457 raft_consensus.cc:2454] T 82b4e9248a52483f8317b563e88ec3fc P 422b69f54b1344ad8d69570c9c6ade69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23dd6c70f2194912960e427740868aa3 in term 1.
I20260809 05:27:35.643985 30892 raft_consensus.cc:2454] T 82b4e9248a52483f8317b563e88ec3fc P 3c95ebabe2cf4a8b834182865088c360 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23dd6c70f2194912960e427740868aa3 in term 1.
I20260809 05:27:35.644423 30559 leader_election.cc:302] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23dd6c70f2194912960e427740868aa3, 422b69f54b1344ad8d69570c9c6ade69; no voters:
I20260809 05:27:35.644906 31088 raft_consensus.cc:2781] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:27:35.645157 31088 raft_consensus.cc:686] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3 [term 1 LEADER]: Becoming Leader. State: Replica: 23dd6c70f2194912960e427740868aa3, State: Running, Role: LEADER
I20260809 05:27:35.645824 31024 leader_election.cc:288] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3 [CANDIDATE]: Term 1 election: Requested vote from peers 422b69f54b1344ad8d69570c9c6ade69 (127.26.185.1:43181), 3c95ebabe2cf4a8b834182865088c360 (127.26.185.3:33997)
I20260809 05:27:35.645661 31088 consensus_queue.cc:237] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:35.650885 30210 catalog_manager.cc:5495] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23dd6c70f2194912960e427740868aa3 (127.26.185.2). New cstate: current_term: 1 leader_uuid: "23dd6c70f2194912960e427740868aa3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } health_report { overall_health: UNKNOWN } } }
I20260809 05:27:35.708245 31067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:35.699977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34632 (local address 127.26.185.2:46449)
0809 05:27:35.700281 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:35.700288 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:35.700311 (+ 23us) server_negotiation.cc:407] Connection header received
0809 05:27:35.700403 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:35.700418 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:35.700557 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:35.700695 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:27:35.701294 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:35.702713 (+ 1419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:35.704992 (+ 2279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:35.706096 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:35.706295 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:35.706922 (+ 627us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:27:35.707185 (+ 263us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:27:35.707314 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:35.707546 (+ 232us) server_negotiation.cc:299] Negotiation successful
0809 05:27:35.707732 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260809 05:27:35.731709 31067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:35.723549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:51877 (local address 127.26.185.2:46449)
0809 05:27:35.723868 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:35.723875 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:35.724198 (+ 323us) server_negotiation.cc:407] Connection header received
0809 05:27:35.724471 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:35.724477 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:35.724570 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:35.724698 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:27:35.725210 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:35.726389 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:35.729015 (+ 2626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:35.729802 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:35.729959 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:35.730601 (+ 642us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:27:35.730815 (+ 214us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:27:35.730940 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:35.731163 (+ 223us) server_negotiation.cc:299] Negotiation successful
0809 05:27:35.731277 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113}
I20260809 05:27:35.731791 31085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:35.723601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:46449 (local address 127.26.185.2:51877)
0809 05:27:35.724072 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:35.724099 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:35.724280 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:35.724728 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:35.724734 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:35.724752 (+ 18us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 05:27:35.725027 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:35.725043 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:35.726588 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:35.726596 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:35.728807 (+ 2211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:35.728828 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:35.730015 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:35.730023 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:35.730268 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:35.730357 (+ 89us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 05:27:35.730955 (+ 598us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 05:27:35.730971 (+ 16us) client_negotiation.cc:769] Sending connection context
0809 05:27:35.731128 (+ 157us) client_negotiation.cc:240] Negotiation successful
0809 05:27:35.731351 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250}
I20260809 05:27:35.759147 30892 raft_consensus.cc:1261] T 82b4e9248a52483f8317b563e88ec3fc P 3c95ebabe2cf4a8b834182865088c360 [term 1 FOLLOWER]: Refusing update from remote peer 23dd6c70f2194912960e427740868aa3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:27:35.760227 31024 consensus_queue.cc:1035] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:27:35.763775 30457 raft_consensus.cc:1261] T 82b4e9248a52483f8317b563e88ec3fc P 422b69f54b1344ad8d69570c9c6ade69 [term 1 FOLLOWER]: Refusing update from remote peer 23dd6c70f2194912960e427740868aa3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:27:35.764871 31024 consensus_queue.cc:1035] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:27:35.797314 31063 mvcc.cc:205] Tried to move back new op lower bound from 7316493335579140096 to 7316493335129341952. Current Snapshot: MvccSnapshot[applied={T|T < 7316493335579140096}]
W20260809 05:27:35.829909 31065 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 05:27:37.451447 30210 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51366:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:27:37.451794 30210 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51366:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:27:37.457113 30210 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fc1ef37618a8471ebe8761ca1fdaebcb: Sending DeleteTablet for 3 replicas of tablet 82b4e9248a52483f8317b563e88ec3fc
I20260809 05:27:37.458130 30636 tablet_service.cc:1514] Processing DeleteTablet for tablet 82b4e9248a52483f8317b563e88ec3fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:27:37 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:34618
I20260809 05:27:37.458153 30422 tablet_service.cc:1514] Processing DeleteTablet for tablet 82b4e9248a52483f8317b563e88ec3fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:27:37 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:59616
I20260809 05:27:37.458366 30854 tablet_service.cc:1514] Processing DeleteTablet for tablet 82b4e9248a52483f8317b563e88ec3fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:27:37 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:47572
I20260809 05:27:37.473841 31144 tablet_replica.cc:330] T 82b4e9248a52483f8317b563e88ec3fc P 422b69f54b1344ad8d69570c9c6ade69: stopping tablet replica
I20260809 05:27:37.474195 31144 raft_consensus.cc:2229] T 82b4e9248a52483f8317b563e88ec3fc P 422b69f54b1344ad8d69570c9c6ade69 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:27:37.474557 31144 raft_consensus.cc:2258] T 82b4e9248a52483f8317b563e88ec3fc P 422b69f54b1344ad8d69570c9c6ade69 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:27:37.475751 31145 tablet_replica.cc:330] T 82b4e9248a52483f8317b563e88ec3fc P 3c95ebabe2cf4a8b834182865088c360: stopping tablet replica
I20260809 05:27:37.476094 31145 raft_consensus.cc:2229] T 82b4e9248a52483f8317b563e88ec3fc P 3c95ebabe2cf4a8b834182865088c360 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:27:37.476240 31144 ts_tablet_manager.cc:1905] T 82b4e9248a52483f8317b563e88ec3fc P 422b69f54b1344ad8d69570c9c6ade69: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:27:37.476482 31145 raft_consensus.cc:2258] T 82b4e9248a52483f8317b563e88ec3fc P 3c95ebabe2cf4a8b834182865088c360 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:27:37.478302 31145 ts_tablet_manager.cc:1905] T 82b4e9248a52483f8317b563e88ec3fc P 3c95ebabe2cf4a8b834182865088c360: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:27:37.482925 31142 tablet_replica.cc:330] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3: stopping tablet replica
I20260809 05:27:37.483271 31142 raft_consensus.cc:2229] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3 [term 1 LEADER]: Raft consensus shutting down.
I20260809 05:27:37.484154 31142 raft_consensus.cc:2258] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:27:37.484251 31144 ts_tablet_manager.cc:1918] T 82b4e9248a52483f8317b563e88ec3fc P 422b69f54b1344ad8d69570c9c6ade69: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 05:27:37.484437 31144 log.cc:1196] T 82b4e9248a52483f8317b563e88ec3fc P 422b69f54b1344ad8d69570c9c6ade69: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-0/wal/wals/82b4e9248a52483f8317b563e88ec3fc
I20260809 05:27:37.485117 31144 ts_tablet_manager.cc:1939] T 82b4e9248a52483f8317b563e88ec3fc P 422b69f54b1344ad8d69570c9c6ade69: Deleting consensus metadata
I20260809 05:27:37.485530 31142 ts_tablet_manager.cc:1905] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:27:37.486867 30188 catalog_manager.cc:4841] TS 422b69f54b1344ad8d69570c9c6ade69 (127.26.185.1:43181): tablet 82b4e9248a52483f8317b563e88ec3fc (table test-table [id=1306ca785a55454085d5652e9e8765c9]) successfully deleted
I20260809 05:27:37.488279 31145 ts_tablet_manager.cc:1918] T 82b4e9248a52483f8317b563e88ec3fc P 3c95ebabe2cf4a8b834182865088c360: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 05:27:37.488476 31145 log.cc:1196] T 82b4e9248a52483f8317b563e88ec3fc P 3c95ebabe2cf4a8b834182865088c360: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-2/wal/wals/82b4e9248a52483f8317b563e88ec3fc
I20260809 05:27:37.488976 31145 ts_tablet_manager.cc:1939] T 82b4e9248a52483f8317b563e88ec3fc P 3c95ebabe2cf4a8b834182865088c360: Deleting consensus metadata
I20260809 05:27:37.490394 30194 catalog_manager.cc:4841] TS 3c95ebabe2cf4a8b834182865088c360 (127.26.185.3:33997): tablet 82b4e9248a52483f8317b563e88ec3fc (table test-table [id=1306ca785a55454085d5652e9e8765c9]) successfully deleted
I20260809 05:27:37.492522 31142 ts_tablet_manager.cc:1918] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 05:27:37.492697 31142 log.cc:1196] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-1/wal/wals/82b4e9248a52483f8317b563e88ec3fc
I20260809 05:27:37.493183 31142 ts_tablet_manager.cc:1939] T 82b4e9248a52483f8317b563e88ec3fc P 23dd6c70f2194912960e427740868aa3: Deleting consensus metadata
I20260809 05:27:37.494410 30191 catalog_manager.cc:4841] TS 23dd6c70f2194912960e427740868aa3 (127.26.185.2:46449): tablet 82b4e9248a52483f8317b563e88ec3fc (table test-table [id=1306ca785a55454085d5652e9e8765c9]) successfully deleted
Aug 09 05:27:37 dist-test-slave-h3ft krb5kdc[30138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253257, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 05:27:37 dist-test-slave-h3ft krb5kdc[30138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253257, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:37.541759 31157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:37.524796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51370 (local address 127.26.185.62:41541)
0809 05:27:37.525568 (+ 772us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:37.525574 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:37.525603 (+ 29us) server_negotiation.cc:407] Connection header received
0809 05:27:37.525752 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:37.525757 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:37.525839 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:37.525957 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:37.527582 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:37.528469 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:37.529847 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:37.530291 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:37.530397 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:37.535200 (+ 4803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:37.535206 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:37.535209 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:37.535253 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:37.538735 (+ 3482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:37.539614 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:37.539619 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:37.539621 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:37.539779 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:37.540169 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:37.540172 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:37.540174 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:37.540490 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:37.540714 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:37.541046 (+ 332us) server_negotiation.cc:299] Negotiation successful
0809 05:27:37.541265 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":626,"thread_start_us":391,"threads_started":1}
I20260809 05:27:37.546305 30210 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51370:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 05:27:37.547134 30210 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 05:27:37.555593 30422 tablet_service.cc:1467] Processing CreateTablet for tablet 03d82f89554b4febbc83e61e3510dcf9 (DEFAULT_TABLE table=test-table [id=d3064f8bf3fa4bfcb590fc135c5b6a03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:27:37.555696 30636 tablet_service.cc:1467] Processing CreateTablet for tablet 03d82f89554b4febbc83e61e3510dcf9 (DEFAULT_TABLE table=test-table [id=d3064f8bf3fa4bfcb590fc135c5b6a03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:27:37.555927 30854 tablet_service.cc:1467] Processing CreateTablet for tablet 03d82f89554b4febbc83e61e3510dcf9 (DEFAULT_TABLE table=test-table [id=d3064f8bf3fa4bfcb590fc135c5b6a03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:27:37.556278 30422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03d82f89554b4febbc83e61e3510dcf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:37.556308 30636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03d82f89554b4febbc83e61e3510dcf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:37.556492 30854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03d82f89554b4febbc83e61e3510dcf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:37.563194 31158 tablet_bootstrap.cc:492] T 03d82f89554b4febbc83e61e3510dcf9 P 23dd6c70f2194912960e427740868aa3: Bootstrap starting.
I20260809 05:27:37.564143 31160 tablet_bootstrap.cc:492] T 03d82f89554b4febbc83e61e3510dcf9 P 3c95ebabe2cf4a8b834182865088c360: Bootstrap starting.
I20260809 05:27:37.565701 31161 tablet_bootstrap.cc:492] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69: Bootstrap starting.
I20260809 05:27:37.566408 31160 tablet_bootstrap.cc:654] T 03d82f89554b4febbc83e61e3510dcf9 P 3c95ebabe2cf4a8b834182865088c360: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:37.566535 31158 tablet_bootstrap.cc:654] T 03d82f89554b4febbc83e61e3510dcf9 P 23dd6c70f2194912960e427740868aa3: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:37.568050 31161 tablet_bootstrap.cc:654] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:37.569285 31158 tablet_bootstrap.cc:492] T 03d82f89554b4febbc83e61e3510dcf9 P 23dd6c70f2194912960e427740868aa3: No bootstrap required, opened a new log
I20260809 05:27:37.569469 31158 ts_tablet_manager.cc:1397] T 03d82f89554b4febbc83e61e3510dcf9 P 23dd6c70f2194912960e427740868aa3: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.002s
I20260809 05:27:37.569631 31160 tablet_bootstrap.cc:492] T 03d82f89554b4febbc83e61e3510dcf9 P 3c95ebabe2cf4a8b834182865088c360: No bootstrap required, opened a new log
I20260809 05:27:37.569832 31160 ts_tablet_manager.cc:1397] T 03d82f89554b4febbc83e61e3510dcf9 P 3c95ebabe2cf4a8b834182865088c360: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 05:27:37.570376 31158 raft_consensus.cc:348] T 03d82f89554b4febbc83e61e3510dcf9 P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:37.570694 31158 raft_consensus.cc:374] T 03d82f89554b4febbc83e61e3510dcf9 P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:37.570819 31158 raft_consensus.cc:729] T 03d82f89554b4febbc83e61e3510dcf9 P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23dd6c70f2194912960e427740868aa3, State: Initialized, Role: FOLLOWER
I20260809 05:27:37.570858 31160 raft_consensus.cc:348] T 03d82f89554b4febbc83e61e3510dcf9 P 3c95ebabe2cf4a8b834182865088c360 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:37.571259 31160 raft_consensus.cc:374] T 03d82f89554b4febbc83e61e3510dcf9 P 3c95ebabe2cf4a8b834182865088c360 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:37.571347 31161 tablet_bootstrap.cc:492] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69: No bootstrap required, opened a new log
I20260809 05:27:37.571162 31158 consensus_queue.cc:260] T 03d82f89554b4febbc83e61e3510dcf9 P 23dd6c70f2194912960e427740868aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:37.571389 31160 raft_consensus.cc:729] T 03d82f89554b4febbc83e61e3510dcf9 P 3c95ebabe2cf4a8b834182865088c360 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c95ebabe2cf4a8b834182865088c360, State: Initialized, Role: FOLLOWER
I20260809 05:27:37.571506 31161 ts_tablet_manager.cc:1397] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 05:27:37.571692 31160 consensus_queue.cc:260] T 03d82f89554b4febbc83e61e3510dcf9 P 3c95ebabe2cf4a8b834182865088c360 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:37.572745 31158 ts_tablet_manager.cc:1428] T 03d82f89554b4febbc83e61e3510dcf9 P 23dd6c70f2194912960e427740868aa3: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260809 05:27:37.572753 31160 ts_tablet_manager.cc:1428] T 03d82f89554b4febbc83e61e3510dcf9 P 3c95ebabe2cf4a8b834182865088c360: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 05:27:37.572557 31161 raft_consensus.cc:348] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:37.573148 31161 raft_consensus.cc:374] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:37.573268 31161 raft_consensus.cc:729] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 422b69f54b1344ad8d69570c9c6ade69, State: Initialized, Role: FOLLOWER
I20260809 05:27:37.573643 31161 consensus_queue.cc:260] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:37.577298 31161 ts_tablet_manager.cc:1428] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 05:27:37.877990 31169 raft_consensus.cc:482] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:27:37.878325 31169 raft_consensus.cc:504] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:37.880476 31169 leader_election.cc:288] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23dd6c70f2194912960e427740868aa3 (127.26.185.2:46449), 3c95ebabe2cf4a8b834182865088c360 (127.26.185.3:33997)
I20260809 05:27:37.902225 31173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:37.881235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:58203 (local address 127.26.185.3:33997)
0809 05:27:37.893772 (+ 12537us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:37.893780 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:37.893816 (+ 36us) server_negotiation.cc:407] Connection header received
0809 05:27:37.894082 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:37.894090 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:37.894206 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:37.894335 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:27:37.895110 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:37.896372 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:37.899455 (+ 3083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:37.900828 (+ 1373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:37.901092 (+ 264us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:37.901195 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:37.901600 (+ 405us) server_negotiation.cc:299] Negotiation successful
0809 05:27:37.901789 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12321,"thread_start_us":12596,"threads_started":1}
I20260809 05:27:37.902201 31172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:37.881167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:58035 (local address 127.26.185.2:46449)
0809 05:27:37.894651 (+ 13484us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:37.894657 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:37.894682 (+ 25us) server_negotiation.cc:407] Connection header received
0809 05:27:37.894754 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:37.894758 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:37.894827 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:37.894917 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:27:37.895624 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:37.896844 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:37.899448 (+ 2604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:37.900821 (+ 1373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:37.901107 (+ 286us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:37.901228 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:37.901658 (+ 430us) server_negotiation.cc:299] Negotiation successful
0809 05:27:37.901819 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13265,"thread_start_us":13073,"threads_started":1}
I20260809 05:27:37.902360 31171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:37.880955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:33997 (local address 127.26.185.1:58203)
0809 05:27:37.893560 (+ 12605us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:37.893597 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:37.893854 (+ 257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:37.894481 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:37.894488 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:37.894519 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:27:37.894829 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:37.894839 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:37.896578 (+ 1739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:37.896582 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:37.899258 (+ 2676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:37.899274 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:37.901105 (+ 1831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:37.901111 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:37.901335 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:37.901383 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 05:27:37.901532 (+ 149us) client_negotiation.cc:240] Negotiation successful
0809 05:27:37.901731 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12348,"mutex_wait_us":77,"thread_start_us":12766,"threads_started":1}
I20260809 05:27:37.902407 31170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:37.881067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:46449 (local address 127.26.185.1:58035)
0809 05:27:37.894267 (+ 13200us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:37.894290 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:37.894461 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:37.894984 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:37.894990 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:37.895052 (+ 62us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:27:37.895416 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:37.895427 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:37.897018 (+ 1591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:37.897024 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:37.899257 (+ 2233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:37.899274 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:37.901270 (+ 1996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:37.901276 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:37.901461 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:37.901506 (+ 45us) client_negotiation.cc:769] Sending connection context
0809 05:27:37.901579 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 05:27:37.901730 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12991,"mutex_wait_us":53,"thread_start_us":11998,"threads_started":1}
I20260809 05:27:37.903281 30892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03d82f89554b4febbc83e61e3510dcf9" candidate_uuid: "422b69f54b1344ad8d69570c9c6ade69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c95ebabe2cf4a8b834182865088c360" is_pre_election: true
I20260809 05:27:37.903529 30677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03d82f89554b4febbc83e61e3510dcf9" candidate_uuid: "422b69f54b1344ad8d69570c9c6ade69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23dd6c70f2194912960e427740868aa3" is_pre_election: true
I20260809 05:27:37.903623 30892 raft_consensus.cc:2454] T 03d82f89554b4febbc83e61e3510dcf9 P 3c95ebabe2cf4a8b834182865088c360 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 422b69f54b1344ad8d69570c9c6ade69 in term 0.
I20260809 05:27:37.903848 30677 raft_consensus.cc:2454] T 03d82f89554b4febbc83e61e3510dcf9 P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 422b69f54b1344ad8d69570c9c6ade69 in term 0.
I20260809 05:27:37.904354 30353 leader_election.cc:302] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 23dd6c70f2194912960e427740868aa3, 3c95ebabe2cf4a8b834182865088c360, 422b69f54b1344ad8d69570c9c6ade69; no voters:
I20260809 05:27:37.904908 31169 raft_consensus.cc:2781] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:27:37.905095 31169 raft_consensus.cc:482] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:27:37.905216 31169 raft_consensus.cc:3037] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:37.908061 31169 raft_consensus.cc:504] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:37.908864 31169 leader_election.cc:288] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69 [CANDIDATE]: Term 1 election: Requested vote from peers 23dd6c70f2194912960e427740868aa3 (127.26.185.2:46449), 3c95ebabe2cf4a8b834182865088c360 (127.26.185.3:33997)
I20260809 05:27:37.909515 30677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03d82f89554b4febbc83e61e3510dcf9" candidate_uuid: "422b69f54b1344ad8d69570c9c6ade69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23dd6c70f2194912960e427740868aa3"
I20260809 05:27:37.909557 30892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03d82f89554b4febbc83e61e3510dcf9" candidate_uuid: "422b69f54b1344ad8d69570c9c6ade69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c95ebabe2cf4a8b834182865088c360"
I20260809 05:27:37.909803 30892 raft_consensus.cc:3037] T 03d82f89554b4febbc83e61e3510dcf9 P 3c95ebabe2cf4a8b834182865088c360 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:37.909827 30677 raft_consensus.cc:3037] T 03d82f89554b4febbc83e61e3510dcf9 P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:37.913318 30677 raft_consensus.cc:2454] T 03d82f89554b4febbc83e61e3510dcf9 P 23dd6c70f2194912960e427740868aa3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 422b69f54b1344ad8d69570c9c6ade69 in term 1.
I20260809 05:27:37.913340 30892 raft_consensus.cc:2454] T 03d82f89554b4febbc83e61e3510dcf9 P 3c95ebabe2cf4a8b834182865088c360 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 422b69f54b1344ad8d69570c9c6ade69 in term 1.
I20260809 05:27:37.913900 30353 leader_election.cc:302] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 23dd6c70f2194912960e427740868aa3, 3c95ebabe2cf4a8b834182865088c360, 422b69f54b1344ad8d69570c9c6ade69; no voters:
I20260809 05:27:37.914316 31169 raft_consensus.cc:2781] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:27:37.914894 31169 raft_consensus.cc:686] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69 [term 1 LEADER]: Becoming Leader. State: Replica: 422b69f54b1344ad8d69570c9c6ade69, State: Running, Role: LEADER
I20260809 05:27:37.915458 31169 consensus_queue.cc:237] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:37.920320 30212 catalog_manager.cc:5495] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69 reported cstate change: term changed from 0 to 1, leader changed from <none> to 422b69f54b1344ad8d69570c9c6ade69 (127.26.185.1). New cstate: current_term: 1 leader_uuid: "422b69f54b1344ad8d69570c9c6ade69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } health_report { overall_health: UNKNOWN } } }
I20260809 05:27:37.954742 31189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:37.947855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59620 (local address 127.26.185.1:43181)
0809 05:27:37.948561 (+ 706us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:37.948567 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:37.948588 (+ 21us) server_negotiation.cc:407] Connection header received
0809 05:27:37.948708 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:37.948712 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:37.948806 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:37.949026 (+ 220us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:27:37.949443 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:37.950349 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:37.951785 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:37.952321 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:37.952430 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:37.953022 (+ 592us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:27:37.953836 (+ 814us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:27:37.954039 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:37.954285 (+ 246us) server_negotiation.cc:299] Negotiation successful
0809 05:27:37.954380 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":413,"threads_started":1}
I20260809 05:27:37.974046 31172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:37.968009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:33429 (local address 127.26.185.2:46449)
0809 05:27:37.968286 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:37.968292 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:37.968827 (+ 535us) server_negotiation.cc:407] Connection header received
0809 05:27:37.969045 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:37.969050 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:37.969138 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:37.969231 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:27:37.969834 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:37.970654 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:37.972232 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:37.972750 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:37.972866 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:37.973356 (+ 490us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:27:37.973489 (+ 133us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:27:37.973565 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:37.973707 (+ 142us) server_negotiation.cc:299] Negotiation successful
0809 05:27:37.973786 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260809 05:27:37.974117 31196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:37.967755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:46449 (local address 127.26.185.1:33429)
0809 05:27:37.968679 (+ 924us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:37.968698 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:37.968855 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:37.969293 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:37.969297 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:37.969309 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 05:27:37.969656 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:37.969666 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:37.970789 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:37.970794 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:37.972064 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:37.972078 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:37.972929 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:37.972933 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:37.973092 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:37.973161 (+ 69us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 05:27:37.973581 (+ 420us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 05:27:37.973590 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 05:27:37.973655 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 05:27:37.973773 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":735,"thread_start_us":505,"threads_started":1}
I20260809 05:27:37.985224 30677 raft_consensus.cc:1261] T 03d82f89554b4febbc83e61e3510dcf9 P 23dd6c70f2194912960e427740868aa3 [term 1 FOLLOWER]: Refusing update from remote peer 422b69f54b1344ad8d69570c9c6ade69: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:27:37.985363 30892 raft_consensus.cc:1261] T 03d82f89554b4febbc83e61e3510dcf9 P 3c95ebabe2cf4a8b834182865088c360 [term 1 FOLLOWER]: Refusing update from remote peer 422b69f54b1344ad8d69570c9c6ade69: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:27:37.986044 31169 consensus_queue.cc:1035] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:27:37.986445 31174 consensus_queue.cc:1035] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:27:38.021970 31189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:38.013075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:34111 (local address 127.26.185.1:43181)
0809 05:27:38.013275 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:38.013282 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:38.015958 (+ 2676us) server_negotiation.cc:407] Connection header received
0809 05:27:38.016215 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:38.016221 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:38.016333 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:38.016444 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:27:38.017028 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:38.018036 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:38.019724 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:38.020402 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:38.020561 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:38.021117 (+ 556us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:27:38.021274 (+ 157us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:27:38.021375 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:38.021563 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 05:27:38.021658 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 05:27:38.022078 31207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:38.012973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:43181 (local address 127.26.185.2:34111)
0809 05:27:38.015807 (+ 2834us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:38.015838 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:38.016021 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:38.016517 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:38.016521 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:38.016536 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 05:27:38.016843 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:38.016853 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:38.018171 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:38.018176 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:38.019581 (+ 1405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:38.019595 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:38.020630 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:38.020636 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:38.020823 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:38.020903 (+ 80us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 05:27:38.021403 (+ 500us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 05:27:38.021418 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 05:27:38.021510 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 05:27:38.021694 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2661,"thread_start_us":2500,"threads_started":1}
I20260809 05:27:38.065408 30212 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:27:38.065804 30212 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:27:38.069898 30212 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fc1ef37618a8471ebe8761ca1fdaebcb: Sending DeleteTablet for 3 replicas of tablet 03d82f89554b4febbc83e61e3510dcf9
I20260809 05:27:38.071099 30422 tablet_service.cc:1514] Processing DeleteTablet for tablet 03d82f89554b4febbc83e61e3510dcf9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:27:38 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:59616
I20260809 05:27:38.071183 30854 tablet_service.cc:1514] Processing DeleteTablet for tablet 03d82f89554b4febbc83e61e3510dcf9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:27:38 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:47572
I20260809 05:27:38.071235 30636 tablet_service.cc:1514] Processing DeleteTablet for tablet 03d82f89554b4febbc83e61e3510dcf9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:27:38 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:34618
I20260809 05:27:38.074743 30212 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51370:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 05:27:38.075698 30212 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 05:27:38.078402 31217 tablet_replica.cc:330] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69: stopping tablet replica
I20260809 05:27:38.078735 31217 raft_consensus.cc:2229] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69 [term 1 LEADER]: Raft consensus shutting down.
I20260809 05:27:38.079644 31217 raft_consensus.cc:2258] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:27:38.083837 31217 ts_tablet_manager.cc:1905] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:27:38.086169 30422 tablet_service.cc:1467] Processing CreateTablet for tablet 59fb0d6a99c64908af658d803562d8f9 (DEFAULT_TABLE table=test-table [id=60c3cc08ae24449aa321df13dc5772ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:27:38.086282 30638 tablet_service.cc:1467] Processing CreateTablet for tablet 59fb0d6a99c64908af658d803562d8f9 (DEFAULT_TABLE table=test-table [id=60c3cc08ae24449aa321df13dc5772ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:27:38.086862 30422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59fb0d6a99c64908af658d803562d8f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:38.087591 30855 tablet_service.cc:1467] Processing CreateTablet for tablet 59fb0d6a99c64908af658d803562d8f9 (DEFAULT_TABLE table=test-table [id=60c3cc08ae24449aa321df13dc5772ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:27:38.088276 30855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59fb0d6a99c64908af658d803562d8f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:38.096118 30638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59fb0d6a99c64908af658d803562d8f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:38.099470 31219 tablet_replica.cc:330] T 03d82f89554b4febbc83e61e3510dcf9 P 3c95ebabe2cf4a8b834182865088c360: stopping tablet replica
I20260809 05:27:38.099763 31219 raft_consensus.cc:2229] T 03d82f89554b4febbc83e61e3510dcf9 P 3c95ebabe2cf4a8b834182865088c360 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:27:38.099965 31221 tablet_bootstrap.cc:492] T 59fb0d6a99c64908af658d803562d8f9 P 422b69f54b1344ad8d69570c9c6ade69: Bootstrap starting.
I20260809 05:27:38.100067 31219 raft_consensus.cc:2258] T 03d82f89554b4febbc83e61e3510dcf9 P 3c95ebabe2cf4a8b834182865088c360 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:27:38.102687 31219 ts_tablet_manager.cc:1905] T 03d82f89554b4febbc83e61e3510dcf9 P 3c95ebabe2cf4a8b834182865088c360: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:27:38.103557 31221 tablet_bootstrap.cc:654] T 59fb0d6a99c64908af658d803562d8f9 P 422b69f54b1344ad8d69570c9c6ade69: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:38.104990 31220 tablet_replica.cc:330] T 03d82f89554b4febbc83e61e3510dcf9 P 23dd6c70f2194912960e427740868aa3: stopping tablet replica
I20260809 05:27:38.105225 31220 raft_consensus.cc:2229] T 03d82f89554b4febbc83e61e3510dcf9 P 23dd6c70f2194912960e427740868aa3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:27:38.105479 31220 raft_consensus.cc:2258] T 03d82f89554b4febbc83e61e3510dcf9 P 23dd6c70f2194912960e427740868aa3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:27:38.111017 31222 tablet_bootstrap.cc:492] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3: Bootstrap starting.
I20260809 05:27:38.112149 31224 tablet_bootstrap.cc:492] T 59fb0d6a99c64908af658d803562d8f9 P 3c95ebabe2cf4a8b834182865088c360: Bootstrap starting.
I20260809 05:27:38.112244 31219 ts_tablet_manager.cc:1918] T 03d82f89554b4febbc83e61e3510dcf9 P 3c95ebabe2cf4a8b834182865088c360: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 05:27:38.112480 31219 log.cc:1196] T 03d82f89554b4febbc83e61e3510dcf9 P 3c95ebabe2cf4a8b834182865088c360: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-2/wal/wals/03d82f89554b4febbc83e61e3510dcf9
I20260809 05:27:38.113154 31219 ts_tablet_manager.cc:1939] T 03d82f89554b4febbc83e61e3510dcf9 P 3c95ebabe2cf4a8b834182865088c360: Deleting consensus metadata
I20260809 05:27:38.114748 30194 catalog_manager.cc:4841] TS 3c95ebabe2cf4a8b834182865088c360 (127.26.185.3:33997): tablet 03d82f89554b4febbc83e61e3510dcf9 (table test-table [id=d3064f8bf3fa4bfcb590fc135c5b6a03]) successfully deleted
I20260809 05:27:38.115839 31220 ts_tablet_manager.cc:1905] T 03d82f89554b4febbc83e61e3510dcf9 P 23dd6c70f2194912960e427740868aa3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:27:38.124465 31222 tablet_bootstrap.cc:654] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:38.114315 31224 tablet_bootstrap.cc:654] T 59fb0d6a99c64908af658d803562d8f9 P 3c95ebabe2cf4a8b834182865088c360: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:38.129172 31220 ts_tablet_manager.cc:1918] T 03d82f89554b4febbc83e61e3510dcf9 P 23dd6c70f2194912960e427740868aa3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 05:27:38.129395 31220 log.cc:1196] T 03d82f89554b4febbc83e61e3510dcf9 P 23dd6c70f2194912960e427740868aa3: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-1/wal/wals/03d82f89554b4febbc83e61e3510dcf9
I20260809 05:27:38.129927 31220 ts_tablet_manager.cc:1939] T 03d82f89554b4febbc83e61e3510dcf9 P 23dd6c70f2194912960e427740868aa3: Deleting consensus metadata
I20260809 05:27:38.133306 31222 tablet_bootstrap.cc:492] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3: No bootstrap required, opened a new log
I20260809 05:27:38.133510 31222 ts_tablet_manager.cc:1397] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.003s
I20260809 05:27:38.134567 31222 raft_consensus.cc:348] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:38.134858 31222 raft_consensus.cc:374] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:38.134963 31222 raft_consensus.cc:729] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23dd6c70f2194912960e427740868aa3, State: Initialized, Role: FOLLOWER
I20260809 05:27:38.135308 31222 consensus_queue.cc:260] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:38.135916 31221 tablet_bootstrap.cc:492] T 59fb0d6a99c64908af658d803562d8f9 P 422b69f54b1344ad8d69570c9c6ade69: No bootstrap required, opened a new log
I20260809 05:27:38.136143 31221 ts_tablet_manager.cc:1397] T 59fb0d6a99c64908af658d803562d8f9 P 422b69f54b1344ad8d69570c9c6ade69: Time spent bootstrapping tablet: real 0.036s user 0.011s sys 0.004s
I20260809 05:27:38.136626 30191 catalog_manager.cc:4841] TS 23dd6c70f2194912960e427740868aa3 (127.26.185.2:46449): tablet 03d82f89554b4febbc83e61e3510dcf9 (table test-table [id=d3064f8bf3fa4bfcb590fc135c5b6a03]) successfully deleted
I20260809 05:27:38.137403 31221 raft_consensus.cc:348] T 59fb0d6a99c64908af658d803562d8f9 P 422b69f54b1344ad8d69570c9c6ade69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:38.137802 31221 raft_consensus.cc:374] T 59fb0d6a99c64908af658d803562d8f9 P 422b69f54b1344ad8d69570c9c6ade69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:38.137995 31221 raft_consensus.cc:729] T 59fb0d6a99c64908af658d803562d8f9 P 422b69f54b1344ad8d69570c9c6ade69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 422b69f54b1344ad8d69570c9c6ade69, State: Initialized, Role: FOLLOWER
I20260809 05:27:38.138351 31221 consensus_queue.cc:260] T 59fb0d6a99c64908af658d803562d8f9 P 422b69f54b1344ad8d69570c9c6ade69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:38.139331 31222 ts_tablet_manager.cc:1428] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20260809 05:27:38.140002 31221 ts_tablet_manager.cc:1428] T 59fb0d6a99c64908af658d803562d8f9 P 422b69f54b1344ad8d69570c9c6ade69: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260809 05:27:38.142097 31217 ts_tablet_manager.cc:1918] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 05:27:38.142256 31217 log.cc:1196] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-0/wal/wals/03d82f89554b4febbc83e61e3510dcf9
I20260809 05:27:38.142854 31217 ts_tablet_manager.cc:1939] T 03d82f89554b4febbc83e61e3510dcf9 P 422b69f54b1344ad8d69570c9c6ade69: Deleting consensus metadata
I20260809 05:27:38.144305 30188 catalog_manager.cc:4841] TS 422b69f54b1344ad8d69570c9c6ade69 (127.26.185.1:43181): tablet 03d82f89554b4febbc83e61e3510dcf9 (table test-table [id=d3064f8bf3fa4bfcb590fc135c5b6a03]) successfully deleted
I20260809 05:27:38.145200 31224 tablet_bootstrap.cc:492] T 59fb0d6a99c64908af658d803562d8f9 P 3c95ebabe2cf4a8b834182865088c360: No bootstrap required, opened a new log
I20260809 05:27:38.145424 31224 ts_tablet_manager.cc:1397] T 59fb0d6a99c64908af658d803562d8f9 P 3c95ebabe2cf4a8b834182865088c360: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.006s
I20260809 05:27:38.146447 31224 raft_consensus.cc:348] T 59fb0d6a99c64908af658d803562d8f9 P 3c95ebabe2cf4a8b834182865088c360 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:38.146754 31224 raft_consensus.cc:374] T 59fb0d6a99c64908af658d803562d8f9 P 3c95ebabe2cf4a8b834182865088c360 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:38.146874 31224 raft_consensus.cc:729] T 59fb0d6a99c64908af658d803562d8f9 P 3c95ebabe2cf4a8b834182865088c360 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c95ebabe2cf4a8b834182865088c360, State: Initialized, Role: FOLLOWER
I20260809 05:27:38.147188 31224 consensus_queue.cc:260] T 59fb0d6a99c64908af658d803562d8f9 P 3c95ebabe2cf4a8b834182865088c360 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:38.148066 31224 ts_tablet_manager.cc:1428] T 59fb0d6a99c64908af658d803562d8f9 P 3c95ebabe2cf4a8b834182865088c360: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 05:27:38.290513 31135 raft_consensus.cc:482] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:27:38.290874 31135 raft_consensus.cc:504] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:38.292069 31135 leader_election.cc:288] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 422b69f54b1344ad8d69570c9c6ade69 (127.26.185.1:43181), 3c95ebabe2cf4a8b834182865088c360 (127.26.185.3:33997)
I20260809 05:27:38.292955 30458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59fb0d6a99c64908af658d803562d8f9" candidate_uuid: "23dd6c70f2194912960e427740868aa3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "422b69f54b1344ad8d69570c9c6ade69" is_pre_election: true
I20260809 05:27:38.293005 30892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59fb0d6a99c64908af658d803562d8f9" candidate_uuid: "23dd6c70f2194912960e427740868aa3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c95ebabe2cf4a8b834182865088c360" is_pre_election: true
I20260809 05:27:38.293305 30458 raft_consensus.cc:2454] T 59fb0d6a99c64908af658d803562d8f9 P 422b69f54b1344ad8d69570c9c6ade69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23dd6c70f2194912960e427740868aa3 in term 0.
I20260809 05:27:38.293318 30892 raft_consensus.cc:2454] T 59fb0d6a99c64908af658d803562d8f9 P 3c95ebabe2cf4a8b834182865088c360 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23dd6c70f2194912960e427740868aa3 in term 0.
I20260809 05:27:38.293959 30563 leader_election.cc:302] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 23dd6c70f2194912960e427740868aa3, 3c95ebabe2cf4a8b834182865088c360, 422b69f54b1344ad8d69570c9c6ade69; no voters:
I20260809 05:27:38.294371 31135 raft_consensus.cc:2781] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:27:38.294519 31135 raft_consensus.cc:482] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:27:38.294620 31135 raft_consensus.cc:3037] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:38.298373 31135 raft_consensus.cc:504] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:38.299065 31135 leader_election.cc:288] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3 [CANDIDATE]: Term 1 election: Requested vote from peers 422b69f54b1344ad8d69570c9c6ade69 (127.26.185.1:43181), 3c95ebabe2cf4a8b834182865088c360 (127.26.185.3:33997)
I20260809 05:27:38.299798 30458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59fb0d6a99c64908af658d803562d8f9" candidate_uuid: "23dd6c70f2194912960e427740868aa3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "422b69f54b1344ad8d69570c9c6ade69"
I20260809 05:27:38.300143 30458 raft_consensus.cc:3037] T 59fb0d6a99c64908af658d803562d8f9 P 422b69f54b1344ad8d69570c9c6ade69 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:38.300185 30892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59fb0d6a99c64908af658d803562d8f9" candidate_uuid: "23dd6c70f2194912960e427740868aa3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c95ebabe2cf4a8b834182865088c360"
I20260809 05:27:38.300449 30892 raft_consensus.cc:3037] T 59fb0d6a99c64908af658d803562d8f9 P 3c95ebabe2cf4a8b834182865088c360 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:38.302989 30458 raft_consensus.cc:2454] T 59fb0d6a99c64908af658d803562d8f9 P 422b69f54b1344ad8d69570c9c6ade69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23dd6c70f2194912960e427740868aa3 in term 1.
I20260809 05:27:38.303591 30559 leader_election.cc:302] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23dd6c70f2194912960e427740868aa3, 422b69f54b1344ad8d69570c9c6ade69; no voters:
I20260809 05:27:38.303603 30892 raft_consensus.cc:2454] T 59fb0d6a99c64908af658d803562d8f9 P 3c95ebabe2cf4a8b834182865088c360 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23dd6c70f2194912960e427740868aa3 in term 1.
I20260809 05:27:38.303973 31135 raft_consensus.cc:2781] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:27:38.304143 31135 raft_consensus.cc:686] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3 [term 1 LEADER]: Becoming Leader. State: Replica: 23dd6c70f2194912960e427740868aa3, State: Running, Role: LEADER
I20260809 05:27:38.304461 31135 consensus_queue.cc:237] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } }
I20260809 05:27:38.307979 30210 catalog_manager.cc:5495] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23dd6c70f2194912960e427740868aa3 (127.26.185.2). New cstate: current_term: 1 leader_uuid: "23dd6c70f2194912960e427740868aa3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23dd6c70f2194912960e427740868aa3" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 46449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 } health_report { overall_health: UNKNOWN } } }
I20260809 05:27:38.368698 31172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:38.362989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34644 (local address 127.26.185.2:46449)
0809 05:27:38.363215 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:38.363221 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:38.363478 (+ 257us) server_negotiation.cc:407] Connection header received
0809 05:27:38.363719 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:38.363727 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:38.363810 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:38.363915 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:27:38.364366 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:38.365236 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:38.366678 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:38.367202 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:38.367353 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:38.367847 (+ 494us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:27:38.367987 (+ 140us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:27:38.368091 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:38.368265 (+ 174us) server_negotiation.cc:299] Negotiation successful
0809 05:27:38.368356 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 05:27:38.380560 30892 raft_consensus.cc:1261] T 59fb0d6a99c64908af658d803562d8f9 P 3c95ebabe2cf4a8b834182865088c360 [term 1 FOLLOWER]: Refusing update from remote peer 23dd6c70f2194912960e427740868aa3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:27:38.381157 31135 consensus_queue.cc:1035] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c95ebabe2cf4a8b834182865088c360" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 33997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:27:38.381254 30458 raft_consensus.cc:1261] T 59fb0d6a99c64908af658d803562d8f9 P 422b69f54b1344ad8d69570c9c6ade69 [term 1 FOLLOWER]: Refusing update from remote peer 23dd6c70f2194912960e427740868aa3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:27:38.382011 31210 consensus_queue.cc:1035] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "422b69f54b1344ad8d69570c9c6ade69" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 05:27:38.416350 31178 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 05:27:40.029374 30210 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:27:40.029847 30210 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:27:40.035466 30210 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fc1ef37618a8471ebe8761ca1fdaebcb: Sending DeleteTablet for 3 replicas of tablet 59fb0d6a99c64908af658d803562d8f9
I20260809 05:27:40.036727 30422 tablet_service.cc:1514] Processing DeleteTablet for tablet 59fb0d6a99c64908af658d803562d8f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:27:40 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:59616
I20260809 05:27:40.036898 30855 tablet_service.cc:1514] Processing DeleteTablet for tablet 59fb0d6a99c64908af658d803562d8f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:27:40 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:47572
I20260809 05:27:40.036823 30638 tablet_service.cc:1514] Processing DeleteTablet for tablet 59fb0d6a99c64908af658d803562d8f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:27:40 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:34618
I20260809 05:27:40.038090 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 30323
I20260809 05:27:40.048102 31271 tablet_replica.cc:330] T 59fb0d6a99c64908af658d803562d8f9 P 3c95ebabe2cf4a8b834182865088c360: stopping tablet replica
I20260809 05:27:40.048805 31271 raft_consensus.cc:2229] T 59fb0d6a99c64908af658d803562d8f9 P 3c95ebabe2cf4a8b834182865088c360 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:27:40.049326 31271 raft_consensus.cc:2258] T 59fb0d6a99c64908af658d803562d8f9 P 3c95ebabe2cf4a8b834182865088c360 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:27:40.049598 31269 tablet_replica.cc:330] T 59fb0d6a99c64908af658d803562d8f9 P 422b69f54b1344ad8d69570c9c6ade69: stopping tablet replica
I20260809 05:27:40.049996 31270 tablet_replica.cc:330] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3: stopping tablet replica
I20260809 05:27:40.050066 31269 raft_consensus.cc:2229] T 59fb0d6a99c64908af658d803562d8f9 P 422b69f54b1344ad8d69570c9c6ade69 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:27:40.050446 31269 raft_consensus.cc:2258] T 59fb0d6a99c64908af658d803562d8f9 P 422b69f54b1344ad8d69570c9c6ade69 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:27:40.050945 31270 raft_consensus.cc:2229] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3 [term 1 LEADER]: Raft consensus shutting down.
I20260809 05:27:40.051656 31271 ts_tablet_manager.cc:1905] T 59fb0d6a99c64908af658d803562d8f9 P 3c95ebabe2cf4a8b834182865088c360: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:27:40.051898 31269 ts_tablet_manager.cc:1905] T 59fb0d6a99c64908af658d803562d8f9 P 422b69f54b1344ad8d69570c9c6ade69: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:27:40.052551 31270 raft_consensus.cc:2258] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:27:40.054659 31270 ts_tablet_manager.cc:1905] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:27:40.060060 31271 ts_tablet_manager.cc:1918] T 59fb0d6a99c64908af658d803562d8f9 P 3c95ebabe2cf4a8b834182865088c360: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 05:27:40.060345 31271 log.cc:1196] T 59fb0d6a99c64908af658d803562d8f9 P 3c95ebabe2cf4a8b834182865088c360: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-2/wal/wals/59fb0d6a99c64908af658d803562d8f9
I20260809 05:27:40.060963 31271 ts_tablet_manager.cc:1939] T 59fb0d6a99c64908af658d803562d8f9 P 3c95ebabe2cf4a8b834182865088c360: Deleting consensus metadata
I20260809 05:27:40.061240 31269 ts_tablet_manager.cc:1918] T 59fb0d6a99c64908af658d803562d8f9 P 422b69f54b1344ad8d69570c9c6ade69: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 05:27:40.061487 31269 log.cc:1196] T 59fb0d6a99c64908af658d803562d8f9 P 422b69f54b1344ad8d69570c9c6ade69: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-0/wal/wals/59fb0d6a99c64908af658d803562d8f9
I20260809 05:27:40.062073 31269 ts_tablet_manager.cc:1939] T 59fb0d6a99c64908af658d803562d8f9 P 422b69f54b1344ad8d69570c9c6ade69: Deleting consensus metadata
I20260809 05:27:40.062673 30194 catalog_manager.cc:4841] TS 3c95ebabe2cf4a8b834182865088c360 (127.26.185.3:33997): tablet 59fb0d6a99c64908af658d803562d8f9 (table test-table [id=60c3cc08ae24449aa321df13dc5772ea]) successfully deleted
I20260809 05:27:40.062968 31270 ts_tablet_manager.cc:1918] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 05:27:40.063254 31270 log.cc:1196] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786253234117492-27364-0/minicluster-data/ts-1/wal/wals/59fb0d6a99c64908af658d803562d8f9
I20260809 05:27:40.063511 30188 catalog_manager.cc:4841] TS 422b69f54b1344ad8d69570c9c6ade69 (127.26.185.1:43181): tablet 59fb0d6a99c64908af658d803562d8f9 (table test-table [id=60c3cc08ae24449aa321df13dc5772ea]) successfully deleted
I20260809 05:27:40.063719 31270 ts_tablet_manager.cc:1939] T 59fb0d6a99c64908af658d803562d8f9 P 23dd6c70f2194912960e427740868aa3: Deleting consensus metadata
I20260809 05:27:40.064908 30191 catalog_manager.cc:4841] TS 23dd6c70f2194912960e427740868aa3 (127.26.185.2:46449): tablet 59fb0d6a99c64908af658d803562d8f9 (table test-table [id=60c3cc08ae24449aa321df13dc5772ea]) successfully deleted
Aug 09 05:27:40 dist-test-slave-h3ft krb5kdc[30138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253257, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.185.1@KRBTEST.COM
I20260809 05:27:40.079852 31273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:40.040277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45530 (local address 127.26.185.1:43181)
0809 05:27:40.052753 (+ 12476us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:40.052764 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:40.053236 (+ 472us) server_negotiation.cc:407] Connection header received
0809 05:27:40.053598 (+ 362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:40.053605 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:40.053715 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:40.053852 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:40.056370 (+ 2518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:40.057660 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:40.059662 (+ 2002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:40.060407 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:40.060551 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:40.072227 (+ 11676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:40.072266 (+ 39us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:40.072295 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:40.072364 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:40.076081 (+ 3717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:40.077093 (+ 1012us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:40.077105 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:40.077108 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:40.077303 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:40.077858 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:40.077863 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:40.077865 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:40.078387 (+ 522us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:40.078702 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:40.079239 (+ 537us) server_negotiation.cc:299] Negotiation successful
0809 05:27:40.079504 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12267,"thread_start_us":12163,"threads_started":1}
W20260809 05:27:40.080814 30524 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45530
W20260809 05:27:40.081691 27364 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 30323: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 05:27:40.081943 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 30323
I20260809 05:27:40.135279 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 30536
Aug 09 05:27:40 dist-test-slave-h3ft krb5kdc[30138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253257, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.185.2@KRBTEST.COM
I20260809 05:27:40.153496 31276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:40.136288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40964 (local address 127.26.185.2:46449)
0809 05:27:40.137051 (+ 763us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:40.137056 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:40.137076 (+ 20us) server_negotiation.cc:407] Connection header received
0809 05:27:40.137147 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:40.137152 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:40.137237 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:40.137346 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:40.139115 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:40.140002 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:40.141364 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:40.141831 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:40.142037 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:40.147103 (+ 5066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:40.147134 (+ 31us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:40.147158 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:40.147209 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:40.150497 (+ 3288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:40.151311 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:40.151319 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:40.151322 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:40.151502 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:40.151841 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:40.151845 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:40.151847 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:40.152261 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:40.152573 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:40.152812 (+ 239us) server_negotiation.cc:299] Negotiation successful
0809 05:27:40.153032 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":640,"thread_start_us":404,"threads_started":1}
W20260809 05:27:40.154430 30735 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40964
W20260809 05:27:40.155398 27364 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 30536: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 05:27:40.155617 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 30536
I20260809 05:27:40.201081 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 30749
Aug 09 05:27:40 dist-test-slave-h3ft krb5kdc[30138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253257, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.185.3@KRBTEST.COM
I20260809 05:27:40.219412 31277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:40.202097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33238 (local address 127.26.185.3:33997)
0809 05:27:40.202752 (+ 655us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:40.202757 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:40.202776 (+ 19us) server_negotiation.cc:407] Connection header received
0809 05:27:40.202859 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:40.202864 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:40.202944 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:40.203110 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:40.204680 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:40.205570 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:40.206843 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:40.207420 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:40.207533 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:40.212664 (+ 5131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:40.212686 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:40.212710 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:40.212753 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:40.216252 (+ 3499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:40.216995 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:40.217002 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:40.217005 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:40.217199 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:40.217674 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:40.217677 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:40.217679 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:40.218116 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:40.218366 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:40.218796 (+ 430us) server_negotiation.cc:299] Negotiation successful
0809 05:27:40.219064 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":519,"thread_start_us":351,"threads_started":1}
W20260809 05:27:40.220255 30975 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33238
W20260809 05:27:40.221098 27364 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 30749: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 05:27:40.221366 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 30749
I20260809 05:27:40.263154 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 30157
I20260809 05:27:40.264719 30278 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:27:40.400425 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 30157
2026-08-09T05:27:40Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (10243 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:27:40 dist-test-slave-h3ft krb5kdc[31286](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:27:40 dist-test-slave-h3ft krb5kdc[31286](info): set up 2 sockets
Aug 09 05:27:40 dist-test-slave-h3ft krb5kdc[31286](info): commencing operation
krb5kdc: starting...
W20260809 05:27:41.786208 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.324s user 0.008s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:27:41 dist-test-slave-h3ft krb5kdc[31286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253261, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:27:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:27:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
I20260809 05:27:42.053336 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:45179
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:45217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:45179
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:27:42.459646 31309 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:27:42.460088 31309 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:27:42.460300 31309 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:27:42.468395 31309 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:27:42.468523 31309 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:27:42.468642 31309 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:27:42.468760 31309 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:27:42.468847 31309 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:27:42.479698 31309 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:45217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:45179
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:45179
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:27:42.481487 31309 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:27:42.483253 31309 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:27:42.498117 31326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:42.498225 31316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:42.498225 31321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:42.499066 31309 server_base.cc:1034] running on GCE node
I20260809 05:27:42.500093 31309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:27:42.501902 31309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:27:42.503147 31309 hybrid_clock.cc:648] HybridClock initialized: now 1786253262503089 us; error 64 us; skew 500 ppm
I20260809 05:27:42.503580 31309 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:27:42 dist-test-slave-h3ft krb5kdc[31286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253262, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:27:42.507506 31309 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:27:42.509301 31309 webserver.cc:460] Webserver started at http://127.26.185.62:41317/ using document root <none> and password file <none>
I20260809 05:27:42.510192 31309 fs_manager.cc:359] Metadata directory not provided
I20260809 05:27:42.510352 31309 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:27:42.510733 31309 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:27:42.514811 31309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "bfc04b1d4e0f45ff927524c07cb6cd08"
format_stamp: "Formatted at 2026-08-09 05:27:42 on dist-test-slave-h3ft"
server_key: "69e09cdcccc5f5abe9890a2a7cf89c5d"
server_key_iv: "ff90b4d15d576460d2b87f5fce12dab2"
server_key_version: "encryptionkey@0"
I20260809 05:27:42.515858 31309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "bfc04b1d4e0f45ff927524c07cb6cd08"
format_stamp: "Formatted at 2026-08-09 05:27:42 on dist-test-slave-h3ft"
server_key: "69e09cdcccc5f5abe9890a2a7cf89c5d"
server_key_iv: "ff90b4d15d576460d2b87f5fce12dab2"
server_key_version: "encryptionkey@0"
I20260809 05:27:42.522370 31309 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260809 05:27:42.526713 31334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:42.528602 31309 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:27:42.528867 31309 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "bfc04b1d4e0f45ff927524c07cb6cd08"
format_stamp: "Formatted at 2026-08-09 05:27:42 on dist-test-slave-h3ft"
server_key: "69e09cdcccc5f5abe9890a2a7cf89c5d"
server_key_iv: "ff90b4d15d576460d2b87f5fce12dab2"
server_key_version: "encryptionkey@0"
I20260809 05:27:42.529135 31309 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:27:42.561969 31309 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:27:42.566787 31309 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:27:42.567201 31309 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:27:42.588825 31309 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:45179
I20260809 05:27:42.588833 31409 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:45179 every 8 connection(s)
I20260809 05:27:42.590547 31309 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:27:42.591691 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 31309
I20260809 05:27:42.592011 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:27:42.592767 27364 external_mini_cluster.cc:1428] Setting key 43cab6f6e6efdf81c3a3200056d2b677
I20260809 05:27:42.596055 31410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 05:27:42 dist-test-slave-h3ft krb5kdc[31286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253261, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:42.610172 31410 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bfc04b1d4e0f45ff927524c07cb6cd08: Bootstrap starting.
I20260809 05:27:42.614598 31410 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bfc04b1d4e0f45ff927524c07cb6cd08: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:42.616246 31410 log.cc:824] T 00000000000000000000000000000000 P bfc04b1d4e0f45ff927524c07cb6cd08: Log is configured to *not* fsync() on all Append() calls
I20260809 05:27:42.619973 31415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:42.595186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49372 (local address 127.26.185.62:45179)
0809 05:27:42.596107 (+ 921us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:42.596145 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:42.596215 (+ 70us) server_negotiation.cc:407] Connection header received
0809 05:27:42.598059 (+ 1844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:42.598086 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:42.598500 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:42.598977 (+ 477us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:42.600715 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:42.602206 (+ 1491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:42.603650 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:42.604869 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:42.605094 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:42.610848 (+ 5754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:42.610857 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:42.610877 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:42.610955 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:42.614344 (+ 3389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:42.615434 (+ 1090us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:42.615444 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:42.615452 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:42.615656 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:42.616161 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:42.616165 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:42.616167 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:42.616933 (+ 766us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:42.617390 (+ 457us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:42.617809 (+ 419us) server_negotiation.cc:299] Negotiation successful
0809 05:27:42.618372 (+ 563us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":669,"thread_start_us":408,"threads_started":1}
I20260809 05:27:42.620505 31410 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bfc04b1d4e0f45ff927524c07cb6cd08: No bootstrap required, opened a new log
I20260809 05:27:42.629603 31410 raft_consensus.cc:348] T 00000000000000000000000000000000 P bfc04b1d4e0f45ff927524c07cb6cd08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfc04b1d4e0f45ff927524c07cb6cd08" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 45179 } }
I20260809 05:27:42.630034 31410 raft_consensus.cc:374] T 00000000000000000000000000000000 P bfc04b1d4e0f45ff927524c07cb6cd08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:42.630118 31410 raft_consensus.cc:729] T 00000000000000000000000000000000 P bfc04b1d4e0f45ff927524c07cb6cd08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfc04b1d4e0f45ff927524c07cb6cd08, State: Initialized, Role: FOLLOWER
I20260809 05:27:42.630767 31410 consensus_queue.cc:260] T 00000000000000000000000000000000 P bfc04b1d4e0f45ff927524c07cb6cd08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfc04b1d4e0f45ff927524c07cb6cd08" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 45179 } }
I20260809 05:27:42.631089 31410 raft_consensus.cc:388] T 00000000000000000000000000000000 P bfc04b1d4e0f45ff927524c07cb6cd08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:27:42.631222 31410 raft_consensus.cc:482] T 00000000000000000000000000000000 P bfc04b1d4e0f45ff927524c07cb6cd08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:27:42.631379 31410 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bfc04b1d4e0f45ff927524c07cb6cd08 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:42.633890 31410 raft_consensus.cc:504] T 00000000000000000000000000000000 P bfc04b1d4e0f45ff927524c07cb6cd08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfc04b1d4e0f45ff927524c07cb6cd08" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 45179 } }
I20260809 05:27:42.634634 31410 leader_election.cc:302] T 00000000000000000000000000000000 P bfc04b1d4e0f45ff927524c07cb6cd08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bfc04b1d4e0f45ff927524c07cb6cd08; no voters:
I20260809 05:27:42.635383 31410 leader_election.cc:288] T 00000000000000000000000000000000 P bfc04b1d4e0f45ff927524c07cb6cd08 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:27:42.635561 31417 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bfc04b1d4e0f45ff927524c07cb6cd08 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:27:42.636722 31417 raft_consensus.cc:686] T 00000000000000000000000000000000 P bfc04b1d4e0f45ff927524c07cb6cd08 [term 1 LEADER]: Becoming Leader. State: Replica: bfc04b1d4e0f45ff927524c07cb6cd08, State: Running, Role: LEADER
I20260809 05:27:42.637275 31417 consensus_queue.cc:237] T 00000000000000000000000000000000 P bfc04b1d4e0f45ff927524c07cb6cd08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfc04b1d4e0f45ff927524c07cb6cd08" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 45179 } }
I20260809 05:27:42.637811 31410 sys_catalog.cc:564] T 00000000000000000000000000000000 P bfc04b1d4e0f45ff927524c07cb6cd08 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:27:42.640712 31419 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfc04b1d4e0f45ff927524c07cb6cd08 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bfc04b1d4e0f45ff927524c07cb6cd08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfc04b1d4e0f45ff927524c07cb6cd08" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 45179 } } }
I20260809 05:27:42.641184 31419 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfc04b1d4e0f45ff927524c07cb6cd08 [sys.catalog]: This master's current role is: LEADER
I20260809 05:27:42.641593 31421 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfc04b1d4e0f45ff927524c07cb6cd08 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bfc04b1d4e0f45ff927524c07cb6cd08. Latest consensus state: current_term: 1 leader_uuid: "bfc04b1d4e0f45ff927524c07cb6cd08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfc04b1d4e0f45ff927524c07cb6cd08" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 45179 } } }
I20260809 05:27:42.641892 31421 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfc04b1d4e0f45ff927524c07cb6cd08 [sys.catalog]: This master's current role is: LEADER
I20260809 05:27:42.642982 31436 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:27:42.649348 31436 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:27:42.660552 31436 catalog_manager.cc:1347] Generated new cluster ID: 07734c926e564f81b09af80ce511e757
I20260809 05:27:42.660882 31436 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:27:42.676626 31436 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:27:42.678134 31436 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:27:42.688885 31436 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bfc04b1d4e0f45ff927524c07cb6cd08: Generated new TSK 0
I20260809 05:27:42.690369 31436 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.185.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
I20260809 05:27:42.772320 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:0
--local_ip_for_outbound_sockets=127.26.185.1
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:45179
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:45217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:27:43.204409 31456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:27:43.204764 31456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:27:43.204934 31456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:27:43.212647 31456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:27:43.212791 31456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:27:43.213004 31456 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:27:43.223757 31456 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:45217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:45179
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:27:43.225502 31456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:27:43.227192 31456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:27:43.243170 31463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:43.243170 31464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:43.244007 31467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:43.244879 31456 server_base.cc:1034] running on GCE node
I20260809 05:27:43.245630 31456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:27:43.246788 31456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:27:43.248000 31456 hybrid_clock.cc:648] HybridClock initialized: now 1786253263247928 us; error 70 us; skew 500 ppm
I20260809 05:27:43.248413 31456 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:27:43 dist-test-slave-h3ft krb5kdc[31286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253263, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:27:43.252513 31456 init.cc:377] Logged in from keytab as kudu/127.26.185.1@KRBTEST.COM (short username kudu)
I20260809 05:27:43.254444 31456 webserver.cc:460] Webserver started at http://127.26.185.1:44131/ using document root <none> and password file <none>
I20260809 05:27:43.255406 31456 fs_manager.cc:359] Metadata directory not provided
I20260809 05:27:43.255553 31456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:27:43.255939 31456 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:27:43.259459 31456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/data/instance:
uuid: "e64d908c4f6c4afabba7a8f3e3ab988b"
format_stamp: "Formatted at 2026-08-09 05:27:43 on dist-test-slave-h3ft"
server_key: "364cc96c711ecb56fbac26ac15ddcc95"
server_key_iv: "e42f5bcea4597aa295a133774c82ef43"
server_key_version: "encryptionkey@0"
I20260809 05:27:43.260360 31456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance:
uuid: "e64d908c4f6c4afabba7a8f3e3ab988b"
format_stamp: "Formatted at 2026-08-09 05:27:43 on dist-test-slave-h3ft"
server_key: "364cc96c711ecb56fbac26ac15ddcc95"
server_key_iv: "e42f5bcea4597aa295a133774c82ef43"
server_key_version: "encryptionkey@0"
I20260809 05:27:43.266676 31456 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260809 05:27:43.270853 31479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:43.272446 31456 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 05:27:43.272670 31456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "e64d908c4f6c4afabba7a8f3e3ab988b"
format_stamp: "Formatted at 2026-08-09 05:27:43 on dist-test-slave-h3ft"
server_key: "364cc96c711ecb56fbac26ac15ddcc95"
server_key_iv: "e42f5bcea4597aa295a133774c82ef43"
server_key_version: "encryptionkey@0"
I20260809 05:27:43.272912 31456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:27:43.304288 31456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:27:43.309772 31456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:27:43.310156 31456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:27:43.311380 31456 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:27:43.313145 31456 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:27:43.313261 31456 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:43.313429 31456 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:27:43.313517 31456 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:43.355026 31456 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:44815
I20260809 05:27:43.355268 31659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:44815 every 8 connection(s)
I20260809 05:27:43.357188 31456 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:27:43.363540 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 31456
I20260809 05:27:43.363818 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance
I20260809 05:27:43.364836 27364 external_mini_cluster.cc:1428] Setting key 1c66e3465b34e17cd1860c863ff7e6bf
Aug 09 05:27:43 dist-test-slave-h3ft krb5kdc[31286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253263, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:43.387705 31666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:43.360607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:55981 (local address 127.26.185.62:45179)
0809 05:27:43.361218 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:43.361226 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:43.366283 (+ 5057us) server_negotiation.cc:407] Connection header received
0809 05:27:43.366361 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:43.366371 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:43.366525 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:43.366667 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:43.369519 (+ 2852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:43.370858 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:43.373646 (+ 2788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:43.374101 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:43.374216 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:43.379501 (+ 5285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:43.379513 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:43.379521 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:43.379580 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:43.383628 (+ 4048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:43.384548 (+ 920us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:43.384558 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:43.384564 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:43.384743 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:43.385211 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:43.385219 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:43.385225 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:43.385711 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:43.385878 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:43.386733 (+ 855us) server_negotiation.cc:299] Negotiation successful
0809 05:27:43.387144 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":283,"threads_started":1}
I20260809 05:27:43.388721 31670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:43.361484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:45179 (local address 127.26.185.1:55981)
0809 05:27:43.362692 (+ 1208us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:43.362756 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:43.365362 (+ 2606us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:43.367237 (+ 1875us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:43.367255 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:43.368226 (+ 971us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:27:43.369244 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:43.369281 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:43.371109 (+ 1828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:43.371117 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:43.373471 (+ 2354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:43.373493 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:43.374377 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:43.374388 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:43.374790 (+ 402us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:43.375713 (+ 923us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:27:43.375753 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:27:43.379186 (+ 3433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:27:43.383823 (+ 4637us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:43.383832 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:43.383852 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:43.384385 (+ 533us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:43.384859 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:43.384864 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:43.384866 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:43.385078 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:43.385837 (+ 759us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:27:43.385844 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:27:43.386280 (+ 436us) client_negotiation.cc:769] Sending connection context
0809 05:27:43.386568 (+ 288us) client_negotiation.cc:240] Negotiation successful
0809 05:27:43.387177 (+ 609us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":792,"thread_start_us":578,"threads_started":1}
I20260809 05:27:43.390808 31661 heartbeater.cc:347] Connected to a master server at 127.26.185.62:45179
I20260809 05:27:43.391283 31661 heartbeater.cc:464] Registering TS with master...
I20260809 05:27:43.392215 31661 heartbeater.cc:511] Master 127.26.185.62:45179 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.26.185.2@KRBTEST.COM; defaulting to no policy
I20260809 05:27:43.395262 31358 ts_manager.cc:194] Registered new tserver with Master: e64d908c4f6c4afabba7a8f3e3ab988b (127.26.185.1:44815)
I20260809 05:27:43.397119 31358 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.1@KRBTEST.COM'} at 127.26.185.1:55981
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
I20260809 05:27:43.431366 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:0
--local_ip_for_outbound_sockets=127.26.185.2
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:45179
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:45217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:27:43.853704 31674 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:27:43.854105 31674 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:27:43.854295 31674 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:27:43.862274 31674 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:27:43.862454 31674 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:27:43.862684 31674 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:27:43.873870 31674 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:45217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:45179
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:27:43.875749 31674 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:27:43.877642 31674 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:27:43.893642 31682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:43.893666 31684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:43.894358 31674 server_base.cc:1034] running on GCE node
W20260809 05:27:43.894505 31681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:43.895483 31674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:27:43.896711 31674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:27:43.898099 31674 hybrid_clock.cc:648] HybridClock initialized: now 1786253263897972 us; error 76 us; skew 500 ppm
I20260809 05:27:43.898520 31674 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:27:43 dist-test-slave-h3ft krb5kdc[31286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253263, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:27:43.902540 31674 init.cc:377] Logged in from keytab as kudu/127.26.185.2@KRBTEST.COM (short username kudu)
I20260809 05:27:43.904541 31674 webserver.cc:460] Webserver started at http://127.26.185.2:36493/ using document root <none> and password file <none>
I20260809 05:27:43.905522 31674 fs_manager.cc:359] Metadata directory not provided
I20260809 05:27:43.905689 31674 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:27:43.906096 31674 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:27:43.909948 31674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/data/instance:
uuid: "48ccea09c86747e9976e603117bfe247"
format_stamp: "Formatted at 2026-08-09 05:27:43 on dist-test-slave-h3ft"
server_key: "a2e9264bab1877ab8fb9ec1a38a51c71"
server_key_iv: "785148fbee47a665f74e3c9063727edc"
server_key_version: "encryptionkey@0"
I20260809 05:27:43.910924 31674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance:
uuid: "48ccea09c86747e9976e603117bfe247"
format_stamp: "Formatted at 2026-08-09 05:27:43 on dist-test-slave-h3ft"
server_key: "a2e9264bab1877ab8fb9ec1a38a51c71"
server_key_iv: "785148fbee47a665f74e3c9063727edc"
server_key_version: "encryptionkey@0"
I20260809 05:27:43.917393 31674 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260809 05:27:43.921613 31693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:43.923390 31674 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 05:27:43.923563 31674 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "48ccea09c86747e9976e603117bfe247"
format_stamp: "Formatted at 2026-08-09 05:27:43 on dist-test-slave-h3ft"
server_key: "a2e9264bab1877ab8fb9ec1a38a51c71"
server_key_iv: "785148fbee47a665f74e3c9063727edc"
server_key_version: "encryptionkey@0"
I20260809 05:27:43.923780 31674 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:27:43.940426 31674 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:27:43.945994 31674 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:27:43.946291 31674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:27:43.947496 31674 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:27:43.949158 31674 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:27:43.949246 31674 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:43.949342 31674 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:27:43.949391 31674 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:43.988130 31674 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:43325
I20260809 05:27:43.988171 31869 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:43325 every 8 connection(s)
I20260809 05:27:43.989760 31674 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:27:43.991446 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 31674
I20260809 05:27:43.991703 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance
I20260809 05:27:43.992369 27364 external_mini_cluster.cc:1428] Setting key 88c30c6181325d81a593c630128f365b
Aug 09 05:27:44 dist-test-slave-h3ft krb5kdc[31286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253263, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:44.015564 31873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:43.993308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:46111 (local address 127.26.185.62:45179)
0809 05:27:43.993960 (+ 652us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:43.993967 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:43.995367 (+ 1400us) server_negotiation.cc:407] Connection header received
0809 05:27:43.997487 (+ 2120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:43.997494 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:43.997613 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:43.997747 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:43.999742 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:44.000578 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:44.002283 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:44.002791 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:44.002940 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:44.007157 (+ 4217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:44.007167 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:44.007176 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:44.007229 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:44.011515 (+ 4286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:44.012422 (+ 907us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:44.012431 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:44.012438 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:44.012643 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:44.013130 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:44.013138 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:44.013145 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:44.013604 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:44.013771 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:44.014660 (+ 889us) server_negotiation.cc:299] Negotiation successful
0809 05:27:44.014960 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":307,"threads_started":1}
I20260809 05:27:44.016539 31875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:43.994125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:45179 (local address 127.26.185.2:46111)
0809 05:27:43.995175 (+ 1050us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:43.995234 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:43.997173 (+ 1939us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:43.998049 (+ 876us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:43.998060 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:43.998709 (+ 649us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:27:43.999541 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:43.999567 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:44.000743 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:44.000750 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:44.002123 (+ 1373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:44.002136 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:44.003080 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:44.003089 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:44.003357 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:44.004239 (+ 882us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:27:44.004267 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:27:44.006838 (+ 2571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:27:44.011702 (+ 4864us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:44.011711 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:44.011729 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:44.012262 (+ 533us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:44.012759 (+ 497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:44.012762 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:44.012764 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:44.013001 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:44.013742 (+ 741us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:27:44.013750 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:27:44.014214 (+ 464us) client_negotiation.cc:769] Sending connection context
0809 05:27:44.014483 (+ 269us) client_negotiation.cc:240] Negotiation successful
0809 05:27:44.014994 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":669,"thread_start_us":383,"threads_started":1}
I20260809 05:27:44.018627 31870 heartbeater.cc:347] Connected to a master server at 127.26.185.62:45179
I20260809 05:27:44.019151 31870 heartbeater.cc:464] Registering TS with master...
I20260809 05:27:44.020385 31870 heartbeater.cc:511] Master 127.26.185.62:45179 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.26.185.3@KRBTEST.COM; defaulting to no policy
I20260809 05:27:44.022570 31358 ts_manager.cc:194] Registered new tserver with Master: 48ccea09c86747e9976e603117bfe247 (127.26.185.2:43325)
I20260809 05:27:44.023684 31358 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.2@KRBTEST.COM'} at 127.26.185.2:46111
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
I20260809 05:27:44.060581 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:0
--local_ip_for_outbound_sockets=127.26.185.3
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:45179
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:45217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:27:44.401144 31661 heartbeater.cc:503] Master 127.26.185.62:45179 was elected leader, sending a full tablet report...
W20260809 05:27:44.479943 31878 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:27:44.480429 31878 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:27:44.480624 31878 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:27:44.488899 31878 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:27:44.489104 31878 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:27:44.489320 31878 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:27:44.500698 31878 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:45217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:45179
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:27:44.502717 31878 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:27:44.504493 31878 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:27:44.520648 31887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:44.520779 31888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:44.520749 31892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:44.522013 31878 server_base.cc:1034] running on GCE node
I20260809 05:27:44.522830 31878 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:27:44.524114 31878 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:27:44.525369 31878 hybrid_clock.cc:648] HybridClock initialized: now 1786253264525314 us; error 56 us; skew 500 ppm
I20260809 05:27:44.525767 31878 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:27:44 dist-test-slave-h3ft krb5kdc[31286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253264, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:27:44.529839 31878 init.cc:377] Logged in from keytab as kudu/127.26.185.3@KRBTEST.COM (short username kudu)
I20260809 05:27:44.531751 31878 webserver.cc:460] Webserver started at http://127.26.185.3:36941/ using document root <none> and password file <none>
I20260809 05:27:44.532688 31878 fs_manager.cc:359] Metadata directory not provided
I20260809 05:27:44.532851 31878 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:27:44.533281 31878 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:27:44.537132 31878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/data/instance:
uuid: "db5abb4223544d0f906039af92fbd6af"
format_stamp: "Formatted at 2026-08-09 05:27:44 on dist-test-slave-h3ft"
server_key: "974fcd5d503682dbf7be93fc796685b1"
server_key_iv: "6d018b2335b0ff5ab9d0e4bb26c5455d"
server_key_version: "encryptionkey@0"
I20260809 05:27:44.538079 31878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance:
uuid: "db5abb4223544d0f906039af92fbd6af"
format_stamp: "Formatted at 2026-08-09 05:27:44 on dist-test-slave-h3ft"
server_key: "974fcd5d503682dbf7be93fc796685b1"
server_key_iv: "6d018b2335b0ff5ab9d0e4bb26c5455d"
server_key_version: "encryptionkey@0"
I20260809 05:27:44.544740 31878 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260809 05:27:44.548830 31901 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:44.550414 31878 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 05:27:44.550621 31878 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "db5abb4223544d0f906039af92fbd6af"
format_stamp: "Formatted at 2026-08-09 05:27:44 on dist-test-slave-h3ft"
server_key: "974fcd5d503682dbf7be93fc796685b1"
server_key_iv: "6d018b2335b0ff5ab9d0e4bb26c5455d"
server_key_version: "encryptionkey@0"
I20260809 05:27:44.550865 31878 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:27:44.568115 31878 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:27:44.573232 31878 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:27:44.573577 31878 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:27:44.574899 31878 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:27:44.576560 31878 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:27:44.576673 31878 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:44.576851 31878 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:27:44.576934 31878 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:44.615883 31878 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:38477
I20260809 05:27:44.615923 32071 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:38477 every 8 connection(s)
I20260809 05:27:44.617496 31878 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:27:44.624146 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 31878
I20260809 05:27:44.624387 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance
I20260809 05:27:44.624907 27364 external_mini_cluster.cc:1428] Setting key bd65e7777a1ca8f1dd94b9d6534caf9b
Aug 09 05:27:44 dist-test-slave-h3ft krb5kdc[31286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253264, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:44.641263 32074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:44.620754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:51509 (local address 127.26.185.62:45179)
0809 05:27:44.621349 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:44.621354 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:44.622428 (+ 1074us) server_negotiation.cc:407] Connection header received
0809 05:27:44.624762 (+ 2334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:44.624769 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:44.624880 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:44.625023 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:44.627228 (+ 2205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:44.628267 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:44.630025 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:44.630475 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:44.630591 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:44.634527 (+ 3936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:44.634537 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:44.634540 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:44.634602 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:44.637326 (+ 2724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:44.638118 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:44.638124 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:44.638128 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:44.638273 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:44.638835 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:44.638847 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:44.638849 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:44.639278 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:44.639447 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:44.640488 (+ 1041us) server_negotiation.cc:299] Negotiation successful
0809 05:27:44.640741 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":457,"thread_start_us":301,"threads_started":1}
I20260809 05:27:44.642573 32076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:44.621374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:45179 (local address 127.26.185.3:51509)
0809 05:27:44.622222 (+ 848us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:44.622268 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:44.624383 (+ 2115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:44.625313 (+ 930us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:44.625324 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:44.626118 (+ 794us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:27:44.626931 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:44.626952 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:44.628454 (+ 1502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:44.628459 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:44.629854 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:44.629867 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:44.630698 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:44.630703 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:44.630921 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:44.631760 (+ 839us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:27:44.631786 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:27:44.634268 (+ 2482us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:27:44.637477 (+ 3209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:44.637490 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:44.637510 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:44.637984 (+ 474us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:44.638388 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:44.638393 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:44.638397 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:44.638697 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:44.639459 (+ 762us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:27:44.639470 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:27:44.640036 (+ 566us) client_negotiation.cc:769] Sending connection context
0809 05:27:44.640379 (+ 343us) client_negotiation.cc:240] Negotiation successful
0809 05:27:44.641028 (+ 649us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":326,"threads_started":1}
I20260809 05:27:44.644102 32072 heartbeater.cc:347] Connected to a master server at 127.26.185.62:45179
I20260809 05:27:44.644459 32072 heartbeater.cc:464] Registering TS with master...
I20260809 05:27:44.645293 32072 heartbeater.cc:511] Master 127.26.185.62:45179 requested a full tablet report, sending...
I20260809 05:27:44.646911 31358 ts_manager.cc:194] Registered new tserver with Master: db5abb4223544d0f906039af92fbd6af (127.26.185.3:38477)
I20260809 05:27:44.647941 31358 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.3@KRBTEST.COM'} at 127.26.185.3:51509
I20260809 05:27:44.653999 27364 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 05:27:44.699479 32074 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:27:44.696221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49376 (local address 127.26.185.62:45179)
0809 05:27:44.696560 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:44.696569 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:44.697028 (+ 459us) server_negotiation.cc:407] Connection header received
0809 05:27:44.697212 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:44.697217 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:44.697339 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:44.697453 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:44.699134 (+ 1681us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49376: BlockingRecv error: recv got EOF from 127.0.0.1:49376 (error 108)
Metrics: {"server-negotiator.queue_time_us":102}
I20260809 05:27:44.702894 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 31456
W20260809 05:27:44.706521 27364 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 31456: Not authorized: Client connection negotiation failed: client connection to 127.26.185.1:44815: server requires authentication, but client does not have Kerberos credentials available
I20260809 05:27:44.706758 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 31456
I20260809 05:27:44.736708 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 31674
W20260809 05:27:44.740585 27364 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 31674: Not authorized: Client connection negotiation failed: client connection to 127.26.185.2:43325: server requires authentication, but client does not have Kerberos credentials available
I20260809 05:27:44.740839 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 31674
W20260809 05:27:44.741042 32095 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:27:44.738065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59652 (local address 127.26.185.2:43325)
0809 05:27:44.738804 (+ 739us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:44.738813 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:44.738847 (+ 34us) server_negotiation.cc:407] Connection header received
0809 05:27:44.739021 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:44.739035 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:44.739426 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:44.739600 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:44.740602 (+ 1002us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59652: BlockingRecv error: recv got EOF from 127.0.0.1:59652 (error 108)
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":400,"threads_started":1}
I20260809 05:27:44.766543 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 31878
W20260809 05:27:44.770407 27364 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 31878: Not authorized: Client connection negotiation failed: client connection to 127.26.185.3:38477: server requires authentication, but client does not have Kerberos credentials available
I20260809 05:27:44.770593 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 31878
I20260809 05:27:44.803085 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 31309
I20260809 05:27:44.804854 31402 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:27:44.926406 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 31309
2026-08-09T05:27:44Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (4523 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:27:45 dist-test-slave-h3ft krb5kdc[32102](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:27:45 dist-test-slave-h3ft krb5kdc[32102](info): set up 2 sockets
Aug 09 05:27:45 dist-test-slave-h3ft krb5kdc[32102](info): commencing operation
krb5kdc: starting...
W20260809 05:27:46.309065 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.323s user 0.000s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:27:46 dist-test-slave-h3ft krb5kdc[32102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253266, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:27:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:27:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
I20260809 05:27:46.583436 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:35179
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:38057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:35179
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:27:46.999971 32129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:27:47.000412 32129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:27:47.000664 32129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:27:47.009104 32129 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:27:47.009274 32129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:27:47.009393 32129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:27:47.009521 32129 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:27:47.009615 32129 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:27:47.021883 32129 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:38057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:35179
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:35179
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:27:47.023838 32129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:27:47.025578 32129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:27:47.040740 32138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:47.040789 32139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:47.041034 32141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:47.042273 32129 server_base.cc:1034] running on GCE node
I20260809 05:27:47.043437 32129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:27:47.045334 32129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:27:47.046605 32129 hybrid_clock.cc:648] HybridClock initialized: now 1786253267046530 us; error 72 us; skew 500 ppm
I20260809 05:27:47.047107 32129 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:27:47 dist-test-slave-h3ft krb5kdc[32102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253267, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:27:47.051177 32129 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:27:47.053125 32129 webserver.cc:460] Webserver started at http://127.26.185.62:44237/ using document root <none> and password file <none>
I20260809 05:27:47.054059 32129 fs_manager.cc:359] Metadata directory not provided
I20260809 05:27:47.054227 32129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:27:47.054636 32129 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:27:47.058559 32129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "6596d78bc93f4ab0acd5973887063c7e"
format_stamp: "Formatted at 2026-08-09 05:27:47 on dist-test-slave-h3ft"
server_key: "c0139bcc53e827c11b86794634d65bd4"
server_key_iv: "0b84ddb33c4567c9056d8a3aa81c7999"
server_key_version: "encryptionkey@0"
I20260809 05:27:47.059568 32129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "6596d78bc93f4ab0acd5973887063c7e"
format_stamp: "Formatted at 2026-08-09 05:27:47 on dist-test-slave-h3ft"
server_key: "c0139bcc53e827c11b86794634d65bd4"
server_key_iv: "0b84ddb33c4567c9056d8a3aa81c7999"
server_key_version: "encryptionkey@0"
I20260809 05:27:47.066066 32129 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260809 05:27:47.070408 32155 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:47.072216 32129 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:27:47.072459 32129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "6596d78bc93f4ab0acd5973887063c7e"
format_stamp: "Formatted at 2026-08-09 05:27:47 on dist-test-slave-h3ft"
server_key: "c0139bcc53e827c11b86794634d65bd4"
server_key_iv: "0b84ddb33c4567c9056d8a3aa81c7999"
server_key_version: "encryptionkey@0"
I20260809 05:27:47.072724 32129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:27:47.098311 32129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:27:47.104434 32129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:27:47.104889 32129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:27:47.129395 32129 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:35179
I20260809 05:27:47.129420 32234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:35179 every 8 connection(s)
I20260809 05:27:47.131466 32129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:27:47.134781 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 32129
I20260809 05:27:47.135208 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:27:47.136227 27364 external_mini_cluster.cc:1428] Setting key ea39b1e679c20deb31ac536c1efc71fe
I20260809 05:27:47.137974 32235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 05:27:47 dist-test-slave-h3ft krb5kdc[32102](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253266, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:47.156247 32235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6596d78bc93f4ab0acd5973887063c7e: Bootstrap starting.
I20260809 05:27:47.160975 32235 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6596d78bc93f4ab0acd5973887063c7e: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:47.162395 32235 log.cc:824] T 00000000000000000000000000000000 P 6596d78bc93f4ab0acd5973887063c7e: Log is configured to *not* fsync() on all Append() calls
I20260809 05:27:47.164673 32240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:47.138794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46072 (local address 127.26.185.62:35179)
0809 05:27:47.139919 (+ 1125us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:47.139934 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:47.139990 (+ 56us) server_negotiation.cc:407] Connection header received
0809 05:27:47.142065 (+ 2075us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:47.142099 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:47.142656 (+ 557us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:47.143228 (+ 572us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:47.145575 (+ 2347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:47.147411 (+ 1836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:47.149457 (+ 2046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:47.150256 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:47.150433 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:47.156127 (+ 5694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:47.156138 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:47.156158 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:47.156203 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:47.159776 (+ 3573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:47.160548 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:47.160561 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:47.160569 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:47.160764 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:47.161223 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:47.161229 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:47.161232 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:47.161906 (+ 674us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:47.162256 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:47.162825 (+ 569us) server_negotiation.cc:299] Negotiation successful
0809 05:27:47.163442 (+ 617us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":839,"thread_start_us":572,"threads_started":1}
I20260809 05:27:47.166174 32235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6596d78bc93f4ab0acd5973887063c7e: No bootstrap required, opened a new log
I20260809 05:27:47.169577 27364 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 05:27:47.175705 32235 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6596d78bc93f4ab0acd5973887063c7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6596d78bc93f4ab0acd5973887063c7e" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 35179 } }
I20260809 05:27:47.176214 32235 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6596d78bc93f4ab0acd5973887063c7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:47.176342 32235 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6596d78bc93f4ab0acd5973887063c7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6596d78bc93f4ab0acd5973887063c7e, State: Initialized, Role: FOLLOWER
I20260809 05:27:47.177111 32235 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6596d78bc93f4ab0acd5973887063c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6596d78bc93f4ab0acd5973887063c7e" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 35179 } }
I20260809 05:27:47.177414 32235 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6596d78bc93f4ab0acd5973887063c7e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:27:47.177603 32235 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6596d78bc93f4ab0acd5973887063c7e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:27:47.177861 32235 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6596d78bc93f4ab0acd5973887063c7e [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:47.180649 32235 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6596d78bc93f4ab0acd5973887063c7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6596d78bc93f4ab0acd5973887063c7e" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 35179 } }
I20260809 05:27:47.181311 32235 leader_election.cc:302] T 00000000000000000000000000000000 P 6596d78bc93f4ab0acd5973887063c7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6596d78bc93f4ab0acd5973887063c7e; no voters:
I20260809 05:27:47.182142 32235 leader_election.cc:288] T 00000000000000000000000000000000 P 6596d78bc93f4ab0acd5973887063c7e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:27:47.182287 32249 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6596d78bc93f4ab0acd5973887063c7e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:27:47.185628 32235 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6596d78bc93f4ab0acd5973887063c7e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:27:47.186128 32249 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6596d78bc93f4ab0acd5973887063c7e [term 1 LEADER]: Becoming Leader. State: Replica: 6596d78bc93f4ab0acd5973887063c7e, State: Running, Role: LEADER
I20260809 05:27:47.187078 32249 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6596d78bc93f4ab0acd5973887063c7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6596d78bc93f4ab0acd5973887063c7e" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 35179 } }
I20260809 05:27:47.191352 32256 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6596d78bc93f4ab0acd5973887063c7e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6596d78bc93f4ab0acd5973887063c7e. Latest consensus state: current_term: 1 leader_uuid: "6596d78bc93f4ab0acd5973887063c7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6596d78bc93f4ab0acd5973887063c7e" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 35179 } } }
I20260809 05:27:47.191979 32256 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6596d78bc93f4ab0acd5973887063c7e [sys.catalog]: This master's current role is: LEADER
I20260809 05:27:47.191807 32255 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6596d78bc93f4ab0acd5973887063c7e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6596d78bc93f4ab0acd5973887063c7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6596d78bc93f4ab0acd5973887063c7e" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 35179 } } }
I20260809 05:27:47.192147 32255 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6596d78bc93f4ab0acd5973887063c7e [sys.catalog]: This master's current role is: LEADER
I20260809 05:27:47.206730 32268 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:27:47.213953 32268 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:27:47.230476 32268 catalog_manager.cc:1347] Generated new cluster ID: aa87b5967f284b139246f4c0b12ab232
I20260809 05:27:47.230728 32268 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:27:47.247810 32268 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:27:47.249825 32268 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:27:47.254062 32240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:47.241990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46080 (local address 127.26.185.62:35179)
0809 05:27:47.242286 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:47.242297 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:47.243061 (+ 764us) server_negotiation.cc:407] Connection header received
0809 05:27:47.243353 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:47.243364 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:47.243456 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:47.243595 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:47.245062 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:47.246528 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:47.248727 (+ 2199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:47.249605 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:47.249778 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:47.251548 (+ 1770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:47.251556 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:47.251563 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:27:47.252827 (+ 1264us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:47.252904 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:27:47.252953 (+ 49us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:47.253101 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:47.253305 (+ 204us) server_negotiation.cc:299] Negotiation successful
0809 05:27:47.253496 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":99}
I20260809 05:27:47.259151 32268 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6596d78bc93f4ab0acd5973887063c7e: Generated new TSK 0
I20260809 05:27:47.260362 32268 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 05:27:47.272665 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 32129
I20260809 05:27:47.274415 32229 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:27:47.376168 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 32129
2026-08-09T05:27:47Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2441 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:27:47 dist-test-slave-h3ft krb5kdc[32299](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:27:47 dist-test-slave-h3ft krb5kdc[32299](info): set up 2 sockets
Aug 09 05:27:47 dist-test-slave-h3ft krb5kdc[32299](info): commencing operation
krb5kdc: starting...
W20260809 05:27:48.757583 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.331s user 0.006s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:27:48 dist-test-slave-h3ft krb5kdc[32299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253268, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:27:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:27:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
I20260809 05:27:49.048870 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:34413
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:34629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:34413
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:27:49.461365 32324 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:27:49.461748 32324 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:27:49.461917 32324 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:27:49.469731 32324 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:27:49.469928 32324 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:27:49.470052 32324 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:27:49.470157 32324 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:27:49.470244 32324 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:27:49.481242 32324 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:34629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:34413
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:34413
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:27:49.483120 32324 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:27:49.484812 32324 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:27:49.499085 32335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:49.499056 32336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:49.498963 32339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:49.500478 32324 server_base.cc:1034] running on GCE node
I20260809 05:27:49.501595 32324 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:27:49.503439 32324 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:27:49.504663 32324 hybrid_clock.cc:648] HybridClock initialized: now 1786253269504607 us; error 37 us; skew 500 ppm
I20260809 05:27:49.505136 32324 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:27:49 dist-test-slave-h3ft krb5kdc[32299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253269, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:27:49.508759 32324 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:27:49.510588 32324 webserver.cc:460] Webserver started at http://127.26.185.62:33805/ using document root <none> and password file <none>
I20260809 05:27:49.511528 32324 fs_manager.cc:359] Metadata directory not provided
I20260809 05:27:49.511688 32324 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:27:49.512058 32324 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:27:49.515931 32324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "2c3e79661df847f58c0fae1f097a79de"
format_stamp: "Formatted at 2026-08-09 05:27:49 on dist-test-slave-h3ft"
server_key: "b59146bc85f79c6cfc13bd9be4e33892"
server_key_iv: "3160a7f7634481d66ed1e11cbe934add"
server_key_version: "encryptionkey@0"
I20260809 05:27:49.516889 32324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "2c3e79661df847f58c0fae1f097a79de"
format_stamp: "Formatted at 2026-08-09 05:27:49 on dist-test-slave-h3ft"
server_key: "b59146bc85f79c6cfc13bd9be4e33892"
server_key_iv: "3160a7f7634481d66ed1e11cbe934add"
server_key_version: "encryptionkey@0"
I20260809 05:27:49.523782 32324 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260809 05:27:49.528159 32352 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:49.529922 32324 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260809 05:27:49.530098 32324 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "2c3e79661df847f58c0fae1f097a79de"
format_stamp: "Formatted at 2026-08-09 05:27:49 on dist-test-slave-h3ft"
server_key: "b59146bc85f79c6cfc13bd9be4e33892"
server_key_iv: "3160a7f7634481d66ed1e11cbe934add"
server_key_version: "encryptionkey@0"
I20260809 05:27:49.530303 32324 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:27:49.553071 32324 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:27:49.557790 32324 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:27:49.558092 32324 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:27:49.579514 32324 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:34413
I20260809 05:27:49.579553 32435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:34413 every 8 connection(s)
I20260809 05:27:49.581260 32324 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:27:49.585956 32437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:49.589296 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 32324
I20260809 05:27:49.589560 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:27:49.590483 27364 external_mini_cluster.cc:1428] Setting key 9fbb6c96afddb646d63997b1cec912b8
I20260809 05:27:49.600826 32437 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c3e79661df847f58c0fae1f097a79de: Bootstrap starting.
I20260809 05:27:49.605576 32437 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2c3e79661df847f58c0fae1f097a79de: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:49.607343 32437 log.cc:824] T 00000000000000000000000000000000 P 2c3e79661df847f58c0fae1f097a79de: Log is configured to *not* fsync() on all Append() calls
Aug 09 05:27:49 dist-test-slave-h3ft krb5kdc[32299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253268, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:49.612118 32437 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c3e79661df847f58c0fae1f097a79de: No bootstrap required, opened a new log
I20260809 05:27:49.619376 32441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:49.593294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38628 (local address 127.26.185.62:34413)
0809 05:27:49.594242 (+ 948us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:49.594257 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:49.594312 (+ 55us) server_negotiation.cc:407] Connection header received
0809 05:27:49.596223 (+ 1911us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:49.596253 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:49.596756 (+ 503us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:49.597149 (+ 393us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:49.599155 (+ 2006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:49.600570 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:49.602383 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:49.603211 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:49.603361 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:49.609290 (+ 5929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:49.609304 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:49.609331 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:49.609381 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:49.613779 (+ 4398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:49.614670 (+ 891us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:49.614681 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:49.614692 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:49.614935 (+ 243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:49.615357 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:49.615367 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:49.615372 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:49.616256 (+ 884us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:49.616630 (+ 374us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:49.617005 (+ 375us) server_negotiation.cc:299] Negotiation successful
0809 05:27:49.617591 (+ 586us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":702,"thread_start_us":454,"threads_started":1}
I20260809 05:27:49.623143 32437 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2c3e79661df847f58c0fae1f097a79de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c3e79661df847f58c0fae1f097a79de" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 34413 } }
I20260809 05:27:49.623606 32437 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2c3e79661df847f58c0fae1f097a79de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:49.623721 32437 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2c3e79661df847f58c0fae1f097a79de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3e79661df847f58c0fae1f097a79de, State: Initialized, Role: FOLLOWER
I20260809 05:27:49.624382 32437 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c3e79661df847f58c0fae1f097a79de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c3e79661df847f58c0fae1f097a79de" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 34413 } }
I20260809 05:27:49.624647 32437 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2c3e79661df847f58c0fae1f097a79de [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:27:49.624795 32437 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2c3e79661df847f58c0fae1f097a79de [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:27:49.624989 32437 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2c3e79661df847f58c0fae1f097a79de [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:49.627655 32437 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2c3e79661df847f58c0fae1f097a79de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c3e79661df847f58c0fae1f097a79de" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 34413 } }
I20260809 05:27:49.628268 32437 leader_election.cc:302] T 00000000000000000000000000000000 P 2c3e79661df847f58c0fae1f097a79de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2c3e79661df847f58c0fae1f097a79de; no voters:
I20260809 05:27:49.629004 32437 leader_election.cc:288] T 00000000000000000000000000000000 P 2c3e79661df847f58c0fae1f097a79de [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:27:49.629226 32446 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2c3e79661df847f58c0fae1f097a79de [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:27:49.630513 32446 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2c3e79661df847f58c0fae1f097a79de [term 1 LEADER]: Becoming Leader. State: Replica: 2c3e79661df847f58c0fae1f097a79de, State: Running, Role: LEADER
I20260809 05:27:49.631263 32446 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2c3e79661df847f58c0fae1f097a79de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c3e79661df847f58c0fae1f097a79de" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 34413 } }
I20260809 05:27:49.631783 32437 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2c3e79661df847f58c0fae1f097a79de [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:27:49.634545 32450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c3e79661df847f58c0fae1f097a79de [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c3e79661df847f58c0fae1f097a79de. Latest consensus state: current_term: 1 leader_uuid: "2c3e79661df847f58c0fae1f097a79de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c3e79661df847f58c0fae1f097a79de" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 34413 } } }
I20260809 05:27:49.634954 32450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c3e79661df847f58c0fae1f097a79de [sys.catalog]: This master's current role is: LEADER
I20260809 05:27:49.634632 32449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c3e79661df847f58c0fae1f097a79de [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2c3e79661df847f58c0fae1f097a79de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c3e79661df847f58c0fae1f097a79de" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 34413 } } }
I20260809 05:27:49.635178 32449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c3e79661df847f58c0fae1f097a79de [sys.catalog]: This master's current role is: LEADER
I20260809 05:27:49.636229 32458 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:27:49.642709 32458 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:27:49.652639 32458 catalog_manager.cc:1347] Generated new cluster ID: 7ee3156223314bbe8bebeba1ee1c769f
I20260809 05:27:49.652786 32458 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:27:49.665688 32458 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:27:49.667989 32458 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:27:49.693606 32458 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2c3e79661df847f58c0fae1f097a79de: Generated new TSK 0
I20260809 05:27:49.695034 32458 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.185.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
I20260809 05:27:49.773622 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:0
--local_ip_for_outbound_sockets=127.26.185.1
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:34413
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:34629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:27:50.199301 32483 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:27:50.199692 32483 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:27:50.199882 32483 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:27:50.207795 32483 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:27:50.207926 32483 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:27:50.208146 32483 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:27:50.220444 32483 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:34629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:34413
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:27:50.222322 32483 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:27:50.224159 32483 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:27:50.240136 32494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:50.240176 32499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:50.240231 32496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:50.244870 32483 server_base.cc:1034] running on GCE node
I20260809 05:27:50.245803 32483 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:27:50.247195 32483 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:27:50.248442 32483 hybrid_clock.cc:648] HybridClock initialized: now 1786253270248369 us; error 72 us; skew 500 ppm
I20260809 05:27:50.248842 32483 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:27:50 dist-test-slave-h3ft krb5kdc[32299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253270, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:27:50.253026 32483 init.cc:377] Logged in from keytab as kudu/127.26.185.1@KRBTEST.COM (short username kudu)
I20260809 05:27:50.255306 32483 webserver.cc:460] Webserver started at http://127.26.185.1:44317/ using document root <none> and password file <none>
I20260809 05:27:50.256330 32483 fs_manager.cc:359] Metadata directory not provided
I20260809 05:27:50.256494 32483 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:27:50.256901 32483 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:27:50.260691 32483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/data/instance:
uuid: "e2c0025976d5400eadc58719dfe53187"
format_stamp: "Formatted at 2026-08-09 05:27:50 on dist-test-slave-h3ft"
server_key: "1f8f8d239d3de4cd30381aeaef4ad96e"
server_key_iv: "29c7b3b9a7eb1ff28c00fed1ecbe816c"
server_key_version: "encryptionkey@0"
I20260809 05:27:50.261641 32483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance:
uuid: "e2c0025976d5400eadc58719dfe53187"
format_stamp: "Formatted at 2026-08-09 05:27:50 on dist-test-slave-h3ft"
server_key: "1f8f8d239d3de4cd30381aeaef4ad96e"
server_key_iv: "29c7b3b9a7eb1ff28c00fed1ecbe816c"
server_key_version: "encryptionkey@0"
I20260809 05:27:50.268424 32483 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260809 05:27:50.272797 32508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:50.274541 32483 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.004s
I20260809 05:27:50.274768 32483 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "e2c0025976d5400eadc58719dfe53187"
format_stamp: "Formatted at 2026-08-09 05:27:50 on dist-test-slave-h3ft"
server_key: "1f8f8d239d3de4cd30381aeaef4ad96e"
server_key_iv: "29c7b3b9a7eb1ff28c00fed1ecbe816c"
server_key_version: "encryptionkey@0"
I20260809 05:27:50.274992 32483 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:27:50.306908 32483 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:27:50.312529 32483 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:27:50.312917 32483 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:27:50.314150 32483 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:27:50.315979 32483 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:27:50.316064 32483 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:50.316247 32483 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:27:50.316339 32483 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:50.355125 32483 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:39023
I20260809 05:27:50.355177 32685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:39023 every 8 connection(s)
I20260809 05:27:50.356923 32483 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:27:50.367185 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 32483
I20260809 05:27:50.367432 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance
I20260809 05:27:50.368216 27364 external_mini_cluster.cc:1428] Setting key 35a5a709b717cee71a1230c0c560f344
Aug 09 05:27:50 dist-test-slave-h3ft krb5kdc[32299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253270, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:50.382247 32689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:50.360121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:44831 (local address 127.26.185.62:34413)
0809 05:27:50.360679 (+ 558us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:50.360684 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:50.361835 (+ 1151us) server_negotiation.cc:407] Connection header received
0809 05:27:50.364003 (+ 2168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:50.364010 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:50.364138 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:50.364275 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:50.366017 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:50.366901 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:50.368806 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:50.369233 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:50.369385 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:50.374132 (+ 4747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:50.374141 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:50.374149 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:50.374200 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:50.377921 (+ 3721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:50.378980 (+ 1059us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:50.378987 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:50.378993 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:50.379183 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:50.379762 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:50.379769 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:50.379774 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:50.380203 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:50.380360 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:50.381535 (+ 1175us) server_negotiation.cc:299] Negotiation successful
0809 05:27:50.381814 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":257,"threads_started":1}
I20260809 05:27:50.383615 32692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:50.360826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:34413 (local address 127.26.185.1:44831)
0809 05:27:50.361637 (+ 811us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:50.361692 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:50.363693 (+ 2001us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:50.364551 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:50.364567 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:50.365156 (+ 589us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:27:50.365834 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:50.365854 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:50.367098 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:50.367104 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:50.368647 (+ 1543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:50.368661 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:50.369489 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:50.369497 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:50.369795 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:50.370591 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:27:50.370618 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:27:50.373844 (+ 3226us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:27:50.378104 (+ 4260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:50.378118 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:50.378143 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:50.378866 (+ 723us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:50.379305 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:50.379313 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:50.379319 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:50.379640 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:50.380450 (+ 810us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:27:50.380464 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:27:50.381082 (+ 618us) client_negotiation.cc:769] Sending connection context
0809 05:27:50.381415 (+ 333us) client_negotiation.cc:240] Negotiation successful
0809 05:27:50.382089 (+ 674us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":307,"threads_started":1}
I20260809 05:27:50.385703 32686 heartbeater.cc:347] Connected to a master server at 127.26.185.62:34413
I20260809 05:27:50.386101 32686 heartbeater.cc:464] Registering TS with master...
I20260809 05:27:50.387053 32686 heartbeater.cc:511] Master 127.26.185.62:34413 requested a full tablet report, sending...
I20260809 05:27:50.389948 32381 ts_manager.cc:194] Registered new tserver with Master: e2c0025976d5400eadc58719dfe53187 (127.26.185.1:39023)
I20260809 05:27:50.392648 32381 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.1@KRBTEST.COM'} at 127.26.185.1:44831
WARNING: no policy specified for kudu/127.26.185.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
I20260809 05:27:50.435185 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:0
--local_ip_for_outbound_sockets=127.26.185.2
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:34413
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:34629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:27:50.861418 32698 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:27:50.861821 32698 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:27:50.861931 32698 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:27:50.870103 32698 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:27:50.870257 32698 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:27:50.870391 32698 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:27:50.881903 32698 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:34629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:34413
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:27:50.883778 32698 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:27:50.885579 32698 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:27:50.901371 32712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:50.901324 32708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:50.901638 32715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:50.902472 32698 server_base.cc:1034] running on GCE node
I20260809 05:27:50.903374 32698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:27:50.904609 32698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:27:50.905855 32698 hybrid_clock.cc:648] HybridClock initialized: now 1786253270905786 us; error 70 us; skew 500 ppm
I20260809 05:27:50.906247 32698 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:27:50 dist-test-slave-h3ft krb5kdc[32299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253270, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:27:50.914624 32698 init.cc:377] Logged in from keytab as kudu/127.26.185.2@KRBTEST.COM (short username kudu)
I20260809 05:27:50.916719 32698 webserver.cc:460] Webserver started at http://127.26.185.2:44155/ using document root <none> and password file <none>
I20260809 05:27:50.917708 32698 fs_manager.cc:359] Metadata directory not provided
I20260809 05:27:50.917876 32698 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:27:50.918278 32698 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:27:50.922111 32698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/data/instance:
uuid: "08a3919a94d742c8b69eb53efd2ecc48"
format_stamp: "Formatted at 2026-08-09 05:27:50 on dist-test-slave-h3ft"
server_key: "ec8625fce05dc9c18a0fb345341bf844"
server_key_iv: "ac39001f44ac2f74f419e15dbfe8f0c2"
server_key_version: "encryptionkey@0"
I20260809 05:27:50.923132 32698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance:
uuid: "08a3919a94d742c8b69eb53efd2ecc48"
format_stamp: "Formatted at 2026-08-09 05:27:50 on dist-test-slave-h3ft"
server_key: "ec8625fce05dc9c18a0fb345341bf844"
server_key_iv: "ac39001f44ac2f74f419e15dbfe8f0c2"
server_key_version: "encryptionkey@0"
I20260809 05:27:50.929461 32698 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260809 05:27:50.934136 32727 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:50.936146 32698 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260809 05:27:50.936365 32698 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "08a3919a94d742c8b69eb53efd2ecc48"
format_stamp: "Formatted at 2026-08-09 05:27:50 on dist-test-slave-h3ft"
server_key: "ec8625fce05dc9c18a0fb345341bf844"
server_key_iv: "ac39001f44ac2f74f419e15dbfe8f0c2"
server_key_version: "encryptionkey@0"
I20260809 05:27:50.936650 32698 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:27:50.961582 32698 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:27:50.966782 32698 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:27:50.967207 32698 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:27:50.968413 32698 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:27:50.970089 32698 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:27:50.970211 32698 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:50.970368 32698 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:27:50.970443 32698 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:51.009111 32698 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:37345
I20260809 05:27:51.009184 435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:37345 every 8 connection(s)
I20260809 05:27:51.010833 32698 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:27:51.018723 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 32698
I20260809 05:27:51.019024 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance
I20260809 05:27:51.019795 27364 external_mini_cluster.cc:1428] Setting key c6ac0fd6ca77e3eba025996f1e31d26e
Aug 09 05:27:51 dist-test-slave-h3ft krb5kdc[32299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253270, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:51.040314 440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:51.014365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:55065 (local address 127.26.185.62:34413)
0809 05:27:51.014971 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:51.014977 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:51.016212 (+ 1235us) server_negotiation.cc:407] Connection header received
0809 05:27:51.018596 (+ 2384us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:51.018602 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:51.018698 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:51.018822 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:51.021498 (+ 2676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:51.022706 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:51.025595 (+ 2889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:51.026189 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:51.026318 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:51.032042 (+ 5724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:51.032048 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:51.032052 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:51.032099 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:51.035992 (+ 3893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:51.036962 (+ 970us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:51.036968 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:51.036970 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:51.037124 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:51.037679 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:51.037684 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:51.037686 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:51.038153 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:51.038354 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:51.039402 (+ 1048us) server_negotiation.cc:299] Negotiation successful
0809 05:27:51.039732 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":469,"thread_start_us":339,"threads_started":1}
I20260809 05:27:51.041756 441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:51.015091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:34413 (local address 127.26.185.2:55065)
0809 05:27:51.016005 (+ 914us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:51.016055 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:51.018115 (+ 2060us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:51.019253 (+ 1138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:51.019269 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:51.020237 (+ 968us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:27:51.021283 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:51.021311 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:51.022890 (+ 1579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:51.022896 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:51.025366 (+ 2470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:51.025392 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:51.026486 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:51.026497 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:51.026898 (+ 401us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:51.027913 (+ 1015us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:27:51.027956 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:27:51.031679 (+ 3723us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:27:51.036176 (+ 4497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:51.036188 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:51.036215 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:51.036790 (+ 575us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:51.037254 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:51.037259 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:51.037264 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:51.037528 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:51.038304 (+ 776us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:27:51.038314 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:27:51.038826 (+ 512us) client_negotiation.cc:769] Sending connection context
0809 05:27:51.039268 (+ 442us) client_negotiation.cc:240] Negotiation successful
0809 05:27:51.039922 (+ 654us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":355,"threads_started":1}
I20260809 05:27:51.043706 437 heartbeater.cc:347] Connected to a master server at 127.26.185.62:34413
I20260809 05:27:51.044152 437 heartbeater.cc:464] Registering TS with master...
I20260809 05:27:51.045377 437 heartbeater.cc:511] Master 127.26.185.62:34413 requested a full tablet report, sending...
I20260809 05:27:51.047581 32381 ts_manager.cc:194] Registered new tserver with Master: 08a3919a94d742c8b69eb53efd2ecc48 (127.26.185.2:37345)
I20260809 05:27:51.048570 32381 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.2@KRBTEST.COM'} at 127.26.185.2:55065
WARNING: no policy specified for kudu/127.26.185.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
I20260809 05:27:51.087862 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:0
--local_ip_for_outbound_sockets=127.26.185.3
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:34413
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:34629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:27:51.397045 32686 heartbeater.cc:503] Master 127.26.185.62:34413 was elected leader, sending a full tablet report...
W20260809 05:27:51.509074 446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:27:51.509568 446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:27:51.509780 446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:27:51.519066 446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:27:51.519286 446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:27:51.519512 446 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:27:51.532171 446 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:34629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:34413
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:27:51.534315 446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:27:51.536351 446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:27:51.553615 455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:51.553678 458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:51.553717 456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:51.554550 446 server_base.cc:1034] running on GCE node
I20260809 05:27:51.555418 446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:27:51.556612 446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:27:51.557875 446 hybrid_clock.cc:648] HybridClock initialized: now 1786253271557817 us; error 61 us; skew 500 ppm
I20260809 05:27:51.558302 446 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:27:51 dist-test-slave-h3ft krb5kdc[32299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253271, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:27:51.562292 446 init.cc:377] Logged in from keytab as kudu/127.26.185.3@KRBTEST.COM (short username kudu)
I20260809 05:27:51.564329 446 webserver.cc:460] Webserver started at http://127.26.185.3:41609/ using document root <none> and password file <none>
I20260809 05:27:51.565275 446 fs_manager.cc:359] Metadata directory not provided
I20260809 05:27:51.565452 446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:27:51.565847 446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:27:51.569809 446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/data/instance:
uuid: "b92d15c3a26b4defa8878c6f2db68e0e"
format_stamp: "Formatted at 2026-08-09 05:27:51 on dist-test-slave-h3ft"
server_key: "1f8e520a125a33ff257fa0d3489a6800"
server_key_iv: "53b37e10ae2cf9de4ddc5f5d902ba2fe"
server_key_version: "encryptionkey@0"
I20260809 05:27:51.570822 446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance:
uuid: "b92d15c3a26b4defa8878c6f2db68e0e"
format_stamp: "Formatted at 2026-08-09 05:27:51 on dist-test-slave-h3ft"
server_key: "1f8e520a125a33ff257fa0d3489a6800"
server_key_iv: "53b37e10ae2cf9de4ddc5f5d902ba2fe"
server_key_version: "encryptionkey@0"
I20260809 05:27:51.577288 446 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260809 05:27:51.582276 468 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:51.584168 446 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260809 05:27:51.584340 446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "b92d15c3a26b4defa8878c6f2db68e0e"
format_stamp: "Formatted at 2026-08-09 05:27:51 on dist-test-slave-h3ft"
server_key: "1f8e520a125a33ff257fa0d3489a6800"
server_key_iv: "53b37e10ae2cf9de4ddc5f5d902ba2fe"
server_key_version: "encryptionkey@0"
I20260809 05:27:51.584589 446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:27:51.616106 446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:27:51.621337 446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:27:51.621685 446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:27:51.622854 446 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:27:51.624542 446 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:27:51.624625 446 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:51.624724 446 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:27:51.624771 446 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:51.664455 446 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:42039
I20260809 05:27:51.664511 659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:42039 every 8 connection(s)
I20260809 05:27:51.666193 446 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:27:51.670562 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 446
I20260809 05:27:51.670810 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance
I20260809 05:27:51.671598 27364 external_mini_cluster.cc:1428] Setting key 35a47820387019d50f558af962b0422a
Aug 09 05:27:51 dist-test-slave-h3ft krb5kdc[32299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253271, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:51.693046 665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:51.669653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:58179 (local address 127.26.185.62:34413)
0809 05:27:51.670257 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:51.670262 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:51.671677 (+ 1415us) server_negotiation.cc:407] Connection header received
0809 05:27:51.674208 (+ 2531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:51.674213 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:51.674368 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:51.674533 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:51.676706 (+ 2173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:51.677584 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:51.679488 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:51.679959 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:51.680077 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:51.684617 (+ 4540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:51.684625 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:51.684629 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:51.684678 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:51.688661 (+ 3983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:51.690001 (+ 1340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:51.690007 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:51.690010 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:51.690216 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:51.690879 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:51.690883 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:51.690885 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:51.691371 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:51.691527 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:51.692435 (+ 908us) server_negotiation.cc:299] Negotiation successful
0809 05:27:51.692696 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":475,"thread_start_us":321,"threads_started":1}
I20260809 05:27:51.694382 667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:51.670383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:34413 (local address 127.26.185.3:58179)
0809 05:27:51.671459 (+ 1076us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:51.671516 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:51.673831 (+ 2315us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:51.674806 (+ 975us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:51.674819 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:51.675724 (+ 905us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:27:51.676516 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:51.676539 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:51.677731 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:51.677734 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:51.679343 (+ 1609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:51.679358 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:51.680232 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:51.680242 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:51.680538 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:51.681352 (+ 814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:27:51.681379 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:27:51.684246 (+ 2867us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:27:51.688878 (+ 4632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:51.688897 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:51.688940 (+ 43us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:51.689738 (+ 798us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:51.690377 (+ 639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:51.690382 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:51.690385 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:51.690708 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:51.691515 (+ 807us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:27:51.691523 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:27:51.692012 (+ 489us) client_negotiation.cc:769] Sending connection context
0809 05:27:51.692302 (+ 290us) client_negotiation.cc:240] Negotiation successful
0809 05:27:51.692900 (+ 598us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":768,"thread_start_us":452,"threads_started":1}
I20260809 05:27:51.696152 661 heartbeater.cc:347] Connected to a master server at 127.26.185.62:34413
I20260809 05:27:51.696559 661 heartbeater.cc:464] Registering TS with master...
I20260809 05:27:51.697561 661 heartbeater.cc:511] Master 127.26.185.62:34413 requested a full tablet report, sending...
I20260809 05:27:51.699724 32381 ts_manager.cc:194] Registered new tserver with Master: b92d15c3a26b4defa8878c6f2db68e0e (127.26.185.3:42039)
I20260809 05:27:51.700766 32381 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.3@KRBTEST.COM'} at 127.26.185.3:58179
I20260809 05:27:51.702234 27364 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 05:27:51 dist-test-slave-h3ft krb5kdc[32299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253271, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 09 05:27:51 dist-test-slave-h3ft krb5kdc[32299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253271, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:51.774036 665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:51.757156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38636 (local address 127.26.185.62:34413)
0809 05:27:51.757407 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:51.757416 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:51.757874 (+ 458us) server_negotiation.cc:407] Connection header received
0809 05:27:51.758132 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:51.758137 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:51.758247 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:51.758373 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:51.760193 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:51.761035 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:51.762493 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:51.762946 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:51.763149 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:51.767872 (+ 4723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:51.767879 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:51.767883 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:51.767932 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:51.770818 (+ 2886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:51.771678 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:51.771684 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:51.771693 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:51.771842 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:51.772297 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:51.772300 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:51.772302 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:51.772736 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:51.773042 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:51.773356 (+ 314us) server_negotiation.cc:299] Negotiation successful
0809 05:27:51.773651 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260809 05:27:51.774705 32381 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:38636
I20260809 05:27:51.777324 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 32483
Aug 09 05:27:51 dist-test-slave-h3ft krb5kdc[32299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253271, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.26.185.1@KRBTEST.COM
I20260809 05:27:51.796979 682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:51.778688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55138 (local address 127.26.185.1:39023)
0809 05:27:51.779580 (+ 892us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:51.779589 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:51.779620 (+ 31us) server_negotiation.cc:407] Connection header received
0809 05:27:51.779694 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:51.779702 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:51.780010 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:51.780165 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:51.781591 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:51.782758 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:51.784125 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:51.784813 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:51.784925 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:51.789880 (+ 4955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:51.789900 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:51.789922 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:51.789999 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:51.793561 (+ 3562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:51.794393 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:51.794409 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:51.794412 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:51.794571 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:51.795022 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:51.795030 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:51.795033 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:51.795501 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:51.795868 (+ 367us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:51.796189 (+ 321us) server_negotiation.cc:299] Negotiation successful
0809 05:27:51.796560 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":686,"thread_start_us":498,"threads_started":1}
W20260809 05:27:51.798647 32681 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:55138
W20260809 05:27:51.800169 27364 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 32483: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 05:27:51.800416 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 32483
I20260809 05:27:51.833439 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 32698
Aug 09 05:27:51 dist-test-slave-h3ft krb5kdc[32299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253271, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.26.185.2@KRBTEST.COM
I20260809 05:27:51.853716 683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:51.834774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39594 (local address 127.26.185.2:37345)
0809 05:27:51.835538 (+ 764us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:51.835550 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:51.835592 (+ 42us) server_negotiation.cc:407] Connection header received
0809 05:27:51.835677 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:51.835685 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:51.836036 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:51.836201 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:51.837675 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:51.838945 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:51.840497 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:51.841266 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:51.841385 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:51.846915 (+ 5530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:51.846932 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:51.846954 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:51.847083 (+ 129us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:51.850603 (+ 3520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:51.851474 (+ 871us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:51.851485 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:51.851488 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:51.851645 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:51.852082 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:51.852086 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:51.852088 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:51.852525 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:51.852815 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:51.853106 (+ 291us) server_negotiation.cc:299] Negotiation successful
0809 05:27:51.853367 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":400,"threads_started":1}
W20260809 05:27:51.855620 429 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:39594
W20260809 05:27:51.857246 27364 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 32698: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 05:27:51.857462 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 32698
I20260809 05:27:51.886195 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 446
Aug 09 05:27:51 dist-test-slave-h3ft krb5kdc[32299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253271, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.26.185.3@KRBTEST.COM
I20260809 05:27:51.907691 684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:51.887693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41948 (local address 127.26.185.3:42039)
0809 05:27:51.888504 (+ 811us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:51.888513 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:51.888552 (+ 39us) server_negotiation.cc:407] Connection header received
0809 05:27:51.888636 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:51.888645 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:51.888945 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:51.889104 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:51.890761 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:51.892187 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:51.893647 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:51.894314 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:51.894421 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:51.899852 (+ 5431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:51.899872 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:51.899901 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:51.899955 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:51.904011 (+ 4056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:51.904996 (+ 985us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:51.905006 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:51.905009 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:51.905176 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:51.905620 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:51.905626 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:51.905628 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:51.906190 (+ 562us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:51.906546 (+ 356us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:51.906912 (+ 366us) server_negotiation.cc:299] Negotiation successful
0809 05:27:51.907292 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":621,"thread_start_us":421,"threads_started":1}
W20260809 05:27:51.909493 653 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:41948
W20260809 05:27:51.911098 27364 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 446: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 05:27:51.911319 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 446
I20260809 05:27:51.946205 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 32324
I20260809 05:27:51.947896 32429 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:27:52.068974 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 32324
2026-08-09T05:27:52Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (4700 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:27:52 dist-test-slave-h3ft krb5kdc[689](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:27:52 dist-test-slave-h3ft krb5kdc[689](info): set up 2 sockets
Aug 09 05:27:52 dist-test-slave-h3ft krb5kdc[689](info): commencing operation
krb5kdc: starting...
W20260809 05:27:53.468395 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.340s user 0.006s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:27:53 dist-test-slave-h3ft krb5kdc[689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:27:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:27:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
I20260809 05:27:53.744551 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:41417
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:44129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:41417
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:27:54.152048 709 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:27:54.152452 709 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:27:54.152644 709 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:27:54.160609 709 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:27:54.160749 709 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:27:54.160841 709 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:27:54.160952 709 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:27:54.161041 709 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:27:54.172109 709 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:44129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:41417
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:41417
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:27:54.173957 709 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:27:54.175715 709 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:27:54.189263 716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:54.189360 717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:54.189317 719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:54.191020 709 server_base.cc:1034] running on GCE node
I20260809 05:27:54.192107 709 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:27:54.194463 709 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:27:54.195781 709 hybrid_clock.cc:648] HybridClock initialized: now 1786253274195697 us; error 64 us; skew 500 ppm
I20260809 05:27:54.196343 709 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:27:54 dist-test-slave-h3ft krb5kdc[689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253274, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:27:54.201519 709 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:27:54.204013 709 webserver.cc:460] Webserver started at http://127.26.185.62:38895/ using document root <none> and password file <none>
I20260809 05:27:54.204970 709 fs_manager.cc:359] Metadata directory not provided
I20260809 05:27:54.205086 709 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:27:54.205420 709 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:27:54.209299 709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "a3f0c785e5fa4646b8a2d8e91ea8050f"
format_stamp: "Formatted at 2026-08-09 05:27:54 on dist-test-slave-h3ft"
server_key: "115665f8f9b1e616e5732c3d7d3ab75e"
server_key_iv: "cd86ffa8a3c31b0e6b2c30a32a83f4a5"
server_key_version: "encryptionkey@0"
I20260809 05:27:54.210189 709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "a3f0c785e5fa4646b8a2d8e91ea8050f"
format_stamp: "Formatted at 2026-08-09 05:27:54 on dist-test-slave-h3ft"
server_key: "115665f8f9b1e616e5732c3d7d3ab75e"
server_key_iv: "cd86ffa8a3c31b0e6b2c30a32a83f4a5"
server_key_version: "encryptionkey@0"
I20260809 05:27:54.216552 709 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260809 05:27:54.220623 735 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:54.222204 709 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 05:27:54.222429 709 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "a3f0c785e5fa4646b8a2d8e91ea8050f"
format_stamp: "Formatted at 2026-08-09 05:27:54 on dist-test-slave-h3ft"
server_key: "115665f8f9b1e616e5732c3d7d3ab75e"
server_key_iv: "cd86ffa8a3c31b0e6b2c30a32a83f4a5"
server_key_version: "encryptionkey@0"
I20260809 05:27:54.222673 709 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:27:54.266052 709 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:27:54.271492 709 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:27:54.271835 709 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:27:54.293442 709 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:41417
I20260809 05:27:54.293449 830 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:41417 every 8 connection(s)
I20260809 05:27:54.295243 709 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:27:54.296795 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 709
I20260809 05:27:54.297111 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:27:54.298061 27364 external_mini_cluster.cc:1428] Setting key 3b7c4fd2d39bcc3ccf59061757109d74
I20260809 05:27:54.301038 831 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:54.313380 831 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3f0c785e5fa4646b8a2d8e91ea8050f: Bootstrap starting.
Aug 09 05:27:54 dist-test-slave-h3ft krb5kdc[689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:54.317356 831 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a3f0c785e5fa4646b8a2d8e91ea8050f: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:54.318619 831 log.cc:824] T 00000000000000000000000000000000 P a3f0c785e5fa4646b8a2d8e91ea8050f: Log is configured to *not* fsync() on all Append() calls
I20260809 05:27:54.322588 831 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3f0c785e5fa4646b8a2d8e91ea8050f: No bootstrap required, opened a new log
I20260809 05:27:54.323843 835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:54.300740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35772 (local address 127.26.185.62:41417)
0809 05:27:54.301677 (+ 937us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:54.301692 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:54.301741 (+ 49us) server_negotiation.cc:407] Connection header received
0809 05:27:54.303806 (+ 2065us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:54.303834 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:54.304306 (+ 472us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:54.304781 (+ 475us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:54.306571 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:54.308063 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:54.309406 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:54.310155 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:54.310392 (+ 237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:54.314920 (+ 4528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:54.314930 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:54.314946 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:54.314996 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:54.318476 (+ 3480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:54.319409 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:54.319420 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:54.319434 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:54.319635 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:54.320117 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:54.320120 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:54.320122 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:54.320924 (+ 802us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:54.321269 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:54.321733 (+ 464us) server_negotiation.cc:299] Negotiation successful
0809 05:27:54.322265 (+ 532us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":703,"thread_start_us":412,"threads_started":1}
I20260809 05:27:54.332167 831 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3f0c785e5fa4646b8a2d8e91ea8050f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3f0c785e5fa4646b8a2d8e91ea8050f" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 41417 } }
I20260809 05:27:54.332670 831 raft_consensus.cc:374] T 00000000000000000000000000000000 P a3f0c785e5fa4646b8a2d8e91ea8050f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:54.332762 831 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3f0c785e5fa4646b8a2d8e91ea8050f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3f0c785e5fa4646b8a2d8e91ea8050f, State: Initialized, Role: FOLLOWER
I20260809 05:27:54.333428 831 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3f0c785e5fa4646b8a2d8e91ea8050f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3f0c785e5fa4646b8a2d8e91ea8050f" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 41417 } }
I20260809 05:27:54.333665 831 raft_consensus.cc:388] T 00000000000000000000000000000000 P a3f0c785e5fa4646b8a2d8e91ea8050f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:27:54.333777 831 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3f0c785e5fa4646b8a2d8e91ea8050f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:27:54.333925 831 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3f0c785e5fa4646b8a2d8e91ea8050f [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:54.336570 831 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3f0c785e5fa4646b8a2d8e91ea8050f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3f0c785e5fa4646b8a2d8e91ea8050f" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 41417 } }
I20260809 05:27:54.337241 831 leader_election.cc:302] T 00000000000000000000000000000000 P a3f0c785e5fa4646b8a2d8e91ea8050f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a3f0c785e5fa4646b8a2d8e91ea8050f; no voters:
I20260809 05:27:54.337910 831 leader_election.cc:288] T 00000000000000000000000000000000 P a3f0c785e5fa4646b8a2d8e91ea8050f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:27:54.338093 838 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a3f0c785e5fa4646b8a2d8e91ea8050f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:27:54.339311 838 raft_consensus.cc:686] T 00000000000000000000000000000000 P a3f0c785e5fa4646b8a2d8e91ea8050f [term 1 LEADER]: Becoming Leader. State: Replica: a3f0c785e5fa4646b8a2d8e91ea8050f, State: Running, Role: LEADER
I20260809 05:27:54.339956 838 consensus_queue.cc:237] T 00000000000000000000000000000000 P a3f0c785e5fa4646b8a2d8e91ea8050f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3f0c785e5fa4646b8a2d8e91ea8050f" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 41417 } }
I20260809 05:27:54.340437 831 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3f0c785e5fa4646b8a2d8e91ea8050f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:27:54.343701 839 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3f0c785e5fa4646b8a2d8e91ea8050f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a3f0c785e5fa4646b8a2d8e91ea8050f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3f0c785e5fa4646b8a2d8e91ea8050f" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 41417 } } }
I20260809 05:27:54.344165 839 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3f0c785e5fa4646b8a2d8e91ea8050f [sys.catalog]: This master's current role is: LEADER
I20260809 05:27:54.343688 840 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3f0c785e5fa4646b8a2d8e91ea8050f [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3f0c785e5fa4646b8a2d8e91ea8050f. Latest consensus state: current_term: 1 leader_uuid: "a3f0c785e5fa4646b8a2d8e91ea8050f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3f0c785e5fa4646b8a2d8e91ea8050f" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 41417 } } }
I20260809 05:27:54.344764 840 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3f0c785e5fa4646b8a2d8e91ea8050f [sys.catalog]: This master's current role is: LEADER
I20260809 05:27:54.349483 848 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:27:54.354736 848 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:27:54.365023 848 catalog_manager.cc:1347] Generated new cluster ID: c6316a1bd9cb4ef2b259fe7e424ad176
I20260809 05:27:54.365160 848 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:27:54.393314 848 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:27:54.395330 848 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:27:54.410574 848 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a3f0c785e5fa4646b8a2d8e91ea8050f: Generated new TSK 0
I20260809 05:27:54.411849 848 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.185.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
I20260809 05:27:54.481989 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:0
--local_ip_for_outbound_sockets=127.26.185.1
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:41417
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:44129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:27:54.897619 869 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:27:54.898053 869 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:27:54.898243 869 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:27:54.906422 869 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:27:54.906622 869 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:27:54.906809 869 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:27:54.918459 869 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:44129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:41417
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:27:54.920395 869 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:27:54.922187 869 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:27:54.938570 877 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:54.938880 878 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:54.939249 880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:54.940326 869 server_base.cc:1034] running on GCE node
I20260809 05:27:54.941263 869 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:27:54.942713 869 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:27:54.943988 869 hybrid_clock.cc:648] HybridClock initialized: now 1786253274943928 us; error 48 us; skew 500 ppm
I20260809 05:27:54.944371 869 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:27:54 dist-test-slave-h3ft krb5kdc[689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253274, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:27:54.949014 869 init.cc:377] Logged in from keytab as kudu/127.26.185.1@KRBTEST.COM (short username kudu)
I20260809 05:27:54.951093 869 webserver.cc:460] Webserver started at http://127.26.185.1:33583/ using document root <none> and password file <none>
I20260809 05:27:54.952024 869 fs_manager.cc:359] Metadata directory not provided
I20260809 05:27:54.952189 869 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:27:54.952664 869 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:27:54.956435 869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-0/data/instance:
uuid: "4e505ac8aa514a04ae571267d5343bc0"
format_stamp: "Formatted at 2026-08-09 05:27:54 on dist-test-slave-h3ft"
server_key: "ac9eddee39b1fae37096727b1a1ad589"
server_key_iv: "3d7c8284e28830326a565a9b690d277d"
server_key_version: "encryptionkey@0"
I20260809 05:27:54.957392 869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance:
uuid: "4e505ac8aa514a04ae571267d5343bc0"
format_stamp: "Formatted at 2026-08-09 05:27:54 on dist-test-slave-h3ft"
server_key: "ac9eddee39b1fae37096727b1a1ad589"
server_key_iv: "3d7c8284e28830326a565a9b690d277d"
server_key_version: "encryptionkey@0"
I20260809 05:27:54.963795 869 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260809 05:27:54.968197 889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:54.969849 869 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260809 05:27:54.970065 869 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "4e505ac8aa514a04ae571267d5343bc0"
format_stamp: "Formatted at 2026-08-09 05:27:54 on dist-test-slave-h3ft"
server_key: "ac9eddee39b1fae37096727b1a1ad589"
server_key_iv: "3d7c8284e28830326a565a9b690d277d"
server_key_version: "encryptionkey@0"
I20260809 05:27:54.970324 869 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:27:54.986107 869 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:27:54.991460 869 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:27:54.991812 869 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:27:54.993043 869 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:27:54.994716 869 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:27:54.994828 869 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:54.994988 869 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:27:54.995100 869 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260809 05:27:55.034056 869 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:39143
I20260809 05:27:55.034122 1076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:39143 every 8 connection(s)
I20260809 05:27:55.035773 869 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:27:55.044991 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 869
I20260809 05:27:55.045313 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance
I20260809 05:27:55.046166 27364 external_mini_cluster.cc:1428] Setting key 86b4f7c4139bd0c95abc58513030ffa3
Aug 09 05:27:55 dist-test-slave-h3ft krb5kdc[689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253274, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:55.061756 1080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:55.038918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:35925 (local address 127.26.185.62:41417)
0809 05:27:55.039457 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:55.039464 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:55.040997 (+ 1533us) server_negotiation.cc:407] Connection header received
0809 05:27:55.043375 (+ 2378us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:55.043382 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:55.043498 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:55.043637 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:55.045723 (+ 2086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:55.046667 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:55.048894 (+ 2227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:55.049343 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:55.049491 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:55.054566 (+ 5075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:55.054572 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:55.054575 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:55.054616 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:55.057643 (+ 3027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:55.058736 (+ 1093us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:55.058740 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:55.058743 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:55.058880 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:55.059400 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:55.059406 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:55.059411 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:55.059843 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:55.060086 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:55.060920 (+ 834us) server_negotiation.cc:299] Negotiation successful
0809 05:27:55.061219 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":231,"threads_started":1}
I20260809 05:27:55.062718 1083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:55.039674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:41417 (local address 127.26.185.1:35925)
0809 05:27:55.040735 (+ 1061us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:55.040835 (+ 100us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:55.043030 (+ 2195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:55.043948 (+ 918us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:55.043959 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:55.044665 (+ 706us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:27:55.045507 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:55.045540 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:55.046859 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:55.046865 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:55.048731 (+ 1866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:55.048744 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:55.049610 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:55.049617 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:55.049903 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:55.050857 (+ 954us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:27:55.050886 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:27:55.054258 (+ 3372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:27:55.057824 (+ 3566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:55.057838 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:55.057866 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:55.058596 (+ 730us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:55.058994 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:55.059019 (+ 25us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:55.059023 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:55.059276 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:55.060002 (+ 726us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:27:55.060009 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:27:55.060441 (+ 432us) client_negotiation.cc:769] Sending connection context
0809 05:27:55.060752 (+ 311us) client_negotiation.cc:240] Negotiation successful
0809 05:27:55.061263 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"thread_start_us":363,"threads_started":1}
I20260809 05:27:55.064910 1078 heartbeater.cc:347] Connected to a master server at 127.26.185.62:41417
I20260809 05:27:55.065369 1078 heartbeater.cc:464] Registering TS with master...
I20260809 05:27:55.066349 1078 heartbeater.cc:511] Master 127.26.185.62:41417 requested a full tablet report, sending...
I20260809 05:27:55.069315 770 ts_manager.cc:194] Registered new tserver with Master: 4e505ac8aa514a04ae571267d5343bc0 (127.26.185.1:39143)
I20260809 05:27:55.071332 770 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.1@KRBTEST.COM'} at 127.26.185.1:35925
WARNING: no policy specified for kudu/127.26.185.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
I20260809 05:27:55.112005 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:0
--local_ip_for_outbound_sockets=127.26.185.2
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:41417
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:44129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:27:55.533404 1090 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:27:55.533977 1090 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:27:55.534178 1090 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:27:55.543220 1090 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:27:55.543368 1090 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:27:55.543524 1090 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:27:55.555620 1090 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:44129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:41417
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:27:55.557355 1090 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:27:55.559036 1090 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:27:55.575135 1102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:55.575120 1107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:55.575205 1103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:55.576603 1090 server_base.cc:1034] running on GCE node
I20260809 05:27:55.577365 1090 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:27:55.578497 1090 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:27:55.579707 1090 hybrid_clock.cc:648] HybridClock initialized: now 1786253275579638 us; error 53 us; skew 500 ppm
I20260809 05:27:55.580080 1090 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:27:55 dist-test-slave-h3ft krb5kdc[689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253275, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:27:55.583827 1090 init.cc:377] Logged in from keytab as kudu/127.26.185.2@KRBTEST.COM (short username kudu)
I20260809 05:27:55.585618 1090 webserver.cc:460] Webserver started at http://127.26.185.2:39851/ using document root <none> and password file <none>
I20260809 05:27:55.586534 1090 fs_manager.cc:359] Metadata directory not provided
I20260809 05:27:55.586688 1090 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:27:55.587147 1090 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:27:55.590734 1090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-1/data/instance:
uuid: "7035605a16524862ac03b68a653d71c1"
format_stamp: "Formatted at 2026-08-09 05:27:55 on dist-test-slave-h3ft"
server_key: "5c0e58e2d0c8c0daa66db38875461189"
server_key_iv: "b3cba72d877aa9f8fa5734ae8cec1bff"
server_key_version: "encryptionkey@0"
I20260809 05:27:55.591720 1090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance:
uuid: "7035605a16524862ac03b68a653d71c1"
format_stamp: "Formatted at 2026-08-09 05:27:55 on dist-test-slave-h3ft"
server_key: "5c0e58e2d0c8c0daa66db38875461189"
server_key_iv: "b3cba72d877aa9f8fa5734ae8cec1bff"
server_key_version: "encryptionkey@0"
I20260809 05:27:55.600739 1090 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.003s sys 0.005s
I20260809 05:27:55.607206 1121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:55.609467 1090 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260809 05:27:55.609714 1090 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "7035605a16524862ac03b68a653d71c1"
format_stamp: "Formatted at 2026-08-09 05:27:55 on dist-test-slave-h3ft"
server_key: "5c0e58e2d0c8c0daa66db38875461189"
server_key_iv: "b3cba72d877aa9f8fa5734ae8cec1bff"
server_key_version: "encryptionkey@0"
I20260809 05:27:55.610069 1090 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:27:55.640431 1090 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:27:55.647711 1090 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:27:55.648114 1090 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:27:55.649703 1090 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:27:55.652382 1090 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:27:55.652510 1090 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:55.652740 1090 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:27:55.652827 1090 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:55.695873 1090 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:35403
I20260809 05:27:55.695919 1309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:35403 every 8 connection(s)
I20260809 05:27:55.697570 1090 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:27:55.704326 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 1090
I20260809 05:27:55.704624 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance
I20260809 05:27:55.705221 27364 external_mini_cluster.cc:1428] Setting key 762472c8fae2eaf08c4799a25f6c3ba3
Aug 09 05:27:55 dist-test-slave-h3ft krb5kdc[689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253275, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:55.726380 1314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:55.700886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:41891 (local address 127.26.185.62:41417)
0809 05:27:55.701477 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:55.701483 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:55.702590 (+ 1107us) server_negotiation.cc:407] Connection header received
0809 05:27:55.705091 (+ 2501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:55.705100 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:55.705225 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:55.705365 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:55.708052 (+ 2687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:55.709446 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:55.711567 (+ 2121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:55.712470 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:55.712677 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:55.718123 (+ 5446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:55.718135 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:55.718143 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:55.718209 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:55.721919 (+ 3710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:55.723263 (+ 1344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:55.723268 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:55.723271 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:55.723422 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:55.724014 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:55.724019 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:55.724022 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:55.724360 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:55.724500 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:55.725752 (+ 1252us) server_negotiation.cc:299] Negotiation successful
0809 05:27:55.725990 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":439,"thread_start_us":301,"threads_started":1}
I20260809 05:27:55.728556 1316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:55.701428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:41417 (local address 127.26.185.2:41891)
0809 05:27:55.702349 (+ 921us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:55.702413 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:55.704656 (+ 2243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:55.705726 (+ 1070us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:55.705738 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:55.706664 (+ 926us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:27:55.707811 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:55.707851 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:55.709717 (+ 1866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:55.709728 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:55.711372 (+ 1644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:55.711390 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:55.712783 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:55.712789 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:55.713075 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:55.714048 (+ 973us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:27:55.714083 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:27:55.717667 (+ 3584us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:27:55.722131 (+ 4464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:55.722147 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:55.722176 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:55.723107 (+ 931us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:55.723545 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:55.723554 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:55.723560 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:55.723891 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:55.724501 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:27:55.724515 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:27:55.725230 (+ 715us) client_negotiation.cc:769] Sending connection context
0809 05:27:55.725672 (+ 442us) client_negotiation.cc:240] Negotiation successful
0809 05:27:55.726514 (+ 842us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":357,"threads_started":1}
I20260809 05:27:55.730587 1310 heartbeater.cc:347] Connected to a master server at 127.26.185.62:41417
I20260809 05:27:55.731082 1310 heartbeater.cc:464] Registering TS with master...
I20260809 05:27:55.732098 1310 heartbeater.cc:511] Master 127.26.185.62:41417 requested a full tablet report, sending...
I20260809 05:27:55.734195 770 ts_manager.cc:194] Registered new tserver with Master: 7035605a16524862ac03b68a653d71c1 (127.26.185.2:35403)
I20260809 05:27:55.735430 770 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.2@KRBTEST.COM'} at 127.26.185.2:41891
WARNING: no policy specified for kudu/127.26.185.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
I20260809 05:27:55.780220 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:0
--local_ip_for_outbound_sockets=127.26.185.3
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:41417
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:44129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:27:56.075637 1078 heartbeater.cc:503] Master 127.26.185.62:41417 was elected leader, sending a full tablet report...
W20260809 05:27:56.194841 1322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:27:56.195218 1322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:27:56.195328 1322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:27:56.203114 1322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:27:56.203267 1322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:27:56.203409 1322 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:27:56.214061 1322 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:44129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:41417
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:27:56.215839 1322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:27:56.217689 1322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:27:56.233599 1333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:56.233551 1336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:56.233506 1334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:56.234567 1322 server_base.cc:1034] running on GCE node
I20260809 05:27:56.235538 1322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:27:56.237080 1322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:27:56.238297 1322 hybrid_clock.cc:648] HybridClock initialized: now 1786253276238240 us; error 58 us; skew 500 ppm
I20260809 05:27:56.238787 1322 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:27:56 dist-test-slave-h3ft krb5kdc[689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253276, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:27:56.247576 1322 init.cc:377] Logged in from keytab as kudu/127.26.185.3@KRBTEST.COM (short username kudu)
I20260809 05:27:56.249672 1322 webserver.cc:460] Webserver started at http://127.26.185.3:39651/ using document root <none> and password file <none>
I20260809 05:27:56.250726 1322 fs_manager.cc:359] Metadata directory not provided
I20260809 05:27:56.250898 1322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:27:56.251339 1322 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:27:56.255189 1322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-2/data/instance:
uuid: "3fadd79972644b87b7c98e0ebc3b810f"
format_stamp: "Formatted at 2026-08-09 05:27:56 on dist-test-slave-h3ft"
server_key: "fda0efbb19dc5390ee3c2b5b5d028c39"
server_key_iv: "753ac2872a0497d273bd2e7fc7bad3b1"
server_key_version: "encryptionkey@0"
I20260809 05:27:56.256333 1322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance:
uuid: "3fadd79972644b87b7c98e0ebc3b810f"
format_stamp: "Formatted at 2026-08-09 05:27:56 on dist-test-slave-h3ft"
server_key: "fda0efbb19dc5390ee3c2b5b5d028c39"
server_key_iv: "753ac2872a0497d273bd2e7fc7bad3b1"
server_key_version: "encryptionkey@0"
I20260809 05:27:56.262807 1322 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260809 05:27:56.266954 1345 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:56.268620 1322 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 05:27:56.268815 1322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "3fadd79972644b87b7c98e0ebc3b810f"
format_stamp: "Formatted at 2026-08-09 05:27:56 on dist-test-slave-h3ft"
server_key: "fda0efbb19dc5390ee3c2b5b5d028c39"
server_key_iv: "753ac2872a0497d273bd2e7fc7bad3b1"
server_key_version: "encryptionkey@0"
I20260809 05:27:56.269053 1322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:27:56.284900 1322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:27:56.290019 1322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:27:56.290364 1322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:27:56.291699 1322 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:27:56.293395 1322 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:27:56.293514 1322 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:56.293633 1322 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:27:56.293699 1322 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:56.332506 1322 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:34909
I20260809 05:27:56.332546 1522 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:34909 every 8 connection(s)
I20260809 05:27:56.334198 1322 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:27:56.342492 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 1322
I20260809 05:27:56.342730 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance
I20260809 05:27:56.343314 27364 external_mini_cluster.cc:1428] Setting key d78ac59133f679bac41601717728a613
Aug 09 05:27:56 dist-test-slave-h3ft krb5kdc[689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253276, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:56.359714 1526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:56.337588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:41165 (local address 127.26.185.62:41417)
0809 05:27:56.338318 (+ 730us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:56.338324 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:56.339345 (+ 1021us) server_negotiation.cc:407] Connection header received
0809 05:27:56.341780 (+ 2435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:56.341789 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:56.341909 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:56.342055 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:56.344429 (+ 2374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:56.345607 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:56.347592 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:56.348061 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:56.348218 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:56.352459 (+ 4241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:56.352465 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:56.352469 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:56.352512 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:56.355947 (+ 3435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:56.356916 (+ 969us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:56.356920 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:56.356923 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:56.357069 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:56.357566 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:56.357570 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:56.357572 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:56.357902 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:56.358081 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:56.358925 (+ 844us) server_negotiation.cc:299] Negotiation successful
0809 05:27:56.359243 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":424,"threads_started":1}
I20260809 05:27:56.360935 1527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:56.338157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:41417 (local address 127.26.185.3:41165)
0809 05:27:56.339118 (+ 961us) negotiation.cc:107] Waiting for socket to connect
0809 05:27:56.339167 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 05:27:56.341394 (+ 2227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:27:56.342382 (+ 988us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:27:56.342394 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:27:56.343248 (+ 854us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:27:56.344192 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:56.344226 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:56.345791 (+ 1565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:56.345797 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:56.347429 (+ 1632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:27:56.347444 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:27:56.348339 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:27:56.348351 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:27:56.348633 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:56.349429 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:27:56.349457 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:27:56.352176 (+ 2719us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:27:56.356120 (+ 3944us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:56.356131 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:56.356157 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:56.356758 (+ 601us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:56.357189 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:27:56.357195 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:27:56.357198 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:27:56.357431 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:27:56.358039 (+ 608us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:27:56.358049 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:27:56.358494 (+ 445us) client_negotiation.cc:769] Sending connection context
0809 05:27:56.358813 (+ 319us) client_negotiation.cc:240] Negotiation successful
0809 05:27:56.359525 (+ 712us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":323,"threads_started":1}
I20260809 05:27:56.362504 1524 heartbeater.cc:347] Connected to a master server at 127.26.185.62:41417
I20260809 05:27:56.362903 1524 heartbeater.cc:464] Registering TS with master...
I20260809 05:27:56.363818 1524 heartbeater.cc:511] Master 127.26.185.62:41417 requested a full tablet report, sending...
I20260809 05:27:56.365430 770 ts_manager.cc:194] Registered new tserver with Master: 3fadd79972644b87b7c98e0ebc3b810f (127.26.185.3:34909)
I20260809 05:27:56.366366 770 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.3@KRBTEST.COM'} at 127.26.185.3:41165
I20260809 05:27:56.372117 27364 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 05:27:56 dist-test-slave-h3ft krb5kdc[689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253276, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 05:27:56 dist-test-slave-h3ft krb5kdc[689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253276, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.1@KRBTEST.COM
I20260809 05:27:56.438694 1532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:56.421169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32874 (local address 127.26.185.1:39143)
0809 05:27:56.421950 (+ 781us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:56.421959 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:56.421999 (+ 40us) server_negotiation.cc:407] Connection header received
0809 05:27:56.422080 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:56.422089 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:56.422377 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:56.422545 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:56.424215 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:56.425310 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:56.426662 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:56.427422 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:56.427567 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:56.432153 (+ 4586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:56.432166 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:56.432186 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:56.432235 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:56.435534 (+ 3299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:56.436310 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:56.436318 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:56.436321 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:56.436462 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:56.436881 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:56.436886 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:56.436890 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:56.437302 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:56.437665 (+ 363us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:56.437958 (+ 293us) server_negotiation.cc:299] Negotiation successful
0809 05:27:56.438282 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":385,"threads_started":1}
Aug 09 05:27:56 dist-test-slave-h3ft krb5kdc[689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253276, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:56.459299 1526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:56.443970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35782 (local address 127.26.185.62:41417)
0809 05:27:56.444202 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:56.444211 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:56.444276 (+ 65us) server_negotiation.cc:407] Connection header received
0809 05:27:56.444496 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:56.444501 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:56.444617 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:56.444730 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:56.446206 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:56.447119 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:56.448400 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:56.448848 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:56.449000 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:56.453343 (+ 4343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:56.453348 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:56.453352 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:56.453392 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:56.456213 (+ 2821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:56.457028 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:56.457039 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:56.457041 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:56.457174 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:56.457581 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:56.457587 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:56.457595 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:56.457996 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:56.458274 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:56.458634 (+ 360us) server_negotiation.cc:299] Negotiation successful
0809 05:27:56.458904 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
W20260809 05:27:56.460110 770 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35782
I20260809 05:27:56.461439 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 869
I20260809 05:27:56.476382 1532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:56.462466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32890 (local address 127.26.185.1:39143)
0809 05:27:56.462662 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:56.462668 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:56.462949 (+ 281us) server_negotiation.cc:407] Connection header received
0809 05:27:56.463144 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:56.463148 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:56.463229 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:56.463323 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:56.464654 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:56.465409 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:56.466722 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:56.467272 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:56.467386 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:56.469822 (+ 2436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:56.469828 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:56.469832 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:56.469895 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:56.473091 (+ 3196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:56.473984 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:56.473992 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:56.473996 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:56.474206 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:56.474675 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:56.474684 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:56.474691 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:56.475199 (+ 508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:56.475432 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:56.475786 (+ 354us) server_negotiation.cc:299] Negotiation successful
0809 05:27:56.476075 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 05:27:56.477191 1072 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:27:56.577993 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 869
I20260809 05:27:56.606644 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 1090
Aug 09 05:27:56 dist-test-slave-h3ft krb5kdc[689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253276, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.2@KRBTEST.COM
I20260809 05:27:56.625149 1539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:56.607823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56120 (local address 127.26.185.2:35403)
0809 05:27:56.608484 (+ 661us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:56.608496 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:56.608542 (+ 46us) server_negotiation.cc:407] Connection header received
0809 05:27:56.608635 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:56.608644 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:56.608927 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:56.609098 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:56.610515 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:56.611868 (+ 1353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:56.613216 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:56.613851 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:56.613976 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:56.618956 (+ 4980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:56.618969 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:56.618989 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:56.619079 (+ 90us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:56.622340 (+ 3261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:56.623065 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:56.623073 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:56.623075 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:56.623239 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:56.623616 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:56.623619 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:56.623621 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:56.624030 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:56.624281 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:56.624562 (+ 281us) server_negotiation.cc:299] Negotiation successful
0809 05:27:56.624803 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":469,"thread_start_us":334,"threads_started":1}
I20260809 05:27:56.626961 1304 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:27:56.719182 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 1090
I20260809 05:27:56.748584 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 1322
Aug 09 05:27:56 dist-test-slave-h3ft krb5kdc[689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253276, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.3@KRBTEST.COM
I20260809 05:27:56.768988 1541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:56.749884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42080 (local address 127.26.185.3:34909)
0809 05:27:56.750675 (+ 791us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:56.750684 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:56.750725 (+ 41us) server_negotiation.cc:407] Connection header received
0809 05:27:56.750806 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:56.750815 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:56.751191 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:56.751349 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:56.752892 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:56.754117 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:56.755820 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:56.756526 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:56.756634 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:56.761634 (+ 5000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:56.761650 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:56.761672 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:56.761720 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:56.765555 (+ 3835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:56.766491 (+ 936us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:56.766502 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:56.766505 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:56.766662 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:56.766996 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:56.767062 (+ 66us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:56.767067 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:56.767612 (+ 545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:56.767949 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:56.768184 (+ 235us) server_negotiation.cc:299] Negotiation successful
0809 05:27:56.768485 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":611,"thread_start_us":398,"threads_started":1}
I20260809 05:27:56.770756 1517 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:27:56.867215 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 1322
I20260809 05:27:56.898118 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 709
I20260809 05:27:56.899884 824 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:27:57.020742 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 709
2026-08-09T05:27:57Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4951 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:27:57 dist-test-slave-h3ft krb5kdc[1549](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:27:57 dist-test-slave-h3ft krb5kdc[1549](info): set up 2 sockets
Aug 09 05:27:57 dist-test-slave-h3ft krb5kdc[1549](info): commencing operation
krb5kdc: starting...
W20260809 05:27:58.429646 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.350s user 0.005s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:27:58 dist-test-slave-h3ft krb5kdc[1549](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253278, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:27:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:27:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
I20260809 05:27:58.725600 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:38095
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:45075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:38095
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:27:59.140733 1568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:27:59.141112 1568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:27:59.141288 1568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:27:59.149188 1568 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:27:59.149318 1568 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:27:59.149402 1568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:27:59.149494 1568 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:27:59.149582 1568 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:27:59.160899 1568 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:45075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:38095
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:38095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:27:59.162746 1568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:27:59.164520 1568 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:27:59.178153 1574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:59.178062 1578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:59.178088 1575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:59.179363 1568 server_base.cc:1034] running on GCE node
I20260809 05:27:59.180353 1568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:27:59.182112 1568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:27:59.183357 1568 hybrid_clock.cc:648] HybridClock initialized: now 1786253279183300 us; error 45 us; skew 500 ppm
I20260809 05:27:59.183825 1568 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:27:59 dist-test-slave-h3ft krb5kdc[1549](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253279, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:27:59.188271 1568 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:27:59.189957 1568 fs_manager.cc:359] Metadata directory not provided
I20260809 05:27:59.190109 1568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:27:59.190572 1568 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:27:59.194608 1568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "118ae11af2d448cb986a695b7358cabb"
format_stamp: "Formatted at 2026-08-09 05:27:59 on dist-test-slave-h3ft"
server_key: "1b9b2174522bad29761735fa5e57e610"
server_key_iv: "654d2c4b340f49c1fe49a35545df41e5"
server_key_version: "encryptionkey@0"
I20260809 05:27:59.195744 1568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "118ae11af2d448cb986a695b7358cabb"
format_stamp: "Formatted at 2026-08-09 05:27:59 on dist-test-slave-h3ft"
server_key: "1b9b2174522bad29761735fa5e57e610"
server_key_iv: "654d2c4b340f49c1fe49a35545df41e5"
server_key_version: "encryptionkey@0"
I20260809 05:27:59.202525 1568 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260809 05:27:59.208741 1590 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:59.211082 1568 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
I20260809 05:27:59.211361 1568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "118ae11af2d448cb986a695b7358cabb"
format_stamp: "Formatted at 2026-08-09 05:27:59 on dist-test-slave-h3ft"
server_key: "1b9b2174522bad29761735fa5e57e610"
server_key_iv: "654d2c4b340f49c1fe49a35545df41e5"
server_key_version: "encryptionkey@0"
I20260809 05:27:59.211719 1568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:27:59.241724 1568 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:27:59.247879 1568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:27:59.248199 1568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:27:59.273558 1568 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:38095
I20260809 05:27:59.273535 1671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:38095 every 8 connection(s)
I20260809 05:27:59.274834 1568 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:27:59.278790 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 1568
I20260809 05:27:59.279122 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:27:59.280087 27364 external_mini_cluster.cc:1428] Setting key 31b10b5e780187035c3d1fd0747dcc3a
I20260809 05:27:59.280313 1673 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:27:59.294945 1673 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 118ae11af2d448cb986a695b7358cabb: Bootstrap starting.
Aug 09 05:27:59 dist-test-slave-h3ft krb5kdc[1549](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253278, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:27:59.298945 1673 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 118ae11af2d448cb986a695b7358cabb: Neither blocks nor log segments found. Creating new log.
I20260809 05:27:59.300239 1673 log.cc:824] T 00000000000000000000000000000000 P 118ae11af2d448cb986a695b7358cabb: Log is configured to *not* fsync() on all Append() calls
I20260809 05:27:59.304117 1673 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 118ae11af2d448cb986a695b7358cabb: No bootstrap required, opened a new log
I20260809 05:27:59.308291 1677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:27:59.282812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34740 (local address 127.26.185.62:38095)
0809 05:27:59.283853 (+ 1041us) server_negotiation.cc:206] Beginning negotiation
0809 05:27:59.283868 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 05:27:59.283926 (+ 58us) server_negotiation.cc:407] Connection header received
0809 05:27:59.286205 (+ 2279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:27:59.286234 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:27:59.286760 (+ 526us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:27:59.287309 (+ 549us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:27:59.289179 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:59.290755 (+ 1576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:59.292388 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:27:59.293304 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:27:59.293540 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:27:59.298696 (+ 5156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:27:59.298707 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:27:59.298725 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:27:59.298774 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:27:59.303066 (+ 4292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:59.303809 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:59.303818 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:59.303827 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:59.304050 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:27:59.304517 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:27:59.304522 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:27:59.304525 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:27:59.305377 (+ 852us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:27:59.305718 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0809 05:27:59.306116 (+ 398us) server_negotiation.cc:299] Negotiation successful
0809 05:27:59.306653 (+ 537us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":765,"thread_start_us":483,"threads_started":1}
I20260809 05:27:59.314492 1673 raft_consensus.cc:348] T 00000000000000000000000000000000 P 118ae11af2d448cb986a695b7358cabb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118ae11af2d448cb986a695b7358cabb" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 38095 } }
I20260809 05:27:59.314882 1673 raft_consensus.cc:374] T 00000000000000000000000000000000 P 118ae11af2d448cb986a695b7358cabb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:27:59.314973 1673 raft_consensus.cc:729] T 00000000000000000000000000000000 P 118ae11af2d448cb986a695b7358cabb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 118ae11af2d448cb986a695b7358cabb, State: Initialized, Role: FOLLOWER
I20260809 05:27:59.315590 1673 consensus_queue.cc:260] T 00000000000000000000000000000000 P 118ae11af2d448cb986a695b7358cabb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118ae11af2d448cb986a695b7358cabb" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 38095 } }
I20260809 05:27:59.315810 1673 raft_consensus.cc:388] T 00000000000000000000000000000000 P 118ae11af2d448cb986a695b7358cabb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:27:59.315913 1673 raft_consensus.cc:482] T 00000000000000000000000000000000 P 118ae11af2d448cb986a695b7358cabb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:27:59.316123 1673 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 118ae11af2d448cb986a695b7358cabb [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:27:59.318538 1673 raft_consensus.cc:504] T 00000000000000000000000000000000 P 118ae11af2d448cb986a695b7358cabb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118ae11af2d448cb986a695b7358cabb" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 38095 } }
I20260809 05:27:59.319183 1673 leader_election.cc:302] T 00000000000000000000000000000000 P 118ae11af2d448cb986a695b7358cabb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 118ae11af2d448cb986a695b7358cabb; no voters:
I20260809 05:27:59.319826 1673 leader_election.cc:288] T 00000000000000000000000000000000 P 118ae11af2d448cb986a695b7358cabb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:27:59.320004 1682 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 118ae11af2d448cb986a695b7358cabb [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:27:59.321382 1682 raft_consensus.cc:686] T 00000000000000000000000000000000 P 118ae11af2d448cb986a695b7358cabb [term 1 LEADER]: Becoming Leader. State: Replica: 118ae11af2d448cb986a695b7358cabb, State: Running, Role: LEADER
I20260809 05:27:59.322113 1682 consensus_queue.cc:237] T 00000000000000000000000000000000 P 118ae11af2d448cb986a695b7358cabb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118ae11af2d448cb986a695b7358cabb" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 38095 } }
I20260809 05:27:59.322584 1673 sys_catalog.cc:564] T 00000000000000000000000000000000 P 118ae11af2d448cb986a695b7358cabb [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:27:59.325577 1686 sys_catalog.cc:455] T 00000000000000000000000000000000 P 118ae11af2d448cb986a695b7358cabb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 118ae11af2d448cb986a695b7358cabb. Latest consensus state: current_term: 1 leader_uuid: "118ae11af2d448cb986a695b7358cabb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118ae11af2d448cb986a695b7358cabb" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 38095 } } }
I20260809 05:27:59.325634 1685 sys_catalog.cc:455] T 00000000000000000000000000000000 P 118ae11af2d448cb986a695b7358cabb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "118ae11af2d448cb986a695b7358cabb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118ae11af2d448cb986a695b7358cabb" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 38095 } } }
I20260809 05:27:59.325973 1686 sys_catalog.cc:458] T 00000000000000000000000000000000 P 118ae11af2d448cb986a695b7358cabb [sys.catalog]: This master's current role is: LEADER
I20260809 05:27:59.326097 1685 sys_catalog.cc:458] T 00000000000000000000000000000000 P 118ae11af2d448cb986a695b7358cabb [sys.catalog]: This master's current role is: LEADER
I20260809 05:27:59.328529 1694 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:27:59.335402 1694 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:27:59.345521 1694 catalog_manager.cc:1347] Generated new cluster ID: d2c79f67fdf6406892c4fb5fb4aca03e
I20260809 05:27:59.345664 1694 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:27:59.378778 1694 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:27:59.381108 1694 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:27:59.389741 1694 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 118ae11af2d448cb986a695b7358cabb: Generated new TSK 0
I20260809 05:27:59.390772 1694 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.185.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
I20260809 05:27:59.464335 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:0
--local_ip_for_outbound_sockets=127.26.185.1
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:38095
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:45075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:27:59.878096 1713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:27:59.878568 1713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:27:59.878767 1713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:27:59.886938 1713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:27:59.887214 1713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:27:59.887436 1713 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:27:59.898546 1713 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:45075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:38095
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:27:59.900550 1713 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:27:59.902326 1713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:27:59.917939 1723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:59.918094 1725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:27:59.918056 1722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:27:59.919332 1713 server_base.cc:1034] running on GCE node
I20260809 05:27:59.920079 1713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:27:59.921267 1713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:27:59.922525 1713 hybrid_clock.cc:648] HybridClock initialized: now 1786253279922467 us; error 54 us; skew 500 ppm
I20260809 05:27:59.922933 1713 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:27:59 dist-test-slave-h3ft krb5kdc[1549](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253279, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:27:59.926842 1713 init.cc:377] Logged in from keytab as kudu/127.26.185.1@KRBTEST.COM (short username kudu)
I20260809 05:27:59.928391 1713 fs_manager.cc:359] Metadata directory not provided
I20260809 05:27:59.928541 1713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:27:59.928933 1713 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:27:59.932811 1713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-0/data/instance:
uuid: "3b38afe2eb56414390ca7ecb0975ef5b"
format_stamp: "Formatted at 2026-08-09 05:27:59 on dist-test-slave-h3ft"
server_key: "b04026d51e89624ce31d5562d6c6b95f"
server_key_iv: "8b94bdb95846abfbe6871c66374d9908"
server_key_version: "encryptionkey@0"
I20260809 05:27:59.933866 1713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance:
uuid: "3b38afe2eb56414390ca7ecb0975ef5b"
format_stamp: "Formatted at 2026-08-09 05:27:59 on dist-test-slave-h3ft"
server_key: "b04026d51e89624ce31d5562d6c6b95f"
server_key_iv: "8b94bdb95846abfbe6871c66374d9908"
server_key_version: "encryptionkey@0"
I20260809 05:27:59.940135 1713 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260809 05:27:59.944319 1737 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:59.946048 1713 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 05:27:59.946278 1713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "3b38afe2eb56414390ca7ecb0975ef5b"
format_stamp: "Formatted at 2026-08-09 05:27:59 on dist-test-slave-h3ft"
server_key: "b04026d51e89624ce31d5562d6c6b95f"
server_key_iv: "8b94bdb95846abfbe6871c66374d9908"
server_key_version: "encryptionkey@0"
I20260809 05:27:59.946553 1713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:27:59.984045 1713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:27:59.989701 1713 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:27:59.990069 1713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:27:59.991386 1713 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:27:59.993110 1713 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:27:59.993245 1713 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:27:59.993405 1713 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:27:59.993502 1713 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:00.035581 1713 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:43889
I20260809 05:28:00.035638 1903 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:43889 every 8 connection(s)
I20260809 05:28:00.036744 1713 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:28:00.038919 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 1713
I20260809 05:28:00.039253 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance
I20260809 05:28:00.040032 27364 external_mini_cluster.cc:1428] Setting key 9a6a0cff34a34866c9377f48fcec9375
Aug 09 05:28:00 dist-test-slave-h3ft krb5kdc[1549](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253279, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:28:00.064323 1909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:00.040300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:33263 (local address 127.26.185.62:38095)
0809 05:28:00.040935 (+ 635us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:00.040941 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:00.042339 (+ 1398us) server_negotiation.cc:407] Connection header received
0809 05:28:00.044754 (+ 2415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:00.044761 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:00.044889 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:00.045038 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:00.047038 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:00.047876 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:00.049713 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:00.050161 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:00.050318 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:00.055619 (+ 5301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:00.055636 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:00.055642 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:00.055700 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:00.059554 (+ 3854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:00.060923 (+ 1369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:00.060928 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:00.060931 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:00.061110 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:00.061816 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:00.061820 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:00.061823 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:00.062238 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:00.062413 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:00.063703 (+ 1290us) server_negotiation.cc:299] Negotiation successful
0809 05:28:00.063986 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":279,"threads_started":1}
I20260809 05:28:00.066473 1910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:00.041185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:38095 (local address 127.26.185.1:33263)
0809 05:28:00.042147 (+ 962us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:00.042195 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:00.044388 (+ 2193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:00.045358 (+ 970us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:00.045370 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:00.046042 (+ 672us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:00.046791 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:00.046812 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:00.048065 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:00.048070 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:00.049520 (+ 1450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:00.049534 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:00.050458 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:00.050466 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:00.050766 (+ 300us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:00.051860 (+ 1094us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:00.051888 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:00.055192 (+ 3304us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:00.059820 (+ 4628us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:00.059837 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:00.059868 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:00.060743 (+ 875us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:00.061266 (+ 523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:00.061274 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:00.061281 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:00.061646 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:00.062401 (+ 755us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:00.062413 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:00.063135 (+ 722us) client_negotiation.cc:769] Sending connection context
0809 05:28:00.063578 (+ 443us) client_negotiation.cc:240] Negotiation successful
0809 05:28:00.064383 (+ 805us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":628,"thread_start_us":401,"threads_started":1}
I20260809 05:28:00.068825 1904 heartbeater.cc:347] Connected to a master server at 127.26.185.62:38095
I20260809 05:28:00.069300 1904 heartbeater.cc:464] Registering TS with master...
I20260809 05:28:00.070434 1904 heartbeater.cc:511] Master 127.26.185.62:38095 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.26.185.2@KRBTEST.COM; defaulting to no policy
I20260809 05:28:00.074014 1615 ts_manager.cc:194] Registered new tserver with Master: 3b38afe2eb56414390ca7ecb0975ef5b (127.26.185.1:43889)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.2@KRBTEST.COM" created.
I20260809 05:28:00.076723 1615 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.1@KRBTEST.COM'} at 127.26.185.1:33263
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
I20260809 05:28:00.110420 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:0
--local_ip_for_outbound_sockets=127.26.185.2
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:38095
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:45075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:28:00.520952 1914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:00.521404 1914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:00.521580 1914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:00.530107 1914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:00.530313 1914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:00.530652 1914 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:28:00.542658 1914 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:45075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:38095
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:00.544715 1914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:00.546545 1914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:00.562878 1922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:00.562819 1924 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:00.562878 1927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:00.564215 1914 server_base.cc:1034] running on GCE node
I20260809 05:28:00.565063 1914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:00.566362 1914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:00.567600 1914 hybrid_clock.cc:648] HybridClock initialized: now 1786253280567506 us; error 75 us; skew 500 ppm
I20260809 05:28:00.568068 1914 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:28:00 dist-test-slave-h3ft krb5kdc[1549](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253280, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:00.572249 1914 init.cc:377] Logged in from keytab as kudu/127.26.185.2@KRBTEST.COM (short username kudu)
I20260809 05:28:00.573856 1914 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:00.573974 1914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:00.574307 1914 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:28:00.578047 1914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-1/data/instance:
uuid: "70523a2b0ae24a579459f5da1c40d667"
format_stamp: "Formatted at 2026-08-09 05:28:00 on dist-test-slave-h3ft"
server_key: "044deff134542dd3a0734c1f9a2a1916"
server_key_iv: "a916540f2a143e9ef3fd003a794fe6b5"
server_key_version: "encryptionkey@0"
I20260809 05:28:00.578964 1914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance:
uuid: "70523a2b0ae24a579459f5da1c40d667"
format_stamp: "Formatted at 2026-08-09 05:28:00 on dist-test-slave-h3ft"
server_key: "044deff134542dd3a0734c1f9a2a1916"
server_key_iv: "a916540f2a143e9ef3fd003a794fe6b5"
server_key_version: "encryptionkey@0"
I20260809 05:28:00.585258 1914 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260809 05:28:00.589599 1938 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:00.591456 1914 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:28:00.591681 1914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "70523a2b0ae24a579459f5da1c40d667"
format_stamp: "Formatted at 2026-08-09 05:28:00 on dist-test-slave-h3ft"
server_key: "044deff134542dd3a0734c1f9a2a1916"
server_key_iv: "a916540f2a143e9ef3fd003a794fe6b5"
server_key_version: "encryptionkey@0"
I20260809 05:28:00.592001 1914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:00.615612 1914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:00.621034 1914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:00.621381 1914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:00.622540 1914 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:28:00.624281 1914 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:28:00.624382 1914 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:00.624470 1914 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:28:00.624533 1914 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:00.665295 1914 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:37707
I20260809 05:28:00.665334 2136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:37707 every 8 connection(s)
I20260809 05:28:00.666429 1914 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:28:00.672860 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 1914
I20260809 05:28:00.673126 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance
I20260809 05:28:00.673772 27364 external_mini_cluster.cc:1428] Setting key 2e67c5db1e7e07f98a596635b000333c
Aug 09 05:28:00 dist-test-slave-h3ft krb5kdc[1549](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253280, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:28:00.694181 2141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:00.669613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:57777 (local address 127.26.185.62:38095)
0809 05:28:00.670330 (+ 717us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:00.670335 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:00.671447 (+ 1112us) server_negotiation.cc:407] Connection header received
0809 05:28:00.674326 (+ 2879us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:00.674332 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:00.674454 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:00.674630 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:00.676934 (+ 2304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:00.677770 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:00.680598 (+ 2828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:00.681130 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:00.681243 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:00.686652 (+ 5409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:00.686658 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:00.686662 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:00.686703 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:00.690422 (+ 3719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:00.691416 (+ 994us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:00.691421 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:00.691424 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:00.691568 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:00.692081 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:00.692085 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:00.692087 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:00.692423 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:00.692615 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:00.693457 (+ 842us) server_negotiation.cc:299] Negotiation successful
0809 05:28:00.693736 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":577,"thread_start_us":449,"threads_started":1}
I20260809 05:28:00.695603 2144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:00.670323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:38095 (local address 127.26.185.2:57777)
0809 05:28:00.671224 (+ 901us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:00.671280 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:00.673906 (+ 2626us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:00.675008 (+ 1102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:00.675025 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:00.675775 (+ 750us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:00.676690 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:00.676719 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:00.677952 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:00.677960 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:00.680409 (+ 2449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:00.680429 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:00.681419 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:00.681431 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:00.681785 (+ 354us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:00.682763 (+ 978us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:00.682801 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:00.686311 (+ 3510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:00.690580 (+ 4269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:00.690588 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:00.690609 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:00.691235 (+ 626us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:00.691694 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:00.691699 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:00.691705 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:00.691937 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:00.692573 (+ 636us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:00.692595 (+ 22us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:00.693029 (+ 434us) client_negotiation.cc:769] Sending connection context
0809 05:28:00.693357 (+ 328us) client_negotiation.cc:240] Negotiation successful
0809 05:28:00.694049 (+ 692us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":336,"threads_started":1}
I20260809 05:28:00.697666 2138 heartbeater.cc:347] Connected to a master server at 127.26.185.62:38095
I20260809 05:28:00.698109 2138 heartbeater.cc:464] Registering TS with master...
I20260809 05:28:00.698982 2138 heartbeater.cc:511] Master 127.26.185.62:38095 requested a full tablet report, sending...
I20260809 05:28:00.700999 1615 ts_manager.cc:194] Registered new tserver with Master: 70523a2b0ae24a579459f5da1c40d667 (127.26.185.2:37707)
I20260809 05:28:00.701987 1615 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.2@KRBTEST.COM'} at 127.26.185.2:57777
WARNING: no policy specified for kudu/127.26.185.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
I20260809 05:28:00.749156 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:0
--local_ip_for_outbound_sockets=127.26.185.3
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:38095
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:45075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:28:01.082249 1904 heartbeater.cc:503] Master 127.26.185.62:38095 was elected leader, sending a full tablet report...
W20260809 05:28:01.176024 2149 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:01.176417 2149 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:01.176599 2149 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:01.185060 2149 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:01.185214 2149 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:01.185418 2149 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:28:01.196861 2149 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:45075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:38095
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:01.198756 2149 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:01.200518 2149 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:01.217073 2164 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:01.217162 2160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:01.217180 2161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:01.218238 2149 server_base.cc:1034] running on GCE node
I20260809 05:28:01.219080 2149 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:01.220350 2149 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:01.221634 2149 hybrid_clock.cc:648] HybridClock initialized: now 1786253281221534 us; error 70 us; skew 500 ppm
I20260809 05:28:01.222136 2149 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:28:01 dist-test-slave-h3ft krb5kdc[1549](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253281, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:01.226300 2149 init.cc:377] Logged in from keytab as kudu/127.26.185.3@KRBTEST.COM (short username kudu)
I20260809 05:28:01.227795 2149 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:01.227954 2149 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:01.228343 2149 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:28:01.232244 2149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-2/data/instance:
uuid: "b7cf7b5b09d646548e958f71314ffb29"
format_stamp: "Formatted at 2026-08-09 05:28:01 on dist-test-slave-h3ft"
server_key: "bcbab42f41d25279afb66dc03b034e28"
server_key_iv: "a6a49848e23d4d79910b3a925b985049"
server_key_version: "encryptionkey@0"
I20260809 05:28:01.233225 2149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance:
uuid: "b7cf7b5b09d646548e958f71314ffb29"
format_stamp: "Formatted at 2026-08-09 05:28:01 on dist-test-slave-h3ft"
server_key: "bcbab42f41d25279afb66dc03b034e28"
server_key_iv: "a6a49848e23d4d79910b3a925b985049"
server_key_version: "encryptionkey@0"
I20260809 05:28:01.239761 2149 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260809 05:28:01.244349 2174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:01.246105 2149 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260809 05:28:01.246337 2149 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "b7cf7b5b09d646548e958f71314ffb29"
format_stamp: "Formatted at 2026-08-09 05:28:01 on dist-test-slave-h3ft"
server_key: "bcbab42f41d25279afb66dc03b034e28"
server_key_iv: "a6a49848e23d4d79910b3a925b985049"
server_key_version: "encryptionkey@0"
I20260809 05:28:01.246623 2149 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:01.286870 2149 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:01.292297 2149 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:01.292693 2149 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:01.294005 2149 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:28:01.295758 2149 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:28:01.295898 2149 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:01.296041 2149 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:28:01.296141 2149 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:01.337206 2149 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:35111
I20260809 05:28:01.337265 2356 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:35111 every 8 connection(s)
I20260809 05:28:01.338311 2149 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:28:01.344686 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 2149
I20260809 05:28:01.344976 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance
I20260809 05:28:01.345681 27364 external_mini_cluster.cc:1428] Setting key 96909e056bf87853859c47ea11296402
Aug 09 05:28:01 dist-test-slave-h3ft krb5kdc[1549](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253281, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:28:01.365075 2360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:01.341482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:39447 (local address 127.26.185.62:38095)
0809 05:28:01.342035 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:01.342041 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:01.343324 (+ 1283us) server_negotiation.cc:407] Connection header received
0809 05:28:01.346332 (+ 3008us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:01.346338 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:01.346473 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:01.346638 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:01.349404 (+ 2766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.350390 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.352338 (+ 1948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.352818 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.352923 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:01.357280 (+ 4357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:01.357286 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:01.357290 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:01.357332 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:01.360823 (+ 3491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:01.362138 (+ 1315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:01.362143 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:01.362146 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:01.362359 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:01.362978 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:01.362982 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:01.362985 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:01.363467 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:01.363596 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:01.364514 (+ 918us) server_negotiation.cc:299] Negotiation successful
0809 05:28:01.364738 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":270,"threads_started":1}
I20260809 05:28:01.366442 2363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:01.342214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:38095 (local address 127.26.185.3:39447)
0809 05:28:01.343131 (+ 917us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:01.343181 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:01.345930 (+ 2749us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:01.347351 (+ 1421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:01.347363 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:01.348383 (+ 1020us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:01.349193 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:01.349215 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.350546 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.350551 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:01.352173 (+ 1622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:01.352187 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.353025 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.353030 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:01.353242 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:01.354082 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:01.354110 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:01.356960 (+ 2850us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:01.361034 (+ 4074us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:01.361048 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:01.361074 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:01.361968 (+ 894us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:01.362500 (+ 532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:01.362507 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:01.362511 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:01.362822 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:01.363633 (+ 811us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:01.363642 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:01.364092 (+ 450us) client_negotiation.cc:769] Sending connection context
0809 05:28:01.364428 (+ 336us) client_negotiation.cc:240] Negotiation successful
0809 05:28:01.364965 (+ 537us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":336,"threads_started":1}
I20260809 05:28:01.368117 2358 heartbeater.cc:347] Connected to a master server at 127.26.185.62:38095
I20260809 05:28:01.368548 2358 heartbeater.cc:464] Registering TS with master...
I20260809 05:28:01.369445 2358 heartbeater.cc:511] Master 127.26.185.62:38095 requested a full tablet report, sending...
I20260809 05:28:01.371238 1615 ts_manager.cc:194] Registered new tserver with Master: b7cf7b5b09d646548e958f71314ffb29 (127.26.185.3:35111)
I20260809 05:28:01.372221 1615 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.3@KRBTEST.COM'} at 127.26.185.3:39447
I20260809 05:28:01.376329 27364 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 05:28:01.396744 2360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:01.381955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34756 (local address 127.26.185.62:38095)
0809 05:28:01.382197 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:01.382206 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:01.382765 (+ 559us) server_negotiation.cc:407] Connection header received
0809 05:28:01.382928 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:01.382932 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:01.383089 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:01.383180 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:01.384871 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.385683 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.387204 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.387642 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.387742 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:01.390584 (+ 2842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:01.390590 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:01.390593 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:01.390630 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:01.393623 (+ 2993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:01.394432 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:01.394436 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:01.394439 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:01.394572 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:01.395113 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:01.395117 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:01.395119 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:01.395512 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:01.395711 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:01.396093 (+ 382us) server_negotiation.cc:299] Negotiation successful
0809 05:28:01.396385 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 05:28:01.402158 1615 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34756:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 05:28:01.410071 1615 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 05:28:01.438638 2379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:01.427513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41374 (local address 127.26.185.1:43889)
0809 05:28:01.429679 (+ 2166us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:01.429687 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:01.429715 (+ 28us) server_negotiation.cc:407] Connection header received
0809 05:28:01.429871 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:01.429882 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:01.430358 (+ 476us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:01.430598 (+ 240us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:28:01.431454 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.433219 (+ 1765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.435655 (+ 2436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.437277 (+ 1622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.437437 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:01.437734 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:01.438022 (+ 288us) server_negotiation.cc:299] Negotiation successful
0809 05:28:01.438217 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1989,"thread_start_us":1814,"threads_started":1}
I20260809 05:28:01.438694 2378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:01.427320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:43889 (local address 127.0.0.1:41374)
0809 05:28:01.428464 (+ 1144us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:01.428544 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:01.428853 (+ 309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:01.430604 (+ 1751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:01.430614 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:01.430645 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:28:01.431201 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:01.431226 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.433368 (+ 2142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.433376 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:01.435433 (+ 2057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:01.435455 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.437496 (+ 2041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.437502 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:01.437717 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:01.437790 (+ 73us) client_negotiation.cc:769] Sending connection context
0809 05:28:01.437951 (+ 161us) client_negotiation.cc:240] Negotiation successful
0809 05:28:01.438174 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":740,"mutex_wait_us":1,"thread_start_us":495,"threads_started":1}
I20260809 05:28:01.440784 2384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:01.429546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:37707 (local address 127.0.0.1:47222)
0809 05:28:01.430128 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:01.430146 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:01.430262 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:01.432282 (+ 2020us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:01.432287 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:01.432314 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:28:01.432696 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:01.432708 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.434914 (+ 2206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.434921 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:01.437505 (+ 2584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:01.437525 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.439787 (+ 2262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.439793 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:01.439963 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:01.439997 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 05:28:01.440090 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 05:28:01.440245 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"mutex_wait_us":7,"thread_start_us":1267,"threads_started":1}
I20260809 05:28:01.441368 2382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:01.428302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:35111 (local address 127.0.0.1:40532)
0809 05:28:01.429211 (+ 909us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:01.429278 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:01.429434 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:01.431530 (+ 2096us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:01.431535 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:01.431567 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:28:01.432195 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:01.432211 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.434602 (+ 2391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.434608 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:01.437035 (+ 2427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:01.437054 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.440195 (+ 3141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.440204 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:01.440454 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:01.440496 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 05:28:01.440609 (+ 113us) client_negotiation.cc:240] Negotiation successful
0809 05:28:01.440800 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":749,"mutex_wait_us":35,"thread_start_us":742,"threads_started":1}
I20260809 05:28:01.441998 2385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:01.430341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47222 (local address 127.26.185.2:37707)
0809 05:28:01.431404 (+ 1063us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:01.431414 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:01.431442 (+ 28us) server_negotiation.cc:407] Connection header received
0809 05:28:01.431553 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:01.431561 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:01.431794 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:01.431998 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:28:01.432913 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.434721 (+ 1808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.437759 (+ 3038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.439550 (+ 1791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.439732 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:01.439982 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:01.441419 (+ 1437us) server_negotiation.cc:299] Negotiation successful
0809 05:28:01.441605 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":828,"thread_start_us":876,"threads_started":1}
I20260809 05:28:01.442049 2381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:01.427823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40532 (local address 127.26.185.3:35111)
0809 05:28:01.430263 (+ 2440us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:01.430276 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:01.430384 (+ 108us) server_negotiation.cc:407] Connection header received
0809 05:28:01.430529 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:01.430543 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:01.430820 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:01.431118 (+ 298us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:28:01.432497 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.434429 (+ 1932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.437237 (+ 2808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.439211 (+ 1974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.439398 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:01.439705 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:01.441270 (+ 1565us) server_negotiation.cc:299] Negotiation successful
0809 05:28:01.441544 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2123,"thread_start_us":2750,"threads_started":1}
I20260809 05:28:01.444231 1807 tablet_service.cc:1467] Processing CreateTablet for tablet e3591723fda948f79a7b6b43ace729b2 (DEFAULT_TABLE table=test-table [id=6ea91765830b432bb48c21a6b1229453]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:28:01.446079 1807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3591723fda948f79a7b6b43ace729b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:01.446020 2017 tablet_service.cc:1467] Processing CreateTablet for tablet e3591723fda948f79a7b6b43ace729b2 (DEFAULT_TABLE table=test-table [id=6ea91765830b432bb48c21a6b1229453]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:28:01.447934 2017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3591723fda948f79a7b6b43ace729b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:01.448280 2251 tablet_service.cc:1467] Processing CreateTablet for tablet e3591723fda948f79a7b6b43ace729b2 (DEFAULT_TABLE table=test-table [id=6ea91765830b432bb48c21a6b1229453]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:28:01.450089 2251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3591723fda948f79a7b6b43ace729b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:01.461826 2386 tablet_bootstrap.cc:492] T e3591723fda948f79a7b6b43ace729b2 P 3b38afe2eb56414390ca7ecb0975ef5b: Bootstrap starting.
I20260809 05:28:01.466127 2386 tablet_bootstrap.cc:654] T e3591723fda948f79a7b6b43ace729b2 P 3b38afe2eb56414390ca7ecb0975ef5b: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:01.467770 2386 log.cc:824] T e3591723fda948f79a7b6b43ace729b2 P 3b38afe2eb56414390ca7ecb0975ef5b: Log is configured to *not* fsync() on all Append() calls
I20260809 05:28:01.468055 2388 tablet_bootstrap.cc:492] T e3591723fda948f79a7b6b43ace729b2 P 70523a2b0ae24a579459f5da1c40d667: Bootstrap starting.
I20260809 05:28:01.472671 2390 tablet_bootstrap.cc:492] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29: Bootstrap starting.
I20260809 05:28:01.473533 2388 tablet_bootstrap.cc:654] T e3591723fda948f79a7b6b43ace729b2 P 70523a2b0ae24a579459f5da1c40d667: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:01.475217 2388 log.cc:824] T e3591723fda948f79a7b6b43ace729b2 P 70523a2b0ae24a579459f5da1c40d667: Log is configured to *not* fsync() on all Append() calls
I20260809 05:28:01.475397 2386 tablet_bootstrap.cc:492] T e3591723fda948f79a7b6b43ace729b2 P 3b38afe2eb56414390ca7ecb0975ef5b: No bootstrap required, opened a new log
I20260809 05:28:01.475827 2386 ts_tablet_manager.cc:1397] T e3591723fda948f79a7b6b43ace729b2 P 3b38afe2eb56414390ca7ecb0975ef5b: Time spent bootstrapping tablet: real 0.014s user 0.012s sys 0.000s
I20260809 05:28:01.478120 2390 tablet_bootstrap.cc:654] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:01.479419 2388 tablet_bootstrap.cc:492] T e3591723fda948f79a7b6b43ace729b2 P 70523a2b0ae24a579459f5da1c40d667: No bootstrap required, opened a new log
I20260809 05:28:01.479764 2388 ts_tablet_manager.cc:1397] T e3591723fda948f79a7b6b43ace729b2 P 70523a2b0ae24a579459f5da1c40d667: Time spent bootstrapping tablet: real 0.012s user 0.011s sys 0.000s
I20260809 05:28:01.480048 2390 log.cc:824] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29: Log is configured to *not* fsync() on all Append() calls
I20260809 05:28:01.487372 2390 tablet_bootstrap.cc:492] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29: No bootstrap required, opened a new log
I20260809 05:28:01.487821 2390 ts_tablet_manager.cc:1397] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29: Time spent bootstrapping tablet: real 0.016s user 0.013s sys 0.000s
I20260809 05:28:01.487936 2386 raft_consensus.cc:348] T e3591723fda948f79a7b6b43ace729b2 P 3b38afe2eb56414390ca7ecb0975ef5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b38afe2eb56414390ca7ecb0975ef5b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43889 } } peers { permanent_uuid: "b7cf7b5b09d646548e958f71314ffb29" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 35111 } } peers { permanent_uuid: "70523a2b0ae24a579459f5da1c40d667" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 37707 } }
I20260809 05:28:01.488546 2386 raft_consensus.cc:374] T e3591723fda948f79a7b6b43ace729b2 P 3b38afe2eb56414390ca7ecb0975ef5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:01.488667 2386 raft_consensus.cc:729] T e3591723fda948f79a7b6b43ace729b2 P 3b38afe2eb56414390ca7ecb0975ef5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b38afe2eb56414390ca7ecb0975ef5b, State: Initialized, Role: FOLLOWER
I20260809 05:28:01.489521 2386 consensus_queue.cc:260] T e3591723fda948f79a7b6b43ace729b2 P 3b38afe2eb56414390ca7ecb0975ef5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b38afe2eb56414390ca7ecb0975ef5b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43889 } } peers { permanent_uuid: "b7cf7b5b09d646548e958f71314ffb29" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 35111 } } peers { permanent_uuid: "70523a2b0ae24a579459f5da1c40d667" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 37707 } }
I20260809 05:28:01.492055 2386 ts_tablet_manager.cc:1428] T e3591723fda948f79a7b6b43ace729b2 P 3b38afe2eb56414390ca7ecb0975ef5b: Time spent starting tablet: real 0.016s user 0.015s sys 0.000s
I20260809 05:28:01.491619 2388 raft_consensus.cc:348] T e3591723fda948f79a7b6b43ace729b2 P 70523a2b0ae24a579459f5da1c40d667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b38afe2eb56414390ca7ecb0975ef5b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43889 } } peers { permanent_uuid: "b7cf7b5b09d646548e958f71314ffb29" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 35111 } } peers { permanent_uuid: "70523a2b0ae24a579459f5da1c40d667" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 37707 } }
I20260809 05:28:01.492234 2388 raft_consensus.cc:374] T e3591723fda948f79a7b6b43ace729b2 P 70523a2b0ae24a579459f5da1c40d667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:01.492354 2388 raft_consensus.cc:729] T e3591723fda948f79a7b6b43ace729b2 P 70523a2b0ae24a579459f5da1c40d667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70523a2b0ae24a579459f5da1c40d667, State: Initialized, Role: FOLLOWER
I20260809 05:28:01.493120 2388 consensus_queue.cc:260] T e3591723fda948f79a7b6b43ace729b2 P 70523a2b0ae24a579459f5da1c40d667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b38afe2eb56414390ca7ecb0975ef5b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43889 } } peers { permanent_uuid: "b7cf7b5b09d646548e958f71314ffb29" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 35111 } } peers { permanent_uuid: "70523a2b0ae24a579459f5da1c40d667" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 37707 } }
I20260809 05:28:01.494658 2138 heartbeater.cc:503] Master 127.26.185.62:38095 was elected leader, sending a full tablet report...
I20260809 05:28:01.495481 2388 ts_tablet_manager.cc:1428] T e3591723fda948f79a7b6b43ace729b2 P 70523a2b0ae24a579459f5da1c40d667: Time spent starting tablet: real 0.016s user 0.016s sys 0.000s
I20260809 05:28:01.503127 2390 raft_consensus.cc:348] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b38afe2eb56414390ca7ecb0975ef5b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43889 } } peers { permanent_uuid: "b7cf7b5b09d646548e958f71314ffb29" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 35111 } } peers { permanent_uuid: "70523a2b0ae24a579459f5da1c40d667" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 37707 } }
I20260809 05:28:01.503746 2390 raft_consensus.cc:374] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:01.503880 2390 raft_consensus.cc:729] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7cf7b5b09d646548e958f71314ffb29, State: Initialized, Role: FOLLOWER
I20260809 05:28:01.504720 2390 consensus_queue.cc:260] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b38afe2eb56414390ca7ecb0975ef5b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43889 } } peers { permanent_uuid: "b7cf7b5b09d646548e958f71314ffb29" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 35111 } } peers { permanent_uuid: "70523a2b0ae24a579459f5da1c40d667" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 37707 } }
I20260809 05:28:01.506184 2358 heartbeater.cc:503] Master 127.26.185.62:38095 was elected leader, sending a full tablet report...
I20260809 05:28:01.507233 2390 ts_tablet_manager.cc:1428] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29: Time spent starting tablet: real 0.019s user 0.013s sys 0.004s
W20260809 05:28:01.540067 1908 tablet.cc:2369] T e3591723fda948f79a7b6b43ace729b2 P 3b38afe2eb56414390ca7ecb0975ef5b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 05:28:01.590200 2359 tablet.cc:2369] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:28:01.591264 2397 raft_consensus.cc:482] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:28:01.591589 2397 raft_consensus.cc:504] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b38afe2eb56414390ca7ecb0975ef5b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43889 } } peers { permanent_uuid: "b7cf7b5b09d646548e958f71314ffb29" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 35111 } } peers { permanent_uuid: "70523a2b0ae24a579459f5da1c40d667" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 37707 } }
I20260809 05:28:01.593696 2397 leader_election.cc:288] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b38afe2eb56414390ca7ecb0975ef5b (127.26.185.1:43889), 70523a2b0ae24a579459f5da1c40d667 (127.26.185.2:37707)
I20260809 05:28:01.601161 2385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:01.594689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:41579 (local address 127.26.185.2:37707)
0809 05:28:01.594986 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:01.594991 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:01.595062 (+ 71us) server_negotiation.cc:407] Connection header received
0809 05:28:01.595155 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:01.595160 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:01.595235 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:01.595357 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:28:01.595926 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.596801 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.598799 (+ 1998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.600027 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.600215 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:01.600310 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:01.600660 (+ 350us) server_negotiation.cc:299] Negotiation successful
0809 05:28:01.600815 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260809 05:28:01.601182 2363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:01.594114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:37707 (local address 127.26.185.3:41579)
0809 05:28:01.594464 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:01.594491 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:01.594665 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:01.595389 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:01.595403 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:01.595468 (+ 65us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:28:01.595698 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:01.595707 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.596962 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.596972 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:01.598608 (+ 1636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:01.598622 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.600215 (+ 1593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.600221 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:01.600455 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:01.600490 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 05:28:01.600629 (+ 139us) client_negotiation.cc:240] Negotiation successful
0809 05:28:01.600802 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"spinlock_wait_cycles":47872}
I20260809 05:28:01.601341 2379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:01.594277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:47615 (local address 127.26.185.1:43889)
0809 05:28:01.594586 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:01.594597 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:01.595395 (+ 798us) server_negotiation.cc:407] Connection header received
0809 05:28:01.595637 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:01.595641 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:01.595716 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:01.595835 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:28:01.596590 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.597523 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.599477 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.600279 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.600483 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:01.600565 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:01.600884 (+ 319us) server_negotiation.cc:299] Negotiation successful
0809 05:28:01.601030 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116}
I20260809 05:28:01.601454 2398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:01.594256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:43889 (local address 127.26.185.3:47615)
0809 05:28:01.595252 (+ 996us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:01.595268 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:01.595455 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:01.595846 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:01.595851 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:01.595875 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:28:01.596375 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:01.596386 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.597680 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.597686 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:01.599293 (+ 1607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:01.599311 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.600517 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.600524 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:01.600708 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:01.600733 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 05:28:01.600844 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 05:28:01.600975 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":881,"thread_start_us":623,"threads_started":1}
I20260809 05:28:01.602795 1836 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3591723fda948f79a7b6b43ace729b2" candidate_uuid: "b7cf7b5b09d646548e958f71314ffb29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b38afe2eb56414390ca7ecb0975ef5b" is_pre_election: true
I20260809 05:28:01.602856 2055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3591723fda948f79a7b6b43ace729b2" candidate_uuid: "b7cf7b5b09d646548e958f71314ffb29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70523a2b0ae24a579459f5da1c40d667" is_pre_election: true
I20260809 05:28:01.603518 1836 raft_consensus.cc:2454] T e3591723fda948f79a7b6b43ace729b2 P 3b38afe2eb56414390ca7ecb0975ef5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7cf7b5b09d646548e958f71314ffb29 in term 0.
I20260809 05:28:01.603519 2055 raft_consensus.cc:2454] T e3591723fda948f79a7b6b43ace729b2 P 70523a2b0ae24a579459f5da1c40d667 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7cf7b5b09d646548e958f71314ffb29 in term 0.
I20260809 05:28:01.604355 2178 leader_election.cc:302] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3b38afe2eb56414390ca7ecb0975ef5b, 70523a2b0ae24a579459f5da1c40d667, b7cf7b5b09d646548e958f71314ffb29; no voters:
I20260809 05:28:01.604882 2397 raft_consensus.cc:2781] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:28:01.605083 2397 raft_consensus.cc:482] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:28:01.605218 2397 raft_consensus.cc:3037] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:01.608031 2397 raft_consensus.cc:504] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b38afe2eb56414390ca7ecb0975ef5b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43889 } } peers { permanent_uuid: "b7cf7b5b09d646548e958f71314ffb29" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 35111 } } peers { permanent_uuid: "70523a2b0ae24a579459f5da1c40d667" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 37707 } }
I20260809 05:28:01.608821 2397 leader_election.cc:288] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29 [CANDIDATE]: Term 1 election: Requested vote from peers 3b38afe2eb56414390ca7ecb0975ef5b (127.26.185.1:43889), 70523a2b0ae24a579459f5da1c40d667 (127.26.185.2:37707)
I20260809 05:28:01.609404 1836 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3591723fda948f79a7b6b43ace729b2" candidate_uuid: "b7cf7b5b09d646548e958f71314ffb29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b38afe2eb56414390ca7ecb0975ef5b"
I20260809 05:28:01.609450 2055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3591723fda948f79a7b6b43ace729b2" candidate_uuid: "b7cf7b5b09d646548e958f71314ffb29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70523a2b0ae24a579459f5da1c40d667"
I20260809 05:28:01.609660 1836 raft_consensus.cc:3037] T e3591723fda948f79a7b6b43ace729b2 P 3b38afe2eb56414390ca7ecb0975ef5b [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:01.609719 2055 raft_consensus.cc:3037] T e3591723fda948f79a7b6b43ace729b2 P 70523a2b0ae24a579459f5da1c40d667 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:01.612349 1836 raft_consensus.cc:2454] T e3591723fda948f79a7b6b43ace729b2 P 3b38afe2eb56414390ca7ecb0975ef5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7cf7b5b09d646548e958f71314ffb29 in term 1.
I20260809 05:28:01.612764 2055 raft_consensus.cc:2454] T e3591723fda948f79a7b6b43ace729b2 P 70523a2b0ae24a579459f5da1c40d667 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7cf7b5b09d646548e958f71314ffb29 in term 1.
I20260809 05:28:01.612900 2178 leader_election.cc:302] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b38afe2eb56414390ca7ecb0975ef5b, b7cf7b5b09d646548e958f71314ffb29; no voters:
I20260809 05:28:01.613323 2397 raft_consensus.cc:2781] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:28:01.613857 2397 raft_consensus.cc:686] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29 [term 1 LEADER]: Becoming Leader. State: Replica: b7cf7b5b09d646548e958f71314ffb29, State: Running, Role: LEADER
I20260809 05:28:01.614496 2397 consensus_queue.cc:237] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b38afe2eb56414390ca7ecb0975ef5b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43889 } } peers { permanent_uuid: "b7cf7b5b09d646548e958f71314ffb29" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 35111 } } peers { permanent_uuid: "70523a2b0ae24a579459f5da1c40d667" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 37707 } }
I20260809 05:28:01.620358 1613 catalog_manager.cc:5495] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7cf7b5b09d646548e958f71314ffb29 (127.26.185.3). New cstate: current_term: 1 leader_uuid: "b7cf7b5b09d646548e958f71314ffb29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b38afe2eb56414390ca7ecb0975ef5b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7cf7b5b09d646548e958f71314ffb29" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 35111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70523a2b0ae24a579459f5da1c40d667" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 37707 } health_report { overall_health: UNKNOWN } } }
I20260809 05:28:01.644330 2381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:01.637755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40548 (local address 127.26.185.3:35111)
0809 05:28:01.638118 (+ 363us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:01.638124 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:01.638148 (+ 24us) server_negotiation.cc:407] Connection header received
0809 05:28:01.638319 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:01.638324 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:01.638446 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:01.638627 (+ 181us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:28:01.639085 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.640000 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.641415 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.641924 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.642042 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:01.642721 (+ 679us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:28:01.643580 (+ 859us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:28:01.643736 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:01.643948 (+ 212us) server_negotiation.cc:299] Negotiation successful
0809 05:28:01.644054 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183}
I20260809 05:28:01.655685 1836 raft_consensus.cc:1261] T e3591723fda948f79a7b6b43ace729b2 P 3b38afe2eb56414390ca7ecb0975ef5b [term 1 FOLLOWER]: Refusing update from remote peer b7cf7b5b09d646548e958f71314ffb29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:28:01.655685 2055 raft_consensus.cc:1261] T e3591723fda948f79a7b6b43ace729b2 P 70523a2b0ae24a579459f5da1c40d667 [term 1 FOLLOWER]: Refusing update from remote peer b7cf7b5b09d646548e958f71314ffb29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:28:01.657092 2397 consensus_queue.cc:1035] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70523a2b0ae24a579459f5da1c40d667" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:28:01.657538 2400 consensus_queue.cc:1035] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b38afe2eb56414390ca7ecb0975ef5b" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 05:28:01.670118 2139 tablet.cc:2369] T e3591723fda948f79a7b6b43ace729b2 P 70523a2b0ae24a579459f5da1c40d667: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:28:01.676334 2404 mvcc.cc:205] Tried to move back new op lower bound from 7316493441647951872 to 7316493441497800704. Current Snapshot: MvccSnapshot[applied={T|T < 7316493441647951872}]
I20260809 05:28:01.685746 2405 mvcc.cc:205] Tried to move back new op lower bound from 7316493441647951872 to 7316493441497800704. Current Snapshot: MvccSnapshot[applied={T|T < 7316493441647951872}]
I20260809 05:28:01.700732 1613 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34756:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:28:01.701196 1613 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34756:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:28:01.706758 1613 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 118ae11af2d448cb986a695b7358cabb: Sending DeleteTablet for 3 replicas of tablet e3591723fda948f79a7b6b43ace729b2
I20260809 05:28:01.708590 1807 tablet_service.cc:1514] Processing DeleteTablet for tablet e3591723fda948f79a7b6b43ace729b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:28:01 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:41374
I20260809 05:28:01.708665 2017 tablet_service.cc:1514] Processing DeleteTablet for tablet e3591723fda948f79a7b6b43ace729b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:28:01 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:47222
I20260809 05:28:01.709087 2251 tablet_service.cc:1514] Processing DeleteTablet for tablet e3591723fda948f79a7b6b43ace729b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:28:01 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:40532
I20260809 05:28:01.711876 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 1713
I20260809 05:28:01.734545 2421 tablet_replica.cc:330] T e3591723fda948f79a7b6b43ace729b2 P 3b38afe2eb56414390ca7ecb0975ef5b: stopping tablet replica
I20260809 05:28:01.735512 2421 raft_consensus.cc:2229] T e3591723fda948f79a7b6b43ace729b2 P 3b38afe2eb56414390ca7ecb0975ef5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:28:01.738706 2421 raft_consensus.cc:2258] T e3591723fda948f79a7b6b43ace729b2 P 3b38afe2eb56414390ca7ecb0975ef5b [term 1 FOLLOWER]: Raft consensus is shut down!
Aug 09 05:28:01 dist-test-slave-h3ft krb5kdc[1549](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253278, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.1@KRBTEST.COM
I20260809 05:28:01.744561 2422 tablet_replica.cc:330] T e3591723fda948f79a7b6b43ace729b2 P 70523a2b0ae24a579459f5da1c40d667: stopping tablet replica
I20260809 05:28:01.744925 2424 tablet_replica.cc:330] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29: stopping tablet replica
I20260809 05:28:01.745266 2422 raft_consensus.cc:2229] T e3591723fda948f79a7b6b43ace729b2 P 70523a2b0ae24a579459f5da1c40d667 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:28:01.745389 2424 raft_consensus.cc:2229] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29 [term 1 LEADER]: Raft consensus shutting down.
I20260809 05:28:01.746053 2422 raft_consensus.cc:2258] T e3591723fda948f79a7b6b43ace729b2 P 70523a2b0ae24a579459f5da1c40d667 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:28:01.746179 2424 raft_consensus.cc:2258] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:28:01.749796 2421 ts_tablet_manager.cc:1905] T e3591723fda948f79a7b6b43ace729b2 P 3b38afe2eb56414390ca7ecb0975ef5b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:28:01.750103 2422 ts_tablet_manager.cc:1905] T e3591723fda948f79a7b6b43ace729b2 P 70523a2b0ae24a579459f5da1c40d667: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:28:01.758646 2422 ts_tablet_manager.cc:1918] T e3591723fda948f79a7b6b43ace729b2 P 70523a2b0ae24a579459f5da1c40d667: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:28:01.758646 2421 ts_tablet_manager.cc:1918] T e3591723fda948f79a7b6b43ace729b2 P 3b38afe2eb56414390ca7ecb0975ef5b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:28:01.758948 2422 log.cc:1196] T e3591723fda948f79a7b6b43ace729b2 P 70523a2b0ae24a579459f5da1c40d667: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-1/wal/wals/e3591723fda948f79a7b6b43ace729b2
I20260809 05:28:01.759508 2421 log.cc:1196] T e3591723fda948f79a7b6b43ace729b2 P 3b38afe2eb56414390ca7ecb0975ef5b: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-0/wal/wals/e3591723fda948f79a7b6b43ace729b2
I20260809 05:28:01.759697 2422 ts_tablet_manager.cc:1939] T e3591723fda948f79a7b6b43ace729b2 P 70523a2b0ae24a579459f5da1c40d667: Deleting consensus metadata
I20260809 05:28:01.759663 2424 ts_tablet_manager.cc:1905] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:28:01.760253 2421 ts_tablet_manager.cc:1939] T e3591723fda948f79a7b6b43ace729b2 P 3b38afe2eb56414390ca7ecb0975ef5b: Deleting consensus metadata
I20260809 05:28:01.762320 1592 catalog_manager.cc:4841] TS 3b38afe2eb56414390ca7ecb0975ef5b (127.26.185.1:43889): tablet e3591723fda948f79a7b6b43ace729b2 (table test-table [id=6ea91765830b432bb48c21a6b1229453]) successfully deleted
I20260809 05:28:01.762290 1591 catalog_manager.cc:4841] TS 70523a2b0ae24a579459f5da1c40d667 (127.26.185.2:37707): tablet e3591723fda948f79a7b6b43ace729b2 (table test-table [id=6ea91765830b432bb48c21a6b1229453]) successfully deleted
I20260809 05:28:01.763144 2379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:01.714272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41386 (local address 127.26.185.1:43889)
0809 05:28:01.714501 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:01.714508 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:01.725876 (+ 11368us) server_negotiation.cc:407] Connection header received
0809 05:28:01.726630 (+ 754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:01.726641 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:01.726849 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:01.726972 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:01.729849 (+ 2877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.731650 (+ 1801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.735926 (+ 4276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.736668 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.736791 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:01.748375 (+ 11584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:01.748395 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:01.748419 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:01.748492 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:01.754284 (+ 5792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:01.755711 (+ 1427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:01.755724 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:01.755728 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:01.755965 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:01.756510 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:01.756521 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:01.756525 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:01.757144 (+ 619us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:01.757513 (+ 369us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:01.761468 (+ 3955us) server_negotiation.cc:299] Negotiation successful
0809 05:28:01.761806 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 05:28:01.764050 1895 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:01.774662 2424 ts_tablet_manager.cc:1918] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:28:01.774958 2424 log.cc:1196] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786253234117492-27364-0/minicluster-data/ts-2/wal/wals/e3591723fda948f79a7b6b43ace729b2
I20260809 05:28:01.775686 2424 ts_tablet_manager.cc:1939] T e3591723fda948f79a7b6b43ace729b2 P b7cf7b5b09d646548e958f71314ffb29: Deleting consensus metadata
I20260809 05:28:01.778465 1591 catalog_manager.cc:4841] TS b7cf7b5b09d646548e958f71314ffb29 (127.26.185.3:35111): tablet e3591723fda948f79a7b6b43ace729b2 (table test-table [id=6ea91765830b432bb48c21a6b1229453]) successfully deleted
I20260809 05:28:01.868957 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 1713
I20260809 05:28:01.903749 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 1914
Aug 09 05:28:01 dist-test-slave-h3ft krb5kdc[1549](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253278, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.2@KRBTEST.COM
I20260809 05:28:01.925336 2385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:01.904929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47236 (local address 127.26.185.2:37707)
0809 05:28:01.905165 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:01.905170 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:01.905192 (+ 22us) server_negotiation.cc:407] Connection header received
0809 05:28:01.905413 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:01.905419 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:01.905523 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:01.905629 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:01.907600 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.908483 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.910470 (+ 1987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:01.910893 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:01.911166 (+ 273us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:01.917252 (+ 6086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:01.917277 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:01.917301 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:01.917356 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:01.921467 (+ 4111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:01.922491 (+ 1024us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:01.922501 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:01.922504 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:01.922712 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:01.923283 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:01.923287 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:01.923289 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:01.923956 (+ 667us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:01.924356 (+ 400us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:01.924687 (+ 331us) server_negotiation.cc:299] Negotiation successful
0809 05:28:01.924944 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260809 05:28:01.926347 2129 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:02.051263 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 1914
I20260809 05:28:02.090893 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 2149
Aug 09 05:28:02 dist-test-slave-h3ft krb5kdc[1549](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253278, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.3@KRBTEST.COM
I20260809 05:28:02.113871 2381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:02.092215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40556 (local address 127.26.185.3:35111)
0809 05:28:02.092464 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:02.092471 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:02.092501 (+ 30us) server_negotiation.cc:407] Connection header received
0809 05:28:02.092675 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:02.092682 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:02.092822 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:02.092972 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:02.094782 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:02.096142 (+ 1360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:02.097741 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:02.098500 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:02.098675 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:02.104227 (+ 5552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:02.104262 (+ 35us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:02.104301 (+ 39us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:02.104373 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:02.109540 (+ 5167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:02.110686 (+ 1146us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:02.110699 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:02.110703 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:02.110981 (+ 278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:02.111645 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:02.111650 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:02.111654 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:02.112247 (+ 593us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:02.112683 (+ 436us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:02.113010 (+ 327us) server_negotiation.cc:299] Negotiation successful
0809 05:28:02.113332 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260809 05:28:02.114987 2350 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:02.270073 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 2149
I20260809 05:28:02.308483 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 1568
I20260809 05:28:02.310047 1666 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:02.436472 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 1568
2026-08-09T05:28:02Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (5412 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-09T05:28:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:28:02Z Disabled control of system clock
I20260809 05:28:02.533776 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:34365
--webserver_interface=127.26.185.62
--webserver_port=0
--builtin_ntp_servers=127.26.185.20:38725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:34365
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 05:28:02.952417 2442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:02.952867 2442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:02.952972 2442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:02.961324 2442 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:28:02.961512 2442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:02.961597 2442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:02.961707 2442 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:28:02.961766 2442 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:28:02.972471 2442 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:38725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:34365
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:34365
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:02.974411 2442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:02.976845 2442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:02.992122 2450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:02.992246 2453 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:02.992563 2449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:02.994239 2442 server_base.cc:1034] running on GCE node
I20260809 05:28:02.995451 2442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:02.997382 2442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:02.998624 2442 hybrid_clock.cc:648] HybridClock initialized: now 1786253282998580 us; error 35 us; skew 500 ppm
I20260809 05:28:02.999133 2442 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 05:28:03.002136 2442 webserver.cc:460] Webserver started at http://127.26.185.62:46553/ using document root <none> and password file <none>
I20260809 05:28:03.003110 2442 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:03.003239 2442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:03.003654 2442 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:28:03.007220 2442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "7e33ad5b818c40168f982ccdcb67ccc5"
format_stamp: "Formatted at 2026-08-09 05:28:03 on dist-test-slave-h3ft"
server_key: "ad2135005f2d411707d291472e614aea"
server_key_iv: "b51aa2ee166b30a1a8c9423367507de9"
server_key_version: "encryptionkey@0"
I20260809 05:28:03.008188 2442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "7e33ad5b818c40168f982ccdcb67ccc5"
format_stamp: "Formatted at 2026-08-09 05:28:03 on dist-test-slave-h3ft"
server_key: "ad2135005f2d411707d291472e614aea"
server_key_iv: "b51aa2ee166b30a1a8c9423367507de9"
server_key_version: "encryptionkey@0"
I20260809 05:28:03.014668 2442 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260809 05:28:03.018854 2461 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:03.020596 2442 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 05:28:03.020813 2442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "7e33ad5b818c40168f982ccdcb67ccc5"
format_stamp: "Formatted at 2026-08-09 05:28:03 on dist-test-slave-h3ft"
server_key: "ad2135005f2d411707d291472e614aea"
server_key_iv: "b51aa2ee166b30a1a8c9423367507de9"
server_key_version: "encryptionkey@0"
I20260809 05:28:03.021100 2442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:03.028324 2442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:03.029299 2442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:03.029642 2442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:03.051162 2442 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:34365
I20260809 05:28:03.051229 2556 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:34365 every 8 connection(s)
I20260809 05:28:03.052975 2442 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:28:03.055208 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 2442
I20260809 05:28:03.055450 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:28:03.056242 27364 external_mini_cluster.cc:1428] Setting key 870b1f2a75076b3d2df8bb6d044b60c0
I20260809 05:28:03.058787 2557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:03.068527 2560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:03.058995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37394 (local address 127.26.185.62:34365)
0809 05:28:03.060417 (+ 1422us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:03.060434 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:03.060512 (+ 78us) server_negotiation.cc:407] Connection header received
0809 05:28:03.062939 (+ 2427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:03.062988 (+ 49us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:03.063770 (+ 782us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:03.064398 (+ 628us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:03.065787 (+ 1389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:03.065799 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:03.065825 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:28:03.065854 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:03.065991 (+ 137us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:28:03.066018 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:03.066300 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:03.066465 (+ 165us) server_negotiation.cc:299] Negotiation successful
0809 05:28:03.066867 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":716,"thread_start_us":430,"threads_started":1}
I20260809 05:28:03.075789 2557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e33ad5b818c40168f982ccdcb67ccc5: Bootstrap starting.
I20260809 05:28:03.080137 2557 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7e33ad5b818c40168f982ccdcb67ccc5: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:03.081535 2557 log.cc:824] T 00000000000000000000000000000000 P 7e33ad5b818c40168f982ccdcb67ccc5: Log is configured to *not* fsync() on all Append() calls
I20260809 05:28:03.085454 2557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e33ad5b818c40168f982ccdcb67ccc5: No bootstrap required, opened a new log
I20260809 05:28:03.094082 2557 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7e33ad5b818c40168f982ccdcb67ccc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e33ad5b818c40168f982ccdcb67ccc5" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 34365 } }
I20260809 05:28:03.094647 2557 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7e33ad5b818c40168f982ccdcb67ccc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:03.094771 2557 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7e33ad5b818c40168f982ccdcb67ccc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e33ad5b818c40168f982ccdcb67ccc5, State: Initialized, Role: FOLLOWER
I20260809 05:28:03.095630 2557 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7e33ad5b818c40168f982ccdcb67ccc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e33ad5b818c40168f982ccdcb67ccc5" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 34365 } }
I20260809 05:28:03.095933 2557 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7e33ad5b818c40168f982ccdcb67ccc5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:28:03.096093 2557 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e33ad5b818c40168f982ccdcb67ccc5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:28:03.096326 2557 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7e33ad5b818c40168f982ccdcb67ccc5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:03.099094 2557 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e33ad5b818c40168f982ccdcb67ccc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e33ad5b818c40168f982ccdcb67ccc5" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 34365 } }
I20260809 05:28:03.099917 2557 leader_election.cc:302] T 00000000000000000000000000000000 P 7e33ad5b818c40168f982ccdcb67ccc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7e33ad5b818c40168f982ccdcb67ccc5; no voters:
I20260809 05:28:03.100822 2557 leader_election.cc:288] T 00000000000000000000000000000000 P 7e33ad5b818c40168f982ccdcb67ccc5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:28:03.101018 2562 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7e33ad5b818c40168f982ccdcb67ccc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:28:03.102033 2562 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7e33ad5b818c40168f982ccdcb67ccc5 [term 1 LEADER]: Becoming Leader. State: Replica: 7e33ad5b818c40168f982ccdcb67ccc5, State: Running, Role: LEADER
I20260809 05:28:03.102723 2562 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7e33ad5b818c40168f982ccdcb67ccc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e33ad5b818c40168f982ccdcb67ccc5" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 34365 } }
I20260809 05:28:03.103824 2557 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7e33ad5b818c40168f982ccdcb67ccc5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:28:03.106321 2568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e33ad5b818c40168f982ccdcb67ccc5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7e33ad5b818c40168f982ccdcb67ccc5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e33ad5b818c40168f982ccdcb67ccc5" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 34365 } } }
I20260809 05:28:03.107165 2568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e33ad5b818c40168f982ccdcb67ccc5 [sys.catalog]: This master's current role is: LEADER
I20260809 05:28:03.106199 2566 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e33ad5b818c40168f982ccdcb67ccc5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7e33ad5b818c40168f982ccdcb67ccc5. Latest consensus state: current_term: 1 leader_uuid: "7e33ad5b818c40168f982ccdcb67ccc5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e33ad5b818c40168f982ccdcb67ccc5" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 34365 } } }
I20260809 05:28:03.108093 2566 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e33ad5b818c40168f982ccdcb67ccc5 [sys.catalog]: This master's current role is: LEADER
I20260809 05:28:03.109846 2576 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:28:03.116953 2576 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:28:03.128618 2576 catalog_manager.cc:1347] Generated new cluster ID: 65ac2c32d6924b37af6afde485935daa
I20260809 05:28:03.128806 2576 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:28:03.152279 2576 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:28:03.152930 2576 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:28:03.168627 2576 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7e33ad5b818c40168f982ccdcb67ccc5: Generated new TSK 0
I20260809 05:28:03.169930 2576 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 05:28:03.176294 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:0
--local_ip_for_outbound_sockets=127.26.185.1
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:34365
--builtin_ntp_servers=127.26.185.20:38725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 05:28:03.640776 2598 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:03.641191 2598 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:03.641296 2598 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:03.649570 2598 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:03.649729 2598 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:03.649863 2598 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:28:03.660573 2598 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:38725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:34365
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:03.662411 2598 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:03.664855 2598 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:03.681275 2609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:03.681356 2604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:03.681322 2605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:03.682583 2598 server_base.cc:1034] running on GCE node
I20260809 05:28:03.683504 2598 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:03.684952 2598 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:03.686228 2598 hybrid_clock.cc:648] HybridClock initialized: now 1786253283686178 us; error 48 us; skew 500 ppm
I20260809 05:28:03.686606 2598 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 05:28:03.689620 2598 webserver.cc:460] Webserver started at http://127.26.185.1:36039/ using document root <none> and password file <none>
I20260809 05:28:03.690514 2598 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:03.690616 2598 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:03.690969 2598 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:28:03.694643 2598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-0/data/instance:
uuid: "26ad3285b83e43cf83013f5a045d28f4"
format_stamp: "Formatted at 2026-08-09 05:28:03 on dist-test-slave-h3ft"
server_key: "5ce98923635fe1bcc3a2c4cc3bd3c4c6"
server_key_iv: "2abc91f1720ea0ee1cdb15670fd2d8fc"
server_key_version: "encryptionkey@0"
I20260809 05:28:03.695799 2598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance:
uuid: "26ad3285b83e43cf83013f5a045d28f4"
format_stamp: "Formatted at 2026-08-09 05:28:03 on dist-test-slave-h3ft"
server_key: "5ce98923635fe1bcc3a2c4cc3bd3c4c6"
server_key_iv: "2abc91f1720ea0ee1cdb15670fd2d8fc"
server_key_version: "encryptionkey@0"
I20260809 05:28:03.702350 2598 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260809 05:28:03.707230 2621 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:03.709233 2598 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:28:03.709493 2598 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "26ad3285b83e43cf83013f5a045d28f4"
format_stamp: "Formatted at 2026-08-09 05:28:03 on dist-test-slave-h3ft"
server_key: "5ce98923635fe1bcc3a2c4cc3bd3c4c6"
server_key_iv: "2abc91f1720ea0ee1cdb15670fd2d8fc"
server_key_version: "encryptionkey@0"
I20260809 05:28:03.709775 2598 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:03.717478 2598 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:03.718555 2598 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:03.718895 2598 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:03.720093 2598 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:28:03.721918 2598 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:28:03.722045 2598 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:03.722199 2598 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:28:03.722286 2598 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:03.764212 2598 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:43373
I20260809 05:28:03.764330 2807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:43373 every 8 connection(s)
I20260809 05:28:03.766186 2598 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:28:03.776268 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 2598
I20260809 05:28:03.776549 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance
I20260809 05:28:03.777379 27364 external_mini_cluster.cc:1428] Setting key 76c3a3094975cb96e988eee611f9eeec
I20260809 05:28:03.778816 2811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:03.770026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:52571 (local address 127.26.185.62:34365)
0809 05:28:03.770702 (+ 676us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:03.770708 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:03.772730 (+ 2022us) server_negotiation.cc:407] Connection header received
0809 05:28:03.775264 (+ 2534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:03.775272 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:03.775403 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:03.775574 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:03.777692 (+ 2118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:03.777699 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:03.777705 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:28:03.777740 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:03.777818 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:28:03.777841 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:03.778044 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:03.778286 (+ 242us) server_negotiation.cc:299] Negotiation successful
0809 05:28:03.778382 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":387,"threads_started":1}
I20260809 05:28:03.780648 2812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:03.770992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:34365 (local address 127.26.185.1:52571)
0809 05:28:03.772453 (+ 1461us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:03.772514 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:03.774761 (+ 2247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:03.775932 (+ 1171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:03.775944 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:03.776087 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:03.777202 (+ 1115us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 05:28:03.777205 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:03.777260 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 05:28:03.777402 (+ 142us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:03.778005 (+ 603us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:03.778016 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:03.778025 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 05:28:03.778415 (+ 390us) client_negotiation.cc:240] Negotiation successful
0809 05:28:03.778836 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":716,"thread_start_us":382,"threads_started":1}
I20260809 05:28:03.782058 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:0
--local_ip_for_outbound_sockets=127.26.185.2
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:34365
--builtin_ntp_servers=127.26.185.20:38725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260809 05:28:03.783109 2809 heartbeater.cc:347] Connected to a master server at 127.26.185.62:34365
I20260809 05:28:03.783614 2809 heartbeater.cc:464] Registering TS with master...
I20260809 05:28:03.784462 2809 heartbeater.cc:511] Master 127.26.185.62:34365 requested a full tablet report, sending...
I20260809 05:28:03.787741 2500 ts_manager.cc:194] Registered new tserver with Master: 26ad3285b83e43cf83013f5a045d28f4 (127.26.185.1:43373)
W20260809 05:28:04.217024 2814 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:04.217429 2814 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:04.217594 2814 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:04.228861 2814 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:04.229081 2814 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:04.229337 2814 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:28:04.242362 2814 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:38725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:34365
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:04.244372 2814 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:04.247076 2814 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:04.264134 2822 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:04.264143 2823 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:04.264328 2825 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:04.265563 2814 server_base.cc:1034] running on GCE node
I20260809 05:28:04.266619 2814 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:04.268105 2814 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:04.269430 2814 hybrid_clock.cc:648] HybridClock initialized: now 1786253284269337 us; error 97 us; skew 500 ppm
I20260809 05:28:04.269898 2814 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 05:28:04.273510 2814 webserver.cc:460] Webserver started at http://127.26.185.2:38261/ using document root <none> and password file <none>
I20260809 05:28:04.274569 2814 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:04.274718 2814 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:04.275246 2814 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:28:04.279744 2814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-1/data/instance:
uuid: "ba4ef4604ed54aa2969f917c60d8d75e"
format_stamp: "Formatted at 2026-08-09 05:28:04 on dist-test-slave-h3ft"
server_key: "3aeb0b6716ad47b84e60ea48e723d5ce"
server_key_iv: "71da4fec716387dbd5feb0047ab151f8"
server_key_version: "encryptionkey@0"
I20260809 05:28:04.280867 2814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance:
uuid: "ba4ef4604ed54aa2969f917c60d8d75e"
format_stamp: "Formatted at 2026-08-09 05:28:04 on dist-test-slave-h3ft"
server_key: "3aeb0b6716ad47b84e60ea48e723d5ce"
server_key_iv: "71da4fec716387dbd5feb0047ab151f8"
server_key_version: "encryptionkey@0"
I20260809 05:28:04.287910 2814 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260809 05:28:04.292654 2833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:04.294545 2814 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260809 05:28:04.294795 2814 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "ba4ef4604ed54aa2969f917c60d8d75e"
format_stamp: "Formatted at 2026-08-09 05:28:04 on dist-test-slave-h3ft"
server_key: "3aeb0b6716ad47b84e60ea48e723d5ce"
server_key_iv: "71da4fec716387dbd5feb0047ab151f8"
server_key_version: "encryptionkey@0"
I20260809 05:28:04.295161 2814 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:04.302861 2814 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:04.304060 2814 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:04.304498 2814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:04.305768 2814 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:28:04.307785 2814 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:28:04.307931 2814 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:04.308058 2814 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:28:04.308130 2814 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:04.349046 2814 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:34741
I20260809 05:28:04.349115 3005 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:34741 every 8 connection(s)
I20260809 05:28:04.350819 2814 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:28:04.358974 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 2814
I20260809 05:28:04.359295 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance
I20260809 05:28:04.360006 27364 external_mini_cluster.cc:1428] Setting key 10c1214d3c876d92644ac062cd09ffe4
I20260809 05:28:04.362057 3009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:04.354335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:48883 (local address 127.26.185.62:34365)
0809 05:28:04.354958 (+ 623us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:04.354967 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:04.356664 (+ 1697us) server_negotiation.cc:407] Connection header received
0809 05:28:04.358750 (+ 2086us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:04.358755 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:04.358847 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:04.359115 (+ 268us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:04.361092 (+ 1977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:04.361105 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:04.361108 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:28:04.361132 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:04.361188 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:28:04.361202 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:04.361377 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:04.361578 (+ 201us) server_negotiation.cc:299] Negotiation successful
0809 05:28:04.361664 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":273,"threads_started":1}
I20260809 05:28:04.363752 3010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:04.355290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:34365 (local address 127.26.185.2:48883)
0809 05:28:04.356434 (+ 1144us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:04.356489 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:04.358316 (+ 1827us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:04.359453 (+ 1137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:04.359468 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:04.359644 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:04.360638 (+ 994us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 05:28:04.360642 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:04.360706 (+ 64us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 05:28:04.360861 (+ 155us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:04.361312 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:04.361324 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:04.361336 (+ 12us) client_negotiation.cc:769] Sending connection context
0809 05:28:04.361696 (+ 360us) client_negotiation.cc:240] Negotiation successful
0809 05:28:04.362074 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":335,"threads_started":1}
I20260809 05:28:04.364394 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:0
--local_ip_for_outbound_sockets=127.26.185.3
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:34365
--builtin_ntp_servers=127.26.185.20:38725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260809 05:28:04.365618 3006 heartbeater.cc:347] Connected to a master server at 127.26.185.62:34365
I20260809 05:28:04.366061 3006 heartbeater.cc:464] Registering TS with master...
I20260809 05:28:04.367060 3006 heartbeater.cc:511] Master 127.26.185.62:34365 requested a full tablet report, sending...
I20260809 05:28:04.369405 2500 ts_manager.cc:194] Registered new tserver with Master: ba4ef4604ed54aa2969f917c60d8d75e (127.26.185.2:34741)
I20260809 05:28:04.792618 2809 heartbeater.cc:503] Master 127.26.185.62:34365 was elected leader, sending a full tablet report...
W20260809 05:28:04.814265 3013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:04.814654 3013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:04.814766 3013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:04.824033 3013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:04.824180 3013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:04.824311 3013 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:28:04.835750 3013 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:38725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:34365
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:04.837671 3013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:04.840279 3013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:04.860105 3021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:04.860011 3024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:04.860059 3026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:04.861826 3013 server_base.cc:1034] running on GCE node
I20260809 05:28:04.862982 3013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:04.864444 3013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:04.865741 3013 hybrid_clock.cc:648] HybridClock initialized: now 1786253284865649 us; error 83 us; skew 500 ppm
I20260809 05:28:04.866205 3013 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 05:28:04.869740 3013 webserver.cc:460] Webserver started at http://127.26.185.3:45697/ using document root <none> and password file <none>
I20260809 05:28:04.870852 3013 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:04.870977 3013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:04.871474 3013 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:28:04.875397 3013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-2/data/instance:
uuid: "8619926752284f8fb656d5efc31eaa16"
format_stamp: "Formatted at 2026-08-09 05:28:04 on dist-test-slave-h3ft"
server_key: "25f7ed5f0cc35292eb2b6b997bdfe235"
server_key_iv: "d2148711df7ca459d84b2fbc0696ded0"
server_key_version: "encryptionkey@0"
I20260809 05:28:04.876469 3013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance:
uuid: "8619926752284f8fb656d5efc31eaa16"
format_stamp: "Formatted at 2026-08-09 05:28:04 on dist-test-slave-h3ft"
server_key: "25f7ed5f0cc35292eb2b6b997bdfe235"
server_key_iv: "d2148711df7ca459d84b2fbc0696ded0"
server_key_version: "encryptionkey@0"
I20260809 05:28:04.884076 3013 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260809 05:28:04.888592 3043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:04.890333 3013 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.004s
I20260809 05:28:04.890561 3013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "8619926752284f8fb656d5efc31eaa16"
format_stamp: "Formatted at 2026-08-09 05:28:04 on dist-test-slave-h3ft"
server_key: "25f7ed5f0cc35292eb2b6b997bdfe235"
server_key_iv: "d2148711df7ca459d84b2fbc0696ded0"
server_key_version: "encryptionkey@0"
I20260809 05:28:04.890816 3013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:04.898103 3013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:04.899271 3013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:04.899617 3013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:04.900888 3013 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:28:04.902751 3013 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:28:04.902876 3013 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:04.903046 3013 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:28:04.903141 3013 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260809 05:28:04.946525 3013 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:45505
I20260809 05:28:04.946571 3222 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:45505 every 8 connection(s)
I20260809 05:28:04.948315 3013 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:28:04.951766 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 3013
I20260809 05:28:04.952008 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance
I20260809 05:28:04.952714 27364 external_mini_cluster.cc:1428] Setting key 0fddc77526e978b8c10141b351f5c81f
I20260809 05:28:04.960107 3231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:04.951923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:49517 (local address 127.26.185.62:34365)
0809 05:28:04.952594 (+ 671us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:04.952604 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:04.954453 (+ 1849us) server_negotiation.cc:407] Connection header received
0809 05:28:04.956824 (+ 2371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:04.956830 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:04.956937 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:04.957114 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:04.958946 (+ 1832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:04.958951 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:04.958955 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:28:04.958997 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:04.959118 (+ 121us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:28:04.959135 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:04.959252 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:04.959571 (+ 319us) server_negotiation.cc:299] Negotiation successful
0809 05:28:04.959650 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":493,"thread_start_us":311,"threads_started":1}
I20260809 05:28:04.961653 3232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:04.952771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:34365 (local address 127.26.185.3:49517)
0809 05:28:04.954215 (+ 1444us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:04.954291 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:04.956391 (+ 2100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:04.957488 (+ 1097us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:04.957505 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:04.957642 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:04.958568 (+ 926us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 05:28:04.958571 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:04.958627 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 05:28:04.958751 (+ 124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:04.959280 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:04.959291 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:04.959299 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 05:28:04.959613 (+ 314us) client_negotiation.cc:240] Negotiation successful
0809 05:28:04.959925 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":704,"thread_start_us":415,"threads_started":1}
I20260809 05:28:04.963781 3224 heartbeater.cc:347] Connected to a master server at 127.26.185.62:34365
I20260809 05:28:04.964244 3224 heartbeater.cc:464] Registering TS with master...
I20260809 05:28:04.965122 3224 heartbeater.cc:511] Master 127.26.185.62:34365 requested a full tablet report, sending...
I20260809 05:28:04.967363 2500 ts_manager.cc:194] Registered new tserver with Master: 8619926752284f8fb656d5efc31eaa16 (127.26.185.3:45505)
I20260809 05:28:04.970440 27364 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 05:28:04.979374 3231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:04.976214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37406 (local address 127.26.185.62:34365)
0809 05:28:04.976462 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:04.976468 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:04.977043 (+ 575us) server_negotiation.cc:407] Connection header received
0809 05:28:04.977266 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:04.977271 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:04.977343 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:04.977459 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:04.978670 (+ 1211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:04.978675 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:04.978679 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:28:04.978700 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:04.978746 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:28:04.978760 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:04.978932 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:04.978971 (+ 39us) server_negotiation.cc:299] Negotiation successful
0809 05:28:04.979111 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260809 05:28:04.985188 2499 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37406:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 05:28:04.993391 2499 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 05:28:05.032282 3252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:05.012349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:34741 (local address 127.0.0.1:58962)
0809 05:28:05.013513 (+ 1164us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:05.013583 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:05.013817 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:05.029228 (+ 15411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:05.029234 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:05.029284 (+ 50us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:05.030287 (+ 1003us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 05:28:05.030292 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:05.030308 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 05:28:05.030436 (+ 128us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:05.031297 (+ 861us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:05.031327 (+ 30us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:05.031339 (+ 12us) client_negotiation.cc:769] Sending connection context
0809 05:28:05.031546 (+ 207us) client_negotiation.cc:240] Negotiation successful
0809 05:28:05.031688 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":693,"thread_start_us":440,"threads_started":1}
I20260809 05:28:05.032968 3259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:05.012559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58962 (local address 127.26.185.2:34741)
0809 05:28:05.028174 (+ 15615us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:05.028185 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:05.028222 (+ 37us) server_negotiation.cc:407] Connection header received
0809 05:28:05.028318 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:05.028326 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:05.028589 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:05.029182 (+ 593us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:05.030909 (+ 1727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:05.030925 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:05.030952 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:28:05.030977 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:05.031112 (+ 135us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:28:05.031148 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:05.032235 (+ 1087us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:05.032315 (+ 80us) server_negotiation.cc:299] Negotiation successful
0809 05:28:05.032482 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15405,"thread_start_us":16160,"threads_started":1}
I20260809 05:28:05.032943 3263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:05.013341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:45505 (local address 127.0.0.1:33672)
0809 05:28:05.026004 (+ 12663us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:05.026038 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:05.026645 (+ 607us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:05.028303 (+ 1658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:05.028316 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:05.028465 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:05.030139 (+ 1674us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 05:28:05.030144 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:05.030617 (+ 473us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 05:28:05.030678 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:05.031786 (+ 1108us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:05.031790 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:05.031795 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 05:28:05.031963 (+ 168us) client_negotiation.cc:240] Negotiation successful
0809 05:28:05.032031 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12350,"thread_start_us":14554,"threads_started":1}
I20260809 05:28:05.033604 3261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:05.014181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33672 (local address 127.26.185.3:45505)
0809 05:28:05.020965 (+ 6784us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:05.020985 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:05.026521 (+ 5536us) server_negotiation.cc:407] Connection header received
0809 05:28:05.026902 (+ 381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:05.026919 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:05.027533 (+ 614us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:05.027764 (+ 231us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:05.031336 (+ 3572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:05.031346 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:05.031361 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:28:05.031386 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:05.031478 (+ 92us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:28:05.031509 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:05.031714 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:05.032977 (+ 1263us) server_negotiation.cc:299] Negotiation successful
0809 05:28:05.033112 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6427,"thread_start_us":6192,"threads_started":1}
I20260809 05:28:05.033792 3264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:05.014550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35480 (local address 127.26.185.1:43373)
0809 05:28:05.024841 (+ 10291us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:05.024856 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:05.028388 (+ 3532us) server_negotiation.cc:407] Connection header received
0809 05:28:05.028729 (+ 341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:05.028739 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:05.029044 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:05.029705 (+ 661us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:05.032148 (+ 2443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:05.032158 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:05.032171 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:28:05.032192 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:05.032263 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:28:05.032287 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:05.032494 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:05.033052 (+ 558us) server_negotiation.cc:299] Negotiation successful
0809 05:28:05.033182 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9966,"thread_start_us":10306,"threads_started":1}
I20260809 05:28:05.034324 3260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:05.014279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:43373 (local address 127.0.0.1:35480)
0809 05:28:05.028233 (+ 13954us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:05.028255 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:05.028491 (+ 236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:05.030728 (+ 2237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:05.030732 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:05.030757 (+ 25us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:05.031872 (+ 1115us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 05:28:05.031875 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:05.031904 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 05:28:05.031956 (+ 52us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:05.032558 (+ 602us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:05.032563 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:05.032568 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 05:28:05.032730 (+ 162us) client_negotiation.cc:240] Negotiation successful
0809 05:28:05.032782 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13790,"thread_start_us":11176,"threads_started":1}
I20260809 05:28:05.038327 2703 tablet_service.cc:1467] Processing CreateTablet for tablet ea56201fe3c84ebf8f34cf3e81ec8d94 (DEFAULT_TABLE table=test-table [id=e9e62a9188534978bb273c25b9e5a070]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:28:05.038347 3114 tablet_service.cc:1467] Processing CreateTablet for tablet ea56201fe3c84ebf8f34cf3e81ec8d94 (DEFAULT_TABLE table=test-table [id=e9e62a9188534978bb273c25b9e5a070]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:28:05.038348 2901 tablet_service.cc:1467] Processing CreateTablet for tablet ea56201fe3c84ebf8f34cf3e81ec8d94 (DEFAULT_TABLE table=test-table [id=e9e62a9188534978bb273c25b9e5a070]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:28:05.039952 2703 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea56201fe3c84ebf8f34cf3e81ec8d94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:05.039988 3114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea56201fe3c84ebf8f34cf3e81ec8d94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:05.039999 2901 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea56201fe3c84ebf8f34cf3e81ec8d94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:05.062184 3266 tablet_bootstrap.cc:492] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 26ad3285b83e43cf83013f5a045d28f4: Bootstrap starting.
I20260809 05:28:05.064683 3267 tablet_bootstrap.cc:492] T ea56201fe3c84ebf8f34cf3e81ec8d94 P ba4ef4604ed54aa2969f917c60d8d75e: Bootstrap starting.
I20260809 05:28:05.067729 3268 tablet_bootstrap.cc:492] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 8619926752284f8fb656d5efc31eaa16: Bootstrap starting.
I20260809 05:28:05.068404 3266 tablet_bootstrap.cc:654] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 26ad3285b83e43cf83013f5a045d28f4: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:05.070147 3267 tablet_bootstrap.cc:654] T ea56201fe3c84ebf8f34cf3e81ec8d94 P ba4ef4604ed54aa2969f917c60d8d75e: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:05.070276 3266 log.cc:824] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 26ad3285b83e43cf83013f5a045d28f4: Log is configured to *not* fsync() on all Append() calls
I20260809 05:28:05.071915 3267 log.cc:824] T ea56201fe3c84ebf8f34cf3e81ec8d94 P ba4ef4604ed54aa2969f917c60d8d75e: Log is configured to *not* fsync() on all Append() calls
I20260809 05:28:05.074694 3268 tablet_bootstrap.cc:654] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 8619926752284f8fb656d5efc31eaa16: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:05.076371 3268 log.cc:824] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 8619926752284f8fb656d5efc31eaa16: Log is configured to *not* fsync() on all Append() calls
I20260809 05:28:05.081759 3266 tablet_bootstrap.cc:492] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 26ad3285b83e43cf83013f5a045d28f4: No bootstrap required, opened a new log
I20260809 05:28:05.081971 3267 tablet_bootstrap.cc:492] T ea56201fe3c84ebf8f34cf3e81ec8d94 P ba4ef4604ed54aa2969f917c60d8d75e: No bootstrap required, opened a new log
I20260809 05:28:05.082211 3266 ts_tablet_manager.cc:1397] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 26ad3285b83e43cf83013f5a045d28f4: Time spent bootstrapping tablet: real 0.020s user 0.007s sys 0.008s
I20260809 05:28:05.082259 3267 ts_tablet_manager.cc:1397] T ea56201fe3c84ebf8f34cf3e81ec8d94 P ba4ef4604ed54aa2969f917c60d8d75e: Time spent bootstrapping tablet: real 0.018s user 0.010s sys 0.005s
I20260809 05:28:05.086138 3268 tablet_bootstrap.cc:492] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 8619926752284f8fb656d5efc31eaa16: No bootstrap required, opened a new log
I20260809 05:28:05.086524 3268 ts_tablet_manager.cc:1397] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 8619926752284f8fb656d5efc31eaa16: Time spent bootstrapping tablet: real 0.019s user 0.008s sys 0.005s
I20260809 05:28:05.094830 3267 raft_consensus.cc:348] T ea56201fe3c84ebf8f34cf3e81ec8d94 P ba4ef4604ed54aa2969f917c60d8d75e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba4ef4604ed54aa2969f917c60d8d75e" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 34741 } } peers { permanent_uuid: "26ad3285b83e43cf83013f5a045d28f4" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43373 } } peers { permanent_uuid: "8619926752284f8fb656d5efc31eaa16" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 45505 } }
I20260809 05:28:05.094877 3266 raft_consensus.cc:348] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 26ad3285b83e43cf83013f5a045d28f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba4ef4604ed54aa2969f917c60d8d75e" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 34741 } } peers { permanent_uuid: "26ad3285b83e43cf83013f5a045d28f4" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43373 } } peers { permanent_uuid: "8619926752284f8fb656d5efc31eaa16" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 45505 } }
I20260809 05:28:05.095587 3266 raft_consensus.cc:374] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 26ad3285b83e43cf83013f5a045d28f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:05.095587 3267 raft_consensus.cc:374] T ea56201fe3c84ebf8f34cf3e81ec8d94 P ba4ef4604ed54aa2969f917c60d8d75e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:05.095328 3268 raft_consensus.cc:348] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 8619926752284f8fb656d5efc31eaa16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba4ef4604ed54aa2969f917c60d8d75e" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 34741 } } peers { permanent_uuid: "26ad3285b83e43cf83013f5a045d28f4" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43373 } } peers { permanent_uuid: "8619926752284f8fb656d5efc31eaa16" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 45505 } }
I20260809 05:28:05.095715 3266 raft_consensus.cc:729] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 26ad3285b83e43cf83013f5a045d28f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26ad3285b83e43cf83013f5a045d28f4, State: Initialized, Role: FOLLOWER
I20260809 05:28:05.095715 3267 raft_consensus.cc:729] T ea56201fe3c84ebf8f34cf3e81ec8d94 P ba4ef4604ed54aa2969f917c60d8d75e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba4ef4604ed54aa2969f917c60d8d75e, State: Initialized, Role: FOLLOWER
I20260809 05:28:05.095842 3268 raft_consensus.cc:374] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 8619926752284f8fb656d5efc31eaa16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:05.095948 3268 raft_consensus.cc:729] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 8619926752284f8fb656d5efc31eaa16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8619926752284f8fb656d5efc31eaa16, State: Initialized, Role: FOLLOWER
I20260809 05:28:05.096714 3268 consensus_queue.cc:260] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 8619926752284f8fb656d5efc31eaa16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba4ef4604ed54aa2969f917c60d8d75e" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 34741 } } peers { permanent_uuid: "26ad3285b83e43cf83013f5a045d28f4" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43373 } } peers { permanent_uuid: "8619926752284f8fb656d5efc31eaa16" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 45505 } }
I20260809 05:28:05.096691 3267 consensus_queue.cc:260] T ea56201fe3c84ebf8f34cf3e81ec8d94 P ba4ef4604ed54aa2969f917c60d8d75e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba4ef4604ed54aa2969f917c60d8d75e" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 34741 } } peers { permanent_uuid: "26ad3285b83e43cf83013f5a045d28f4" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43373 } } peers { permanent_uuid: "8619926752284f8fb656d5efc31eaa16" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 45505 } }
I20260809 05:28:05.096755 3266 consensus_queue.cc:260] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 26ad3285b83e43cf83013f5a045d28f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba4ef4604ed54aa2969f917c60d8d75e" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 34741 } } peers { permanent_uuid: "26ad3285b83e43cf83013f5a045d28f4" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43373 } } peers { permanent_uuid: "8619926752284f8fb656d5efc31eaa16" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 45505 } }
I20260809 05:28:05.100626 3006 heartbeater.cc:503] Master 127.26.185.62:34365 was elected leader, sending a full tablet report...
I20260809 05:28:05.101572 3224 heartbeater.cc:503] Master 127.26.185.62:34365 was elected leader, sending a full tablet report...
I20260809 05:28:05.102258 3268 ts_tablet_manager.cc:1428] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 8619926752284f8fb656d5efc31eaa16: Time spent starting tablet: real 0.016s user 0.012s sys 0.004s
W20260809 05:28:05.103416 3007 tablet.cc:2369] T ea56201fe3c84ebf8f34cf3e81ec8d94 P ba4ef4604ed54aa2969f917c60d8d75e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:28:05.103848 3266 ts_tablet_manager.cc:1428] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 26ad3285b83e43cf83013f5a045d28f4: Time spent starting tablet: real 0.021s user 0.014s sys 0.008s
I20260809 05:28:05.103258 3267 ts_tablet_manager.cc:1428] T ea56201fe3c84ebf8f34cf3e81ec8d94 P ba4ef4604ed54aa2969f917c60d8d75e: Time spent starting tablet: real 0.021s user 0.009s sys 0.012s
I20260809 05:28:05.149425 3276 raft_consensus.cc:482] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 26ad3285b83e43cf83013f5a045d28f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:28:05.149979 3276 raft_consensus.cc:504] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 26ad3285b83e43cf83013f5a045d28f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba4ef4604ed54aa2969f917c60d8d75e" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 34741 } } peers { permanent_uuid: "26ad3285b83e43cf83013f5a045d28f4" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43373 } } peers { permanent_uuid: "8619926752284f8fb656d5efc31eaa16" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 45505 } }
I20260809 05:28:05.152635 3276 leader_election.cc:288] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 26ad3285b83e43cf83013f5a045d28f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba4ef4604ed54aa2969f917c60d8d75e (127.26.185.2:34741), 8619926752284f8fb656d5efc31eaa16 (127.26.185.3:45505)
I20260809 05:28:05.157274 3259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:05.153272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:46747 (local address 127.26.185.2:34741)
0809 05:28:05.153571 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:05.153580 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:05.154734 (+ 1154us) server_negotiation.cc:407] Connection header received
0809 05:28:05.154885 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:05.154895 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:05.155090 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:05.155228 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:05.156359 (+ 1131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:05.156366 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:05.156371 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:28:05.156395 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:05.156446 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:28:05.156469 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:05.156613 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:05.156820 (+ 207us) server_negotiation.cc:299] Negotiation successful
0809 05:28:05.156923 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260809 05:28:05.157285 3261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:05.153780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:52665 (local address 127.26.185.3:45505)
0809 05:28:05.154019 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:05.154028 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:05.154204 (+ 176us) server_negotiation.cc:407] Connection header received
0809 05:28:05.154485 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:05.154492 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:05.154584 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:05.154729 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:05.156389 (+ 1660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:05.156394 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:05.156398 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:28:05.156416 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:05.156453 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:28:05.156466 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:05.156637 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:05.156875 (+ 238us) server_negotiation.cc:299] Negotiation successful
0809 05:28:05.156952 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260809 05:28:05.157940 3280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:05.153046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:34741 (local address 127.26.185.1:46747)
0809 05:28:05.154579 (+ 1533us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:05.154600 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:05.154739 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:05.155244 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:05.155247 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:05.155267 (+ 20us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:05.156115 (+ 848us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 05:28:05.156118 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:05.156130 (+ 12us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 05:28:05.156160 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:05.156592 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:05.156598 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:05.156604 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 05:28:05.156851 (+ 247us) client_negotiation.cc:240] Negotiation successful
0809 05:28:05.156921 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1402,"thread_start_us":1147,"threads_started":1}
I20260809 05:28:05.158370 3279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:05.152959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:45505 (local address 127.26.185.1:52665)
0809 05:28:05.153992 (+ 1033us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:05.154025 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:05.154283 (+ 258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:05.154808 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:05.154817 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:05.154849 (+ 32us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:05.156009 (+ 1160us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 05:28:05.156015 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:05.156081 (+ 66us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 05:28:05.156144 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:05.156680 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:05.156686 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:05.156692 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 05:28:05.157673 (+ 981us) client_negotiation.cc:240] Negotiation successful
0809 05:28:05.157744 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":808,"thread_start_us":780,"threads_started":1}
I20260809 05:28:05.159374 2930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea56201fe3c84ebf8f34cf3e81ec8d94" candidate_uuid: "26ad3285b83e43cf83013f5a045d28f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba4ef4604ed54aa2969f917c60d8d75e" is_pre_election: true
I20260809 05:28:05.159519 3141 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea56201fe3c84ebf8f34cf3e81ec8d94" candidate_uuid: "26ad3285b83e43cf83013f5a045d28f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8619926752284f8fb656d5efc31eaa16" is_pre_election: true
I20260809 05:28:05.160120 2930 raft_consensus.cc:2454] T ea56201fe3c84ebf8f34cf3e81ec8d94 P ba4ef4604ed54aa2969f917c60d8d75e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26ad3285b83e43cf83013f5a045d28f4 in term 0.
I20260809 05:28:05.160176 3141 raft_consensus.cc:2454] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 8619926752284f8fb656d5efc31eaa16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26ad3285b83e43cf83013f5a045d28f4 in term 0.
I20260809 05:28:05.160935 2626 leader_election.cc:302] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 26ad3285b83e43cf83013f5a045d28f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26ad3285b83e43cf83013f5a045d28f4, ba4ef4604ed54aa2969f917c60d8d75e; no voters:
I20260809 05:28:05.161448 3276 raft_consensus.cc:2781] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 26ad3285b83e43cf83013f5a045d28f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:28:05.161631 3276 raft_consensus.cc:482] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 26ad3285b83e43cf83013f5a045d28f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:28:05.161759 3276 raft_consensus.cc:3037] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 26ad3285b83e43cf83013f5a045d28f4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:05.164664 3276 raft_consensus.cc:504] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 26ad3285b83e43cf83013f5a045d28f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba4ef4604ed54aa2969f917c60d8d75e" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 34741 } } peers { permanent_uuid: "26ad3285b83e43cf83013f5a045d28f4" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43373 } } peers { permanent_uuid: "8619926752284f8fb656d5efc31eaa16" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 45505 } }
I20260809 05:28:05.165480 3276 leader_election.cc:288] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 26ad3285b83e43cf83013f5a045d28f4 [CANDIDATE]: Term 1 election: Requested vote from peers ba4ef4604ed54aa2969f917c60d8d75e (127.26.185.2:34741), 8619926752284f8fb656d5efc31eaa16 (127.26.185.3:45505)
I20260809 05:28:05.166144 2930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea56201fe3c84ebf8f34cf3e81ec8d94" candidate_uuid: "26ad3285b83e43cf83013f5a045d28f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba4ef4604ed54aa2969f917c60d8d75e"
I20260809 05:28:05.166258 3141 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea56201fe3c84ebf8f34cf3e81ec8d94" candidate_uuid: "26ad3285b83e43cf83013f5a045d28f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8619926752284f8fb656d5efc31eaa16"
I20260809 05:28:05.166440 2930 raft_consensus.cc:3037] T ea56201fe3c84ebf8f34cf3e81ec8d94 P ba4ef4604ed54aa2969f917c60d8d75e [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:05.166615 3141 raft_consensus.cc:3037] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 8619926752284f8fb656d5efc31eaa16 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:05.169582 2930 raft_consensus.cc:2454] T ea56201fe3c84ebf8f34cf3e81ec8d94 P ba4ef4604ed54aa2969f917c60d8d75e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26ad3285b83e43cf83013f5a045d28f4 in term 1.
I20260809 05:28:05.169677 3141 raft_consensus.cc:2454] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 8619926752284f8fb656d5efc31eaa16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26ad3285b83e43cf83013f5a045d28f4 in term 1.
I20260809 05:28:05.170331 2626 leader_election.cc:302] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 26ad3285b83e43cf83013f5a045d28f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 26ad3285b83e43cf83013f5a045d28f4, 8619926752284f8fb656d5efc31eaa16, ba4ef4604ed54aa2969f917c60d8d75e; no voters:
I20260809 05:28:05.170845 3276 raft_consensus.cc:2781] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 26ad3285b83e43cf83013f5a045d28f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:28:05.171545 3276 raft_consensus.cc:686] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 26ad3285b83e43cf83013f5a045d28f4 [term 1 LEADER]: Becoming Leader. State: Replica: 26ad3285b83e43cf83013f5a045d28f4, State: Running, Role: LEADER
I20260809 05:28:05.172338 3276 consensus_queue.cc:237] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 26ad3285b83e43cf83013f5a045d28f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba4ef4604ed54aa2969f917c60d8d75e" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 34741 } } peers { permanent_uuid: "26ad3285b83e43cf83013f5a045d28f4" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43373 } } peers { permanent_uuid: "8619926752284f8fb656d5efc31eaa16" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 45505 } }
I20260809 05:28:05.178745 2500 catalog_manager.cc:5495] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 26ad3285b83e43cf83013f5a045d28f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26ad3285b83e43cf83013f5a045d28f4 (127.26.185.1). New cstate: current_term: 1 leader_uuid: "26ad3285b83e43cf83013f5a045d28f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba4ef4604ed54aa2969f917c60d8d75e" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 34741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26ad3285b83e43cf83013f5a045d28f4" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8619926752284f8fb656d5efc31eaa16" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 45505 } health_report { overall_health: UNKNOWN } } }
W20260809 05:28:05.200448 3230 tablet.cc:2369] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 8619926752284f8fb656d5efc31eaa16: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:28:05.201551 3264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:05.198175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35484 (local address 127.26.185.1:43373)
0809 05:28:05.198428 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:05.198434 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:05.198566 (+ 132us) server_negotiation.cc:407] Connection header received
0809 05:28:05.198917 (+ 351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:05.198922 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:05.199163 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:05.199304 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:05.200663 (+ 1359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:05.200669 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:05.200673 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:28:05.200693 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:05.200766 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:28:05.200787 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:05.200967 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:05.201076 (+ 109us) server_negotiation.cc:299] Negotiation successful
0809 05:28:05.201160 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 05:28:05.213768 2930 raft_consensus.cc:1261] T ea56201fe3c84ebf8f34cf3e81ec8d94 P ba4ef4604ed54aa2969f917c60d8d75e [term 1 FOLLOWER]: Refusing update from remote peer 26ad3285b83e43cf83013f5a045d28f4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:28:05.213768 3141 raft_consensus.cc:1261] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 8619926752284f8fb656d5efc31eaa16 [term 1 FOLLOWER]: Refusing update from remote peer 26ad3285b83e43cf83013f5a045d28f4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:28:05.215490 3281 consensus_queue.cc:1035] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 26ad3285b83e43cf83013f5a045d28f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba4ef4604ed54aa2969f917c60d8d75e" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 34741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:28:05.216054 3276 consensus_queue.cc:1035] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 26ad3285b83e43cf83013f5a045d28f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8619926752284f8fb656d5efc31eaa16" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 45505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:28:05.255795 2499 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37406:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:28:05.256212 2499 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37406:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:28:05.261404 2499 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e33ad5b818c40168f982ccdcb67ccc5: Sending DeleteTablet for 3 replicas of tablet ea56201fe3c84ebf8f34cf3e81ec8d94
I20260809 05:28:05.263439 2703 tablet_service.cc:1514] Processing DeleteTablet for tablet ea56201fe3c84ebf8f34cf3e81ec8d94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:28:05 UTC) from {username='slave'} at 127.0.0.1:35480
I20260809 05:28:05.263474 3114 tablet_service.cc:1514] Processing DeleteTablet for tablet ea56201fe3c84ebf8f34cf3e81ec8d94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:28:05 UTC) from {username='slave'} at 127.0.0.1:33672
I20260809 05:28:05.263803 2901 tablet_service.cc:1514] Processing DeleteTablet for tablet ea56201fe3c84ebf8f34cf3e81ec8d94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:28:05 UTC) from {username='slave'} at 127.0.0.1:58962
I20260809 05:28:05.270021 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 2598
I20260809 05:28:05.278004 3303 tablet_replica.cc:330] T ea56201fe3c84ebf8f34cf3e81ec8d94 P ba4ef4604ed54aa2969f917c60d8d75e: stopping tablet replica
I20260809 05:28:05.278944 3300 tablet_replica.cc:330] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 26ad3285b83e43cf83013f5a045d28f4: stopping tablet replica
I20260809 05:28:05.281699 3300 raft_consensus.cc:2229] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 26ad3285b83e43cf83013f5a045d28f4 [term 1 LEADER]: Raft consensus shutting down.
I20260809 05:28:05.282639 3303 raft_consensus.cc:2229] T ea56201fe3c84ebf8f34cf3e81ec8d94 P ba4ef4604ed54aa2969f917c60d8d75e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:28:05.284090 3300 raft_consensus.cc:2258] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 26ad3285b83e43cf83013f5a045d28f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:28:05.284536 3264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:05.272224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35486 (local address 127.26.185.1:43373)
0809 05:28:05.272515 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:05.272526 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:05.275925 (+ 3399us) server_negotiation.cc:407] Connection header received
0809 05:28:05.279420 (+ 3495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:05.279429 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:05.279547 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:05.279671 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:05.283167 (+ 3496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:05.283178 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:05.283187 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:28:05.283227 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:05.283300 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:28:05.283326 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:05.283547 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:05.283869 (+ 322us) server_negotiation.cc:299] Negotiation successful
0809 05:28:05.283999 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260809 05:28:05.285138 3301 tablet_replica.cc:330] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 8619926752284f8fb656d5efc31eaa16: stopping tablet replica
I20260809 05:28:05.285749 3301 raft_consensus.cc:2229] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 8619926752284f8fb656d5efc31eaa16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:28:05.286206 3303 raft_consensus.cc:2258] T ea56201fe3c84ebf8f34cf3e81ec8d94 P ba4ef4604ed54aa2969f917c60d8d75e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:28:05.286464 2800 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:05.286496 3301 raft_consensus.cc:2258] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 8619926752284f8fb656d5efc31eaa16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:28:05.289299 3301 ts_tablet_manager.cc:1905] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 8619926752284f8fb656d5efc31eaa16: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:28:05.289300 3303 ts_tablet_manager.cc:1905] T ea56201fe3c84ebf8f34cf3e81ec8d94 P ba4ef4604ed54aa2969f917c60d8d75e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:28:05.298548 3301 ts_tablet_manager.cc:1918] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 8619926752284f8fb656d5efc31eaa16: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:28:05.298548 3303 ts_tablet_manager.cc:1918] T ea56201fe3c84ebf8f34cf3e81ec8d94 P ba4ef4604ed54aa2969f917c60d8d75e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:28:05.298799 3303 log.cc:1196] T ea56201fe3c84ebf8f34cf3e81ec8d94 P ba4ef4604ed54aa2969f917c60d8d75e: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-1/wal/wals/ea56201fe3c84ebf8f34cf3e81ec8d94
I20260809 05:28:05.298827 3301 log.cc:1196] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 8619926752284f8fb656d5efc31eaa16: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786253234117492-27364-0/minicluster-data/ts-2/wal/wals/ea56201fe3c84ebf8f34cf3e81ec8d94
I20260809 05:28:05.299574 3301 ts_tablet_manager.cc:1939] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 8619926752284f8fb656d5efc31eaa16: Deleting consensus metadata
I20260809 05:28:05.299563 3303 ts_tablet_manager.cc:1939] T ea56201fe3c84ebf8f34cf3e81ec8d94 P ba4ef4604ed54aa2969f917c60d8d75e: Deleting consensus metadata
I20260809 05:28:05.302197 2463 catalog_manager.cc:4841] TS ba4ef4604ed54aa2969f917c60d8d75e (127.26.185.2:34741): tablet ea56201fe3c84ebf8f34cf3e81ec8d94 (table test-table [id=e9e62a9188534978bb273c25b9e5a070]) successfully deleted
I20260809 05:28:05.302175 2468 catalog_manager.cc:4841] TS 8619926752284f8fb656d5efc31eaa16 (127.26.185.3:45505): tablet ea56201fe3c84ebf8f34cf3e81ec8d94 (table test-table [id=e9e62a9188534978bb273c25b9e5a070]) successfully deleted
I20260809 05:28:05.289271 3300 ts_tablet_manager.cc:1905] T ea56201fe3c84ebf8f34cf3e81ec8d94 P 26ad3285b83e43cf83013f5a045d28f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:28:05.395182 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 2598
I20260809 05:28:05.426857 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 2814
W20260809 05:28:05.426968 2463 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.185.1:43373 (error 108)
I20260809 05:28:05.429548 3260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:05.428919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:43373 (local address 127.0.0.1:35492)
0809 05:28:05.429152 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:05.429326 (+ 174us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.1:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
W20260809 05:28:05.429942 2463 catalog_manager.cc:4584] TS 26ad3285b83e43cf83013f5a045d28f4 (127.26.185.1:43373): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ea56201fe3c84ebf8f34cf3e81ec8d94: Network error: Client connection negotiation failed: client connection to 127.26.185.1:43373: connect: Connection refused (error 111)
I20260809 05:28:05.436772 3259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:05.427966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58978 (local address 127.26.185.2:34741)
0809 05:28:05.428217 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:05.428225 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:05.428357 (+ 132us) server_negotiation.cc:407] Connection header received
0809 05:28:05.428593 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:05.428598 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:05.428757 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:05.428886 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:05.436013 (+ 7127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:05.436020 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:05.436024 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:28:05.436049 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:05.436097 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:28:05.436113 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:05.436285 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:05.436395 (+ 110us) server_negotiation.cc:299] Negotiation successful
0809 05:28:05.436466 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260809 05:28:05.437602 2999 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:05.484213 3260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:05.483455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:43373 (local address 127.0.0.1:35506)
0809 05:28:05.483766 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:05.483985 (+ 219us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.1:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260809 05:28:05.485505 3260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:05.485074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:43373 (local address 127.0.0.1:35514)
0809 05:28:05.485248 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:05.485358 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.1:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 05:28:05.537475 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 2814
I20260809 05:28:05.546763 3260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:05.546150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:43373 (local address 127.0.0.1:35530)
0809 05:28:05.546415 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:05.546553 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.1:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260809 05:28:05.548532 3260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:05.547971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:43373 (local address 127.0.0.1:35542)
0809 05:28:05.548188 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:05.548316 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.1:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 05:28:05.570603 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 3013
I20260809 05:28:05.574761 3261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:05.571802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33680 (local address 127.26.185.3:45505)
0809 05:28:05.572032 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:05.572037 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:05.572060 (+ 23us) server_negotiation.cc:407] Connection header received
0809 05:28:05.572253 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:05.572259 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:05.572371 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:05.572471 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:05.573779 (+ 1308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:05.573785 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:05.573789 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:28:05.573810 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:05.573856 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:28:05.573879 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:05.574079 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:05.574236 (+ 157us) server_negotiation.cc:299] Negotiation successful
0809 05:28:05.574304 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 05:28:05.575834 3215 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:05.630400 3260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:05.629586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:43373 (local address 127.0.0.1:35550)
0809 05:28:05.629945 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:05.630094 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.1:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151}
I20260809 05:28:05.632189 3260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:05.631587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:43373 (local address 127.0.0.1:35554)
0809 05:28:05.631891 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:05.631999 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.1:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163}
I20260809 05:28:05.678862 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 3013
I20260809 05:28:05.712467 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 2442
I20260809 05:28:05.714318 2548 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:05.855988 3260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:05.855354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:43373 (local address 127.0.0.1:35560)
0809 05:28:05.855641 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:05.855775 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.1:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 05:28:05.856762 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 2442
2026-08-09T05:28:05Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (3422 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260809 05:28:05.916388 27364 mini_oidc.cc:152] Starting JWKS server
I20260809 05:28:05.919962 27364 webserver.cc:460] Webserver started at https://127.0.0.1:39607/ using document root <none> and password file <none>
I20260809 05:28:05.920439 27364 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 05:28:05.921244 27364 webserver.cc:460] Webserver started at http://127.0.0.1:40357/ using document root <none> and password file <none>
2026-08-09T05:28:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:28:05Z Disabled control of system clock
I20260809 05:28:05.972419 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:42033
--webserver_interface=127.26.185.62
--webserver_port=0
--builtin_ntp_servers=127.26.185.20:42263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:42033
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39607/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786253234117492-27364-0/testchainca.cert with env {}
W20260809 05:28:06.394517 3317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:06.395051 3317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:06.395253 3317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:06.403498 3317 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:28:06.403689 3317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:06.403788 3317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:06.403911 3317 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:28:06.404006 3317 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 05:28:06.404107 3317 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 05:28:06.404191 3317 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39607/jwks.json
I20260809 05:28:06.415693 3317 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:42263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:42033
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:42033
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39607/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786253234117492-27364-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:06.417598 3317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:06.419493 3317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:06.434957 3326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:06.434904 3327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:06.435267 3333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:06.436357 3317 server_base.cc:1034] running on GCE node
I20260809 05:28:06.437703 3317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:06.439972 3317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:06.441254 3317 hybrid_clock.cc:648] HybridClock initialized: now 1786253286441212 us; error 55 us; skew 500 ppm
I20260809 05:28:06.441718 3317 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 05:28:06.449365 3317 webserver.cc:460] Webserver started at http://127.26.185.62:43261/ using document root <none> and password file <none>
I20260809 05:28:06.450443 3317 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:06.450623 3317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:06.451151 3317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:28:06.455335 3317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "e4cd4e8889364e39b2f45784a434f106"
format_stamp: "Formatted at 2026-08-09 05:28:06 on dist-test-slave-h3ft"
server_key: "9a7018d4067a36032712fcb3164387a7"
server_key_iv: "c8ce6a9c7972b41b7bb1f786a6e608c1"
server_key_version: "encryptionkey@0"
I20260809 05:28:06.456462 3317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "e4cd4e8889364e39b2f45784a434f106"
format_stamp: "Formatted at 2026-08-09 05:28:06 on dist-test-slave-h3ft"
server_key: "9a7018d4067a36032712fcb3164387a7"
server_key_iv: "c8ce6a9c7972b41b7bb1f786a6e608c1"
server_key_version: "encryptionkey@0"
I20260809 05:28:06.463692 3317 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.003s sys 0.005s
I20260809 05:28:06.468573 3341 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:06.470521 3317 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 05:28:06.470808 3317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "e4cd4e8889364e39b2f45784a434f106"
format_stamp: "Formatted at 2026-08-09 05:28:06 on dist-test-slave-h3ft"
server_key: "9a7018d4067a36032712fcb3164387a7"
server_key_iv: "c8ce6a9c7972b41b7bb1f786a6e608c1"
server_key_version: "encryptionkey@0"
I20260809 05:28:06.471190 3317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:06.489509 3317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:06.490658 3317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:06.491129 3317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:06.513669 3317 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:42033
I20260809 05:28:06.513693 3425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:42033 every 8 connection(s)
I20260809 05:28:06.515785 3317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:28:06.517859 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 3317
I20260809 05:28:06.518119 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:28:06.519066 27364 external_mini_cluster.cc:1428] Setting key b05a32fe2c501c290d38d6993c69ad8d
I20260809 05:28:06.521863 3428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:06.536468 3432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:06.521544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51700 (local address 127.26.185.62:42033)
0809 05:28:06.522782 (+ 1238us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:06.522795 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:06.522850 (+ 55us) server_negotiation.cc:407] Connection header received
0809 05:28:06.524787 (+ 1937us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:06.524812 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:06.525376 (+ 564us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:06.525792 (+ 416us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:06.526578 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:06.528210 (+ 1632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:06.530314 (+ 2104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:06.531468 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:06.531632 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:06.533266 (+ 1634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:06.533277 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:06.533297 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:28:06.534127 (+ 830us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:06.534237 (+ 110us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:28:06.534266 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:06.534370 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:06.534688 (+ 318us) server_negotiation.cc:299] Negotiation successful
0809 05:28:06.535225 (+ 537us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":715,"thread_start_us":489,"threads_started":1}
I20260809 05:28:06.537195 3428 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4cd4e8889364e39b2f45784a434f106: Bootstrap starting.
I20260809 05:28:06.541725 27364 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 05:28:06.541882 3428 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e4cd4e8889364e39b2f45784a434f106: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:06.543399 3428 log.cc:824] T 00000000000000000000000000000000 P e4cd4e8889364e39b2f45784a434f106: Log is configured to *not* fsync() on all Append() calls
I20260809 05:28:06.547542 3428 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4cd4e8889364e39b2f45784a434f106: No bootstrap required, opened a new log
I20260809 05:28:06.556370 3428 raft_consensus.cc:348] T 00000000000000000000000000000000 P e4cd4e8889364e39b2f45784a434f106 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4cd4e8889364e39b2f45784a434f106" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42033 } }
I20260809 05:28:06.557016 3428 raft_consensus.cc:374] T 00000000000000000000000000000000 P e4cd4e8889364e39b2f45784a434f106 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:06.557137 3428 raft_consensus.cc:729] T 00000000000000000000000000000000 P e4cd4e8889364e39b2f45784a434f106 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4cd4e8889364e39b2f45784a434f106, State: Initialized, Role: FOLLOWER
I20260809 05:28:06.557902 3428 consensus_queue.cc:260] T 00000000000000000000000000000000 P e4cd4e8889364e39b2f45784a434f106 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4cd4e8889364e39b2f45784a434f106" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42033 } }
I20260809 05:28:06.558185 3428 raft_consensus.cc:388] T 00000000000000000000000000000000 P e4cd4e8889364e39b2f45784a434f106 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:28:06.558339 3428 raft_consensus.cc:482] T 00000000000000000000000000000000 P e4cd4e8889364e39b2f45784a434f106 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:28:06.558544 3428 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e4cd4e8889364e39b2f45784a434f106 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:06.561101 3428 raft_consensus.cc:504] T 00000000000000000000000000000000 P e4cd4e8889364e39b2f45784a434f106 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4cd4e8889364e39b2f45784a434f106" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42033 } }
I20260809 05:28:06.561738 3428 leader_election.cc:302] T 00000000000000000000000000000000 P e4cd4e8889364e39b2f45784a434f106 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e4cd4e8889364e39b2f45784a434f106; no voters:
I20260809 05:28:06.562479 3428 leader_election.cc:288] T 00000000000000000000000000000000 P e4cd4e8889364e39b2f45784a434f106 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:28:06.562669 3436 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e4cd4e8889364e39b2f45784a434f106 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:28:06.563594 3436 raft_consensus.cc:686] T 00000000000000000000000000000000 P e4cd4e8889364e39b2f45784a434f106 [term 1 LEADER]: Becoming Leader. State: Replica: e4cd4e8889364e39b2f45784a434f106, State: Running, Role: LEADER
I20260809 05:28:06.564193 3436 consensus_queue.cc:237] T 00000000000000000000000000000000 P e4cd4e8889364e39b2f45784a434f106 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4cd4e8889364e39b2f45784a434f106" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42033 } }
I20260809 05:28:06.565228 3428 sys_catalog.cc:564] T 00000000000000000000000000000000 P e4cd4e8889364e39b2f45784a434f106 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:28:06.568086 3438 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4cd4e8889364e39b2f45784a434f106 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e4cd4e8889364e39b2f45784a434f106. Latest consensus state: current_term: 1 leader_uuid: "e4cd4e8889364e39b2f45784a434f106" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4cd4e8889364e39b2f45784a434f106" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42033 } } }
I20260809 05:28:06.568145 3437 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4cd4e8889364e39b2f45784a434f106 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e4cd4e8889364e39b2f45784a434f106" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4cd4e8889364e39b2f45784a434f106" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42033 } } }
I20260809 05:28:06.568837 3437 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4cd4e8889364e39b2f45784a434f106 [sys.catalog]: This master's current role is: LEADER
I20260809 05:28:06.568849 3438 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4cd4e8889364e39b2f45784a434f106 [sys.catalog]: This master's current role is: LEADER
I20260809 05:28:06.571667 3447 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:28:06.578418 3447 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:28:06.590655 3447 catalog_manager.cc:1347] Generated new cluster ID: 18a1ebbfd9574a4f8ba23959fea21738
I20260809 05:28:06.590838 3447 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:28:06.616120 3447 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:28:06.618523 3447 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:28:06.628808 3447 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e4cd4e8889364e39b2f45784a434f106: Generated new TSK 0
I20260809 05:28:06.630218 3447 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 05:28:06.688247 3475 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260809 05:28:06.688557 3475 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 05:28:06.689697 3432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:06.657096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51702 (local address 127.26.185.62:42033)
0809 05:28:06.657396 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:06.657404 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:06.657956 (+ 552us) server_negotiation.cc:407] Connection header received
0809 05:28:06.658438 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:06.658443 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:06.658544 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:06.658688 (+ 144us) server_negotiation.cc:226] Negotiated authn=JWT
0809 05:28:06.659512 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:06.660327 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:06.662744 (+ 2417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:06.663391 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:06.663519 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:06.664345 (+ 826us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 05:28:06.688924 (+ 24579us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39607/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 05:28:06.689374 (+ 450us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51702: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39607/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":112}
W20260809 05:28:06.689898 3432 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51702: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39607/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260809 05:28:06.692534 3472 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:06.656873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:42033 (local address 127.0.0.1:51702)
0809 05:28:06.657749 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:06.657775 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:06.658043 (+ 268us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:06.658767 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:06.658776 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:06.658793 (+ 17us) client_negotiation.cc:189] Negotiated authn=JWT
0809 05:28:06.659324 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:06.659338 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:06.660491 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:06.660497 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:06.662560 (+ 2063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:06.662580 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:06.663621 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:06.663631 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:06.663852 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:06.663960 (+ 108us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 05:28:06.689367 (+ 25407us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39607/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 05:28:06.689858 (+ 491us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.185.62:42033: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39607/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":407,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.26.185.62:42033: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39607/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260809 05:28:06.694862 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 3317
I20260809 05:28:06.696564 3417 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:06.807322 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 3317
2026-08-09T05:28:06Z chronyd exiting
I20260809 05:28:06.875854 27364 test_util.cc:175] -----------------------------------------------
I20260809 05:28:06.876092 27364 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786253234117492-27364-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (965 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260809 05:28:06.883435 27364 mini_oidc.cc:152] Starting JWKS server
I20260809 05:28:06.885758 27364 webserver.cc:460] Webserver started at https://127.0.0.1:46051/ using document root <none> and password file <none>
I20260809 05:28:06.886121 27364 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 05:28:06.887038 27364 webserver.cc:460] Webserver started at http://127.0.0.1:35843/ using document root <none> and password file <none>
2026-08-09T05:28:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:28:06Z Disabled control of system clock
I20260809 05:28:06.938423 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:43073
--webserver_interface=127.26.185.62
--webserver_port=0
--builtin_ntp_servers=127.26.185.20:42255
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:43073
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46051/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786253234117492-27364-0/testchainca.cert with env {}
W20260809 05:28:07.376222 3484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:07.376670 3484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:07.376781 3484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:07.385143 3484 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:28:07.385304 3484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:07.385345 3484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:07.385411 3484 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:28:07.385460 3484 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 05:28:07.385532 3484 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 05:28:07.385576 3484 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:46051/jwks.json
I20260809 05:28:07.397850 3484 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:42255
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:43073
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:43073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46051/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786253234117492-27364-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:07.399803 3484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:07.401539 3484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:07.416167 3491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:07.416910 3494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:07.417291 3496 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:07.418156 3484 server_base.cc:1034] running on GCE node
I20260809 05:28:07.419486 3484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:07.421583 3484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:07.422835 3484 hybrid_clock.cc:648] HybridClock initialized: now 1786253287422749 us; error 72 us; skew 500 ppm
I20260809 05:28:07.423349 3484 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 05:28:07.426445 3484 webserver.cc:460] Webserver started at http://127.26.185.62:42363/ using document root <none> and password file <none>
I20260809 05:28:07.427487 3484 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:07.427630 3484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:07.428053 3484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:28:07.431970 3484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "dcf0c9f0b24c409c815f68416438831b"
format_stamp: "Formatted at 2026-08-09 05:28:07 on dist-test-slave-h3ft"
server_key: "6842ad26312451d37e6f9efae9322ca6"
server_key_iv: "d663399dba7f914f350b44567f4df778"
server_key_version: "encryptionkey@0"
I20260809 05:28:07.433058 3484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "dcf0c9f0b24c409c815f68416438831b"
format_stamp: "Formatted at 2026-08-09 05:28:07 on dist-test-slave-h3ft"
server_key: "6842ad26312451d37e6f9efae9322ca6"
server_key_iv: "d663399dba7f914f350b44567f4df778"
server_key_version: "encryptionkey@0"
I20260809 05:28:07.440567 3484 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260809 05:28:07.445783 3509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:07.448081 3484 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260809 05:28:07.448369 3484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "dcf0c9f0b24c409c815f68416438831b"
format_stamp: "Formatted at 2026-08-09 05:28:07 on dist-test-slave-h3ft"
server_key: "6842ad26312451d37e6f9efae9322ca6"
server_key_iv: "d663399dba7f914f350b44567f4df778"
server_key_version: "encryptionkey@0"
I20260809 05:28:07.448716 3484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:07.492066 3484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:07.493386 3484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:07.493850 3484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:07.519825 3484 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:43073
I20260809 05:28:07.519842 3592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:43073 every 8 connection(s)
I20260809 05:28:07.521757 3484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:28:07.527226 3593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:07.528163 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 3484
I20260809 05:28:07.528419 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:28:07.529529 27364 external_mini_cluster.cc:1428] Setting key 4268870c1b0e7bf95445b4d0c318068c
I20260809 05:28:07.546463 3593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dcf0c9f0b24c409c815f68416438831b: Bootstrap starting.
I20260809 05:28:07.548683 3598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:07.532459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53646 (local address 127.26.185.62:43073)
0809 05:28:07.533963 (+ 1504us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:07.533980 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:07.534045 (+ 65us) server_negotiation.cc:407] Connection header received
0809 05:28:07.536425 (+ 2380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:07.536463 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:07.537228 (+ 765us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:07.537731 (+ 503us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:07.538518 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:07.540108 (+ 1590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:07.542410 (+ 2302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:07.543523 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:07.543711 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:07.545391 (+ 1680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:07.545401 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:07.545424 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:28:07.546277 (+ 853us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:07.546396 (+ 119us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:28:07.546424 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:07.546542 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:07.546914 (+ 372us) server_negotiation.cc:299] Negotiation successful
0809 05:28:07.547437 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":810,"thread_start_us":525,"threads_started":1}
I20260809 05:28:07.551208 3593 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dcf0c9f0b24c409c815f68416438831b: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:07.552840 3593 log.cc:824] T 00000000000000000000000000000000 P dcf0c9f0b24c409c815f68416438831b: Log is configured to *not* fsync() on all Append() calls
I20260809 05:28:07.553960 27364 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 05:28:07.557636 3593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dcf0c9f0b24c409c815f68416438831b: No bootstrap required, opened a new log
I20260809 05:28:07.566656 3593 raft_consensus.cc:348] T 00000000000000000000000000000000 P dcf0c9f0b24c409c815f68416438831b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcf0c9f0b24c409c815f68416438831b" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43073 } }
I20260809 05:28:07.567319 3593 raft_consensus.cc:374] T 00000000000000000000000000000000 P dcf0c9f0b24c409c815f68416438831b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:07.567454 3593 raft_consensus.cc:729] T 00000000000000000000000000000000 P dcf0c9f0b24c409c815f68416438831b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcf0c9f0b24c409c815f68416438831b, State: Initialized, Role: FOLLOWER
I20260809 05:28:07.568246 3593 consensus_queue.cc:260] T 00000000000000000000000000000000 P dcf0c9f0b24c409c815f68416438831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcf0c9f0b24c409c815f68416438831b" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43073 } }
I20260809 05:28:07.568542 3593 raft_consensus.cc:388] T 00000000000000000000000000000000 P dcf0c9f0b24c409c815f68416438831b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:28:07.568732 3593 raft_consensus.cc:482] T 00000000000000000000000000000000 P dcf0c9f0b24c409c815f68416438831b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:28:07.568943 3593 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dcf0c9f0b24c409c815f68416438831b [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:07.572043 3593 raft_consensus.cc:504] T 00000000000000000000000000000000 P dcf0c9f0b24c409c815f68416438831b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcf0c9f0b24c409c815f68416438831b" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43073 } }
I20260809 05:28:07.572919 3593 leader_election.cc:302] T 00000000000000000000000000000000 P dcf0c9f0b24c409c815f68416438831b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dcf0c9f0b24c409c815f68416438831b; no voters:
I20260809 05:28:07.573910 3593 leader_election.cc:288] T 00000000000000000000000000000000 P dcf0c9f0b24c409c815f68416438831b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:28:07.574061 3600 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dcf0c9f0b24c409c815f68416438831b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:28:07.575362 3600 raft_consensus.cc:686] T 00000000000000000000000000000000 P dcf0c9f0b24c409c815f68416438831b [term 1 LEADER]: Becoming Leader. State: Replica: dcf0c9f0b24c409c815f68416438831b, State: Running, Role: LEADER
I20260809 05:28:07.576211 3600 consensus_queue.cc:237] T 00000000000000000000000000000000 P dcf0c9f0b24c409c815f68416438831b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcf0c9f0b24c409c815f68416438831b" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43073 } }
I20260809 05:28:07.577593 3593 sys_catalog.cc:564] T 00000000000000000000000000000000 P dcf0c9f0b24c409c815f68416438831b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:28:07.581193 3602 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcf0c9f0b24c409c815f68416438831b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dcf0c9f0b24c409c815f68416438831b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcf0c9f0b24c409c815f68416438831b" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43073 } } }
I20260809 05:28:07.581907 3602 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcf0c9f0b24c409c815f68416438831b [sys.catalog]: This master's current role is: LEADER
I20260809 05:28:07.581684 3603 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcf0c9f0b24c409c815f68416438831b [sys.catalog]: SysCatalogTable state changed. Reason: New leader dcf0c9f0b24c409c815f68416438831b. Latest consensus state: current_term: 1 leader_uuid: "dcf0c9f0b24c409c815f68416438831b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcf0c9f0b24c409c815f68416438831b" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43073 } } }
I20260809 05:28:07.583117 3603 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcf0c9f0b24c409c815f68416438831b [sys.catalog]: This master's current role is: LEADER
I20260809 05:28:07.583256 3611 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:28:07.591373 3611 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:28:07.602898 3611 catalog_manager.cc:1347] Generated new cluster ID: d4026f5737b84d63ada0ceac2cb21747
I20260809 05:28:07.603112 3611 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:28:07.651912 3611 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:28:07.653896 3611 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:28:07.661820 3611 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dcf0c9f0b24c409c815f68416438831b: Generated new TSK 0
I20260809 05:28:07.663213 3611 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 05:28:07.708626 3635 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260809 05:28:07.708833 3635 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 05:28:07.710631 3598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:07.686700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53656 (local address 127.26.185.62:43073)
0809 05:28:07.686992 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:07.687035 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:07.687583 (+ 548us) server_negotiation.cc:407] Connection header received
0809 05:28:07.687956 (+ 373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:07.687971 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:07.688095 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:07.688329 (+ 234us) server_negotiation.cc:226] Negotiated authn=JWT
0809 05:28:07.688956 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:07.690251 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:07.691909 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:07.692740 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:07.692891 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:07.693614 (+ 723us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 05:28:07.709663 (+ 16049us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46051/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 05:28:07.710233 (+ 570us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53656: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46051/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":114}
W20260809 05:28:07.710811 3598 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53656: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46051/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260809 05:28:07.710809 3634 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:07.686513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:43073 (local address 127.0.0.1:53656)
0809 05:28:07.687435 (+ 922us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:07.687461 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:07.687699 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:07.688330 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:07.688334 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:07.688347 (+ 13us) client_negotiation.cc:189] Negotiated authn=JWT
0809 05:28:07.688751 (+ 404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:07.688763 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:07.690461 (+ 1698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:07.690467 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:07.691738 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:07.691755 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:07.692984 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:07.692990 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:07.693176 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:07.693227 (+ 51us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 05:28:07.710094 (+ 16867us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46051/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 05:28:07.710388 (+ 294us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.185.62:43073: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46051/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":710,"thread_start_us":498,"threads_started":1}
I20260809 05:28:07.712509 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 3484
I20260809 05:28:07.714138 3584 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:07.824613 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 3484
2026-08-09T05:28:07Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (1016 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260809 05:28:07.896961 27364 mini_oidc.cc:152] Starting JWKS server
I20260809 05:28:07.899364 27364 webserver.cc:460] Webserver started at https://127.0.0.1:44421/ using document root <none> and password file <none>
I20260809 05:28:07.899672 27364 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 05:28:07.900514 27364 webserver.cc:460] Webserver started at http://127.0.0.1:45909/ using document root <none> and password file <none>
2026-08-09T05:28:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:28:07Z Disabled control of system clock
I20260809 05:28:07.949968 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:33941
--webserver_interface=127.26.185.62
--webserver_port=0
--builtin_ntp_servers=127.26.185.20:45685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:33941
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44421/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 05:28:08.388859 3645 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:08.389360 3645 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:08.389521 3645 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:08.397889 3645 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:28:08.398120 3645 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:08.398233 3645 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:08.398353 3645 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:28:08.398437 3645 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 05:28:08.398537 3645 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 05:28:08.398617 3645 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44421/jwks.json
I20260809 05:28:08.409305 3645 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:45685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:33941
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:33941
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44421/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:08.411177 3645 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:08.413642 3645 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:08.428325 3653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:08.428277 3659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:08.428368 3654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:08.429536 3645 server_base.cc:1034] running on GCE node
I20260809 05:28:08.430616 3645 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:08.432662 3645 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:08.433954 3645 hybrid_clock.cc:648] HybridClock initialized: now 1786253288433855 us; error 96 us; skew 500 ppm
I20260809 05:28:08.434418 3645 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 05:28:08.437477 3645 webserver.cc:460] Webserver started at http://127.26.185.62:38973/ using document root <none> and password file <none>
I20260809 05:28:08.438472 3645 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:08.438642 3645 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:08.439159 3645 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:28:08.443210 3645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "6d0b793dfbea4b73bd027e253e82f679"
format_stamp: "Formatted at 2026-08-09 05:28:08 on dist-test-slave-h3ft"
server_key: "5ae0431bb44c080bc53eb6d48d24d7f7"
server_key_iv: "d7a1aec387a94e3c466bd5653492c186"
server_key_version: "encryptionkey@0"
I20260809 05:28:08.444335 3645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "6d0b793dfbea4b73bd027e253e82f679"
format_stamp: "Formatted at 2026-08-09 05:28:08 on dist-test-slave-h3ft"
server_key: "5ae0431bb44c080bc53eb6d48d24d7f7"
server_key_iv: "d7a1aec387a94e3c466bd5653492c186"
server_key_version: "encryptionkey@0"
I20260809 05:28:08.450870 3645 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.003s
I20260809 05:28:08.455574 3672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:08.457546 3645 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.004s
I20260809 05:28:08.457824 3645 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "6d0b793dfbea4b73bd027e253e82f679"
format_stamp: "Formatted at 2026-08-09 05:28:08 on dist-test-slave-h3ft"
server_key: "5ae0431bb44c080bc53eb6d48d24d7f7"
server_key_iv: "d7a1aec387a94e3c466bd5653492c186"
server_key_version: "encryptionkey@0"
I20260809 05:28:08.458148 3645 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:08.502331 3645 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:08.503664 3645 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:08.504094 3645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:08.527890 3645 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:33941
I20260809 05:28:08.527952 3753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:33941 every 8 connection(s)
I20260809 05:28:08.529850 3645 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:28:08.534917 3755 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:08.537072 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 3645
I20260809 05:28:08.537358 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:28:08.538344 27364 external_mini_cluster.cc:1428] Setting key 70ca69319e662221ef149cfea70efddd
I20260809 05:28:08.549827 3755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d0b793dfbea4b73bd027e253e82f679: Bootstrap starting.
I20260809 05:28:08.554004 3755 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6d0b793dfbea4b73bd027e253e82f679: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:08.555229 3761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:08.541001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33000 (local address 127.26.185.62:33941)
0809 05:28:08.542379 (+ 1378us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:08.542395 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:08.542457 (+ 62us) server_negotiation.cc:407] Connection header received
0809 05:28:08.544649 (+ 2192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:08.544682 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:08.545295 (+ 613us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:08.545800 (+ 505us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:08.546549 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:08.548137 (+ 1588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:08.549706 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:08.550581 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:08.550806 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:08.552270 (+ 1464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:08.552279 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:08.552296 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:28:08.552978 (+ 682us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:08.553071 (+ 93us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:28:08.553095 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:08.553245 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:08.553511 (+ 266us) server_negotiation.cc:299] Negotiation successful
0809 05:28:08.553912 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":741,"thread_start_us":462,"threads_started":1}
I20260809 05:28:08.555500 3755 log.cc:824] T 00000000000000000000000000000000 P 6d0b793dfbea4b73bd027e253e82f679: Log is configured to *not* fsync() on all Append() calls
I20260809 05:28:08.559332 3755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d0b793dfbea4b73bd027e253e82f679: No bootstrap required, opened a new log
I20260809 05:28:08.560114 27364 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 05:28:08.568573 3755 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6d0b793dfbea4b73bd027e253e82f679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d0b793dfbea4b73bd027e253e82f679" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33941 } }
I20260809 05:28:08.569118 3755 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6d0b793dfbea4b73bd027e253e82f679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:08.569242 3755 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6d0b793dfbea4b73bd027e253e82f679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d0b793dfbea4b73bd027e253e82f679, State: Initialized, Role: FOLLOWER
I20260809 05:28:08.569995 3755 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6d0b793dfbea4b73bd027e253e82f679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d0b793dfbea4b73bd027e253e82f679" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33941 } }
I20260809 05:28:08.570370 3755 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6d0b793dfbea4b73bd027e253e82f679 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:28:08.570564 3755 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6d0b793dfbea4b73bd027e253e82f679 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:28:08.570791 3755 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6d0b793dfbea4b73bd027e253e82f679 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:08.573499 3755 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6d0b793dfbea4b73bd027e253e82f679 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d0b793dfbea4b73bd027e253e82f679" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33941 } }
I20260809 05:28:08.574144 3755 leader_election.cc:302] T 00000000000000000000000000000000 P 6d0b793dfbea4b73bd027e253e82f679 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d0b793dfbea4b73bd027e253e82f679; no voters:
I20260809 05:28:08.574838 3755 leader_election.cc:288] T 00000000000000000000000000000000 P 6d0b793dfbea4b73bd027e253e82f679 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:28:08.575053 3763 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6d0b793dfbea4b73bd027e253e82f679 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:28:08.576910 3763 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6d0b793dfbea4b73bd027e253e82f679 [term 1 LEADER]: Becoming Leader. State: Replica: 6d0b793dfbea4b73bd027e253e82f679, State: Running, Role: LEADER
I20260809 05:28:08.577605 3763 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6d0b793dfbea4b73bd027e253e82f679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d0b793dfbea4b73bd027e253e82f679" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33941 } }
I20260809 05:28:08.578328 3755 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6d0b793dfbea4b73bd027e253e82f679 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:28:08.581621 3766 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d0b793dfbea4b73bd027e253e82f679 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6d0b793dfbea4b73bd027e253e82f679" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d0b793dfbea4b73bd027e253e82f679" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33941 } } }
I20260809 05:28:08.582134 3766 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d0b793dfbea4b73bd027e253e82f679 [sys.catalog]: This master's current role is: LEADER
I20260809 05:28:08.583384 3768 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d0b793dfbea4b73bd027e253e82f679 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6d0b793dfbea4b73bd027e253e82f679. Latest consensus state: current_term: 1 leader_uuid: "6d0b793dfbea4b73bd027e253e82f679" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d0b793dfbea4b73bd027e253e82f679" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33941 } } }
I20260809 05:28:08.583877 3768 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d0b793dfbea4b73bd027e253e82f679 [sys.catalog]: This master's current role is: LEADER
I20260809 05:28:08.585541 3777 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:28:08.592420 3777 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:28:08.604921 3777 catalog_manager.cc:1347] Generated new cluster ID: ed529ce9942946608bead2b620c2a068
I20260809 05:28:08.605113 3777 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:28:08.626426 3777 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:28:08.628274 3777 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:28:08.641603 3777 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6d0b793dfbea4b73bd027e253e82f679: Generated new TSK 0
I20260809 05:28:08.643055 3777 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 05:28:08.670710 3761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:08.660123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33012 (local address 127.26.185.62:33941)
0809 05:28:08.660405 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:08.660419 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:08.660933 (+ 514us) server_negotiation.cc:407] Connection header received
0809 05:28:08.661284 (+ 351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:08.661291 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:08.661435 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:08.661663 (+ 228us) server_negotiation.cc:226] Negotiated authn=JWT
0809 05:28:08.662278 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:08.663577 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:08.665383 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:08.666142 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:08.666282 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:08.666912 (+ 630us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 05:28:08.669884 (+ 2972us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44421/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 05:28:08.670311 (+ 427us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:33012: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44421/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":97}
W20260809 05:28:08.670897 3761 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:33012: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44421/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260809 05:28:08.672417 3800 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:08.659935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33941 (local address 127.0.0.1:33012)
0809 05:28:08.660792 (+ 857us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:08.660813 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:08.661038 (+ 225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:08.661692 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:08.661696 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:08.661710 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0809 05:28:08.662096 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:08.662107 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:08.663795 (+ 1688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:08.663800 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:08.665191 (+ 1391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:08.665206 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:08.666372 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:08.666377 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:08.666523 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:08.666566 (+ 43us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 05:28:08.670155 (+ 3589us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44421/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 05:28:08.671903 (+ 1748us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.185.62:33941: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44421/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":680,"mutex_wait_us":1356,"thread_start_us":474,"threads_started":1}
I20260809 05:28:08.674748 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 3645
I20260809 05:28:08.676375 3745 generic_service.cc:196] Checking for leaks (request via RPC)
E20260809 05:28:08.682816 3802 webserver.cc:533] Webserver: sslize failed:
E20260809 05:28:08.682958 3802 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 05:28:08.781458 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 3645
2026-08-09T05:28:08Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (955 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-09T05:28:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:28:08Z Disabled control of system clock
I20260809 05:28:08.902750 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:33245
--webserver_interface=127.26.185.62
--webserver_port=0
--builtin_ntp_servers=127.26.185.20:45325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:33245
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786253234117492-27364-0/testchainca.cert with env {}
W20260809 05:28:09.343531 3809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:09.343947 3809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:09.344101 3809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:09.352428 3809 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:28:09.352612 3809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:09.352656 3809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:09.352756 3809 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:28:09.352852 3809 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 05:28:09.352960 3809 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 05:28:09.353022 3809 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260809 05:28:09.364835 3809 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:45325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:33245
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:33245
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786253234117492-27364-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:09.366719 3809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:09.368552 3809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:09.383802 3816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:09.383744 3823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:09.383705 3820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:09.384896 3809 server_base.cc:1034] running on GCE node
I20260809 05:28:09.386008 3809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:09.387902 3809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:09.389117 3809 hybrid_clock.cc:648] HybridClock initialized: now 1786253289389057 us; error 63 us; skew 500 ppm
I20260809 05:28:09.389524 3809 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 05:28:09.392458 3809 webserver.cc:460] Webserver started at http://127.26.185.62:39893/ using document root <none> and password file <none>
I20260809 05:28:09.393384 3809 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:09.393518 3809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:09.393930 3809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:28:09.397780 3809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "364287a816084d5590ed45829b44c263"
format_stamp: "Formatted at 2026-08-09 05:28:09 on dist-test-slave-h3ft"
server_key: "fb1e3e82b8fe43bfbcf29eb7499c23f0"
server_key_iv: "0631a9f5604308e17db4fc8807019797"
server_key_version: "encryptionkey@0"
I20260809 05:28:09.398756 3809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "364287a816084d5590ed45829b44c263"
format_stamp: "Formatted at 2026-08-09 05:28:09 on dist-test-slave-h3ft"
server_key: "fb1e3e82b8fe43bfbcf29eb7499c23f0"
server_key_iv: "0631a9f5604308e17db4fc8807019797"
server_key_version: "encryptionkey@0"
I20260809 05:28:09.405275 3809 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260809 05:28:09.409822 3830 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:09.411710 3809 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:28:09.412002 3809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "364287a816084d5590ed45829b44c263"
format_stamp: "Formatted at 2026-08-09 05:28:09 on dist-test-slave-h3ft"
server_key: "fb1e3e82b8fe43bfbcf29eb7499c23f0"
server_key_iv: "0631a9f5604308e17db4fc8807019797"
server_key_version: "encryptionkey@0"
I20260809 05:28:09.412295 3809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:09.438972 3809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:09.440276 3809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:09.440671 3809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:09.463765 3809 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:33245
I20260809 05:28:09.463806 3914 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:33245 every 8 connection(s)
I20260809 05:28:09.465583 3809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:28:09.470783 3915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:09.472846 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 3809
I20260809 05:28:09.473116 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:28:09.473980 27364 external_mini_cluster.cc:1428] Setting key d13414a892d4699596d8b49d63b609da
I20260809 05:28:09.485273 3915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 364287a816084d5590ed45829b44c263: Bootstrap starting.
I20260809 05:28:09.490051 3915 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 364287a816084d5590ed45829b44c263: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:09.491571 3915 log.cc:824] T 00000000000000000000000000000000 P 364287a816084d5590ed45829b44c263: Log is configured to *not* fsync() on all Append() calls
I20260809 05:28:09.492220 3919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:09.476804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40912 (local address 127.26.185.62:33245)
0809 05:28:09.478233 (+ 1429us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:09.478247 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:09.478308 (+ 61us) server_negotiation.cc:407] Connection header received
0809 05:28:09.480407 (+ 2099us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:09.480441 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:09.481145 (+ 704us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:09.481610 (+ 465us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:09.482413 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:09.484048 (+ 1635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:09.486076 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:09.486972 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:09.487249 (+ 277us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:09.488874 (+ 1625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:09.488885 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:09.488904 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:28:09.489612 (+ 708us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:09.489732 (+ 120us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:28:09.489758 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:09.489866 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:09.490274 (+ 408us) server_negotiation.cc:299] Negotiation successful
0809 05:28:09.490678 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":869,"thread_start_us":521,"threads_started":1}
I20260809 05:28:09.495527 3915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 364287a816084d5590ed45829b44c263: No bootstrap required, opened a new log
I20260809 05:28:09.497237 27364 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 05:28:09.504479 3915 raft_consensus.cc:348] T 00000000000000000000000000000000 P 364287a816084d5590ed45829b44c263 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "364287a816084d5590ed45829b44c263" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33245 } }
I20260809 05:28:09.505084 3915 raft_consensus.cc:374] T 00000000000000000000000000000000 P 364287a816084d5590ed45829b44c263 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:09.505249 3915 raft_consensus.cc:729] T 00000000000000000000000000000000 P 364287a816084d5590ed45829b44c263 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 364287a816084d5590ed45829b44c263, State: Initialized, Role: FOLLOWER
I20260809 05:28:09.506009 3915 consensus_queue.cc:260] T 00000000000000000000000000000000 P 364287a816084d5590ed45829b44c263 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "364287a816084d5590ed45829b44c263" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33245 } }
I20260809 05:28:09.506278 3915 raft_consensus.cc:388] T 00000000000000000000000000000000 P 364287a816084d5590ed45829b44c263 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:28:09.506453 3915 raft_consensus.cc:482] T 00000000000000000000000000000000 P 364287a816084d5590ed45829b44c263 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:28:09.506671 3915 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 364287a816084d5590ed45829b44c263 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:09.509214 3915 raft_consensus.cc:504] T 00000000000000000000000000000000 P 364287a816084d5590ed45829b44c263 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "364287a816084d5590ed45829b44c263" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33245 } }
I20260809 05:28:09.509931 3915 leader_election.cc:302] T 00000000000000000000000000000000 P 364287a816084d5590ed45829b44c263 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 364287a816084d5590ed45829b44c263; no voters:
I20260809 05:28:09.510834 3915 leader_election.cc:288] T 00000000000000000000000000000000 P 364287a816084d5590ed45829b44c263 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:28:09.511063 3923 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 364287a816084d5590ed45829b44c263 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:28:09.512001 3923 raft_consensus.cc:686] T 00000000000000000000000000000000 P 364287a816084d5590ed45829b44c263 [term 1 LEADER]: Becoming Leader. State: Replica: 364287a816084d5590ed45829b44c263, State: Running, Role: LEADER
I20260809 05:28:09.512648 3923 consensus_queue.cc:237] T 00000000000000000000000000000000 P 364287a816084d5590ed45829b44c263 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "364287a816084d5590ed45829b44c263" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33245 } }
I20260809 05:28:09.513712 3915 sys_catalog.cc:564] T 00000000000000000000000000000000 P 364287a816084d5590ed45829b44c263 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:28:09.516129 3925 sys_catalog.cc:455] T 00000000000000000000000000000000 P 364287a816084d5590ed45829b44c263 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 364287a816084d5590ed45829b44c263. Latest consensus state: current_term: 1 leader_uuid: "364287a816084d5590ed45829b44c263" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "364287a816084d5590ed45829b44c263" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33245 } } }
I20260809 05:28:09.516528 3925 sys_catalog.cc:458] T 00000000000000000000000000000000 P 364287a816084d5590ed45829b44c263 [sys.catalog]: This master's current role is: LEADER
I20260809 05:28:09.517071 3924 sys_catalog.cc:455] T 00000000000000000000000000000000 P 364287a816084d5590ed45829b44c263 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "364287a816084d5590ed45829b44c263" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "364287a816084d5590ed45829b44c263" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33245 } } }
I20260809 05:28:09.517584 3924 sys_catalog.cc:458] T 00000000000000000000000000000000 P 364287a816084d5590ed45829b44c263 [sys.catalog]: This master's current role is: LEADER
I20260809 05:28:09.518378 3934 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:28:09.524802 3934 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:28:09.535670 3934 catalog_manager.cc:1347] Generated new cluster ID: 42f11dd51d4545849890eb1e5a41e42c
I20260809 05:28:09.535821 3934 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:28:09.549422 3934 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:28:09.551210 3934 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:28:09.564985 3934 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 364287a816084d5590ed45829b44c263: Generated new TSK 0
I20260809 05:28:09.566192 3934 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 05:28:09.645444 3919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:09.589514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40916 (local address 127.26.185.62:33245)
0809 05:28:09.589785 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:09.589792 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:09.590203 (+ 411us) server_negotiation.cc:407] Connection header received
0809 05:28:09.590524 (+ 321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:09.590529 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:09.590618 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:09.590770 (+ 152us) server_negotiation.cc:226] Negotiated authn=JWT
0809 05:28:09.591426 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:09.592230 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:09.594407 (+ 2177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:09.594889 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:09.594984 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:09.595666 (+ 682us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 05:28:09.644503 (+ 48837us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 05:28:09.645105 (+ 602us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:40916: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":103}
W20260809 05:28:09.645639 3919 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:40916: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260809 05:28:09.645859 3965 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:09.589302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33245 (local address 127.0.0.1:40916)
0809 05:28:09.590061 (+ 759us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:09.590088 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:09.590284 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:09.590830 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:09.590836 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:09.590852 (+ 16us) client_negotiation.cc:189] Negotiated authn=JWT
0809 05:28:09.591251 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:09.591268 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:09.592396 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:09.592402 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:09.594253 (+ 1851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:09.594270 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:09.595106 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:09.595113 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:09.595329 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:09.595380 (+ 51us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 05:28:09.644968 (+ 49588us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 05:28:09.645357 (+ 389us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.185.62:33245: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":358,"threads_started":1}
I20260809 05:28:09.647966 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 3809
I20260809 05:28:09.649479 3908 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:09.760922 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 3809
2026-08-09T05:28:09Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (960 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (526 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (1661 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:28:12 dist-test-slave-h3ft krb5kdc[3988](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:28:12 dist-test-slave-h3ft krb5kdc[3988](info): set up 2 sockets
Aug 09 05:28:12 dist-test-slave-h3ft krb5kdc[3988](info): commencing operation
krb5kdc: starting...
W20260809 05:28:13.335988 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.334s user 0.005s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:28:13 dist-test-slave-h3ft krb5kdc[3988](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253293, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:28:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:28:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
I20260809 05:28:13.643947 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:39731
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:36753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:39731
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:28:14.064687 4011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:14.065104 4011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:14.065207 4011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:14.073235 4011 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:28:14.073400 4011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:14.073452 4011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:14.073509 4011 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:28:14.073559 4011 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:28:14.085074 4011 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:36753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:39731
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:39731
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:14.086891 4011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:14.088627 4011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:14.103451 4018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:14.103530 4022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:14.103464 4020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:14.104419 4011 server_base.cc:1034] running on GCE node
I20260809 05:28:14.105579 4011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:14.107682 4011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:14.108951 4011 hybrid_clock.cc:648] HybridClock initialized: now 1786253294108901 us; error 52 us; skew 500 ppm
I20260809 05:28:14.109405 4011 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:28:14 dist-test-slave-h3ft krb5kdc[3988](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253294, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:14.113651 4011 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:28:14.115849 4011 webserver.cc:460] Webserver started at http://127.26.185.62:38103/ using document root <none> and password file <none>
I20260809 05:28:14.116788 4011 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:14.116963 4011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:14.117369 4011 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:28:14.121218 4011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "46f21364a10b4447ac7a4131905f8ced"
format_stamp: "Formatted at 2026-08-09 05:28:14 on dist-test-slave-h3ft"
server_key: "ea19b24dc377c6b19503b1232e849b14"
server_key_iv: "a0cb3b4c4fafc1ebb29eea2beab43701"
server_key_version: "encryptionkey@0"
I20260809 05:28:14.122185 4011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "46f21364a10b4447ac7a4131905f8ced"
format_stamp: "Formatted at 2026-08-09 05:28:14 on dist-test-slave-h3ft"
server_key: "ea19b24dc377c6b19503b1232e849b14"
server_key_iv: "a0cb3b4c4fafc1ebb29eea2beab43701"
server_key_version: "encryptionkey@0"
I20260809 05:28:14.128729 4011 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.003s
I20260809 05:28:14.132989 4031 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:14.134613 4011 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 05:28:14.134828 4011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "46f21364a10b4447ac7a4131905f8ced"
format_stamp: "Formatted at 2026-08-09 05:28:14 on dist-test-slave-h3ft"
server_key: "ea19b24dc377c6b19503b1232e849b14"
server_key_iv: "a0cb3b4c4fafc1ebb29eea2beab43701"
server_key_version: "encryptionkey@0"
I20260809 05:28:14.135133 4011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:14.167347 4011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:14.172602 4011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:14.172977 4011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:14.196085 4011 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:39731
I20260809 05:28:14.196110 4107 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:39731 every 8 connection(s)
I20260809 05:28:14.197919 4011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:28:14.199412 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 4011
I20260809 05:28:14.199682 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:28:14.200667 27364 external_mini_cluster.cc:1428] Setting key c0339867e95dec9bbf299b0904aeb13e
I20260809 05:28:14.204113 4109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 05:28:14 dist-test-slave-h3ft krb5kdc[3988](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253293, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:28:14.219910 4109 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46f21364a10b4447ac7a4131905f8ced: Bootstrap starting.
I20260809 05:28:14.224203 4109 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 46f21364a10b4447ac7a4131905f8ced: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:14.225539 4109 log.cc:824] T 00000000000000000000000000000000 P 46f21364a10b4447ac7a4131905f8ced: Log is configured to *not* fsync() on all Append() calls
I20260809 05:28:14.228317 4115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:14.203320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54972 (local address 127.26.185.62:39731)
0809 05:28:14.204338 (+ 1018us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:14.204353 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:14.204406 (+ 53us) server_negotiation.cc:407] Connection header received
0809 05:28:14.206316 (+ 1910us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:14.206345 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:14.206797 (+ 452us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:14.207276 (+ 479us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:14.209350 (+ 2074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:14.210940 (+ 1590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:14.212899 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:14.213646 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:14.213800 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:14.219267 (+ 5467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:14.219277 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:14.219299 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:14.219354 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:14.223105 (+ 3751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:14.224123 (+ 1018us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:14.224132 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:14.224141 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:14.224414 (+ 273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:14.224868 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:14.224874 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:14.224877 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:14.225546 (+ 669us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:14.225910 (+ 364us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:14.226477 (+ 567us) server_negotiation.cc:299] Negotiation successful
0809 05:28:14.227079 (+ 602us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":699,"thread_start_us":431,"threads_started":1}
I20260809 05:28:14.229278 4109 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46f21364a10b4447ac7a4131905f8ced: No bootstrap required, opened a new log
I20260809 05:28:14.237710 4109 raft_consensus.cc:348] T 00000000000000000000000000000000 P 46f21364a10b4447ac7a4131905f8ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46f21364a10b4447ac7a4131905f8ced" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39731 } }
I20260809 05:28:14.238205 4109 raft_consensus.cc:374] T 00000000000000000000000000000000 P 46f21364a10b4447ac7a4131905f8ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:14.238324 4109 raft_consensus.cc:729] T 00000000000000000000000000000000 P 46f21364a10b4447ac7a4131905f8ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f21364a10b4447ac7a4131905f8ced, State: Initialized, Role: FOLLOWER
I20260809 05:28:14.239071 4109 consensus_queue.cc:260] T 00000000000000000000000000000000 P 46f21364a10b4447ac7a4131905f8ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46f21364a10b4447ac7a4131905f8ced" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39731 } }
I20260809 05:28:14.239370 4109 raft_consensus.cc:388] T 00000000000000000000000000000000 P 46f21364a10b4447ac7a4131905f8ced [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:28:14.239555 4109 raft_consensus.cc:482] T 00000000000000000000000000000000 P 46f21364a10b4447ac7a4131905f8ced [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:28:14.239769 4109 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 46f21364a10b4447ac7a4131905f8ced [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:14.242434 4109 raft_consensus.cc:504] T 00000000000000000000000000000000 P 46f21364a10b4447ac7a4131905f8ced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46f21364a10b4447ac7a4131905f8ced" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39731 } }
I20260809 05:28:14.243228 4109 leader_election.cc:302] T 00000000000000000000000000000000 P 46f21364a10b4447ac7a4131905f8ced [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 46f21364a10b4447ac7a4131905f8ced; no voters:
I20260809 05:28:14.243966 4109 leader_election.cc:288] T 00000000000000000000000000000000 P 46f21364a10b4447ac7a4131905f8ced [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:28:14.244184 4118 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 46f21364a10b4447ac7a4131905f8ced [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:28:14.244927 4118 raft_consensus.cc:686] T 00000000000000000000000000000000 P 46f21364a10b4447ac7a4131905f8ced [term 1 LEADER]: Becoming Leader. State: Replica: 46f21364a10b4447ac7a4131905f8ced, State: Running, Role: LEADER
I20260809 05:28:14.245573 4118 consensus_queue.cc:237] T 00000000000000000000000000000000 P 46f21364a10b4447ac7a4131905f8ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46f21364a10b4447ac7a4131905f8ced" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39731 } }
I20260809 05:28:14.246594 4109 sys_catalog.cc:564] T 00000000000000000000000000000000 P 46f21364a10b4447ac7a4131905f8ced [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:28:14.248888 4119 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46f21364a10b4447ac7a4131905f8ced [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "46f21364a10b4447ac7a4131905f8ced" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46f21364a10b4447ac7a4131905f8ced" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39731 } } }
I20260809 05:28:14.248874 4121 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46f21364a10b4447ac7a4131905f8ced [sys.catalog]: SysCatalogTable state changed. Reason: New leader 46f21364a10b4447ac7a4131905f8ced. Latest consensus state: current_term: 1 leader_uuid: "46f21364a10b4447ac7a4131905f8ced" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46f21364a10b4447ac7a4131905f8ced" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39731 } } }
I20260809 05:28:14.249454 4119 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46f21364a10b4447ac7a4131905f8ced [sys.catalog]: This master's current role is: LEADER
I20260809 05:28:14.249496 4121 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46f21364a10b4447ac7a4131905f8ced [sys.catalog]: This master's current role is: LEADER
I20260809 05:28:14.250651 4125 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:28:14.260428 4125 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:28:14.276032 4125 catalog_manager.cc:1347] Generated new cluster ID: d54f270a3af04396bbc9e94460c3f5fe
I20260809 05:28:14.276216 4125 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:28:14.301538 4125 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:28:14.303926 4125 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:28:14.320217 4125 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 46f21364a10b4447ac7a4131905f8ced: Generated new TSK 0
I20260809 05:28:14.321700 4125 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.185.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
I20260809 05:28:14.399637 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:0
--local_ip_for_outbound_sockets=127.26.185.1
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:39731
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:36753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:28:14.828895 4153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:14.829349 4153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:14.829531 4153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:14.837702 4153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:14.837906 4153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:14.838111 4153 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:28:14.854950 4153 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:36753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:39731
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:14.856913 4153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:14.858757 4153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:14.875691 4160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:14.875734 4162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:14.875650 4158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:14.877108 4153 server_base.cc:1034] running on GCE node
I20260809 05:28:14.877945 4153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:14.879278 4153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:14.880540 4153 hybrid_clock.cc:648] HybridClock initialized: now 1786253294880463 us; error 66 us; skew 500 ppm
I20260809 05:28:14.880957 4153 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:28:14 dist-test-slave-h3ft krb5kdc[3988](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253294, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:14.885032 4153 init.cc:377] Logged in from keytab as kudu/127.26.185.1@KRBTEST.COM (short username kudu)
I20260809 05:28:14.887446 4153 webserver.cc:460] Webserver started at http://127.26.185.1:38103/ using document root <none> and password file <none>
I20260809 05:28:14.888448 4153 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:14.888640 4153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:14.889050 4153 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:28:14.892895 4153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-0/data/instance:
uuid: "fd566ac3935d4d2482ed5a31d9065776"
format_stamp: "Formatted at 2026-08-09 05:28:14 on dist-test-slave-h3ft"
server_key: "e1cfda477fecb08af6830c2331168567"
server_key_iv: "883a6b2edb15c61cfe0a2547712294f2"
server_key_version: "encryptionkey@0"
I20260809 05:28:14.893956 4153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance:
uuid: "fd566ac3935d4d2482ed5a31d9065776"
format_stamp: "Formatted at 2026-08-09 05:28:14 on dist-test-slave-h3ft"
server_key: "e1cfda477fecb08af6830c2331168567"
server_key_iv: "883a6b2edb15c61cfe0a2547712294f2"
server_key_version: "encryptionkey@0"
I20260809 05:28:14.900775 4153 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260809 05:28:14.906069 4171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:14.907967 4153 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:28:14.908223 4153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "fd566ac3935d4d2482ed5a31d9065776"
format_stamp: "Formatted at 2026-08-09 05:28:14 on dist-test-slave-h3ft"
server_key: "e1cfda477fecb08af6830c2331168567"
server_key_iv: "883a6b2edb15c61cfe0a2547712294f2"
server_key_version: "encryptionkey@0"
I20260809 05:28:14.908499 4153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:14.926807 4153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:14.932602 4153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:14.932976 4153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:14.934218 4153 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:28:14.936112 4153 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:28:14.936228 4153 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:14.936404 4153 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:28:14.936479 4153 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:14.976681 4153 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:34011
I20260809 05:28:14.976722 4349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:34011 every 8 connection(s)
I20260809 05:28:14.978355 4153 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:28:14.986483 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 4153
I20260809 05:28:14.986753 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance
I20260809 05:28:14.987601 27364 external_mini_cluster.cc:1428] Setting key cbe5f06d55c69aa0dca926091b3caf4d
Aug 09 05:28:14 dist-test-slave-h3ft krb5kdc[3988](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253294, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:28:15.005225 4354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:14.981992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:39229 (local address 127.26.185.62:39731)
0809 05:28:14.982621 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:14.982626 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:14.983812 (+ 1186us) server_negotiation.cc:407] Connection header received
0809 05:28:14.986044 (+ 2232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:14.986051 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:14.986172 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:14.986318 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:14.988680 (+ 2362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:14.989655 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:14.991716 (+ 2061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:14.992566 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:14.992751 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:14.996921 (+ 4170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:14.996931 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:14.996939 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:14.996989 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:15.001014 (+ 4025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:15.002166 (+ 1152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:15.002175 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:15.002181 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:15.002381 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:15.002918 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:15.002923 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:15.002926 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:15.003345 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:15.003529 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:15.004456 (+ 927us) server_negotiation.cc:299] Negotiation successful
0809 05:28:15.004776 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":499,"thread_start_us":335,"threads_started":1}
I20260809 05:28:15.006630 4355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:14.982592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39731 (local address 127.26.185.1:39229)
0809 05:28:14.983585 (+ 993us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:14.983646 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:14.985654 (+ 2008us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:14.986640 (+ 986us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:14.986652 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:14.987505 (+ 853us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:14.988382 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:14.988414 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:14.989917 (+ 1503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:14.989924 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:14.991550 (+ 1626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:14.991564 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:14.992851 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:14.992856 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:14.993115 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:14.993991 (+ 876us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:14.994018 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:14.996638 (+ 2620us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:15.001212 (+ 4574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:15.001227 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:15.001256 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:15.001998 (+ 742us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:15.002538 (+ 540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:15.002544 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:15.002548 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:15.002787 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:15.003497 (+ 710us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:15.003507 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:15.004001 (+ 494us) client_negotiation.cc:769] Sending connection context
0809 05:28:15.004347 (+ 346us) client_negotiation.cc:240] Negotiation successful
0809 05:28:15.005086 (+ 739us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":668,"thread_start_us":424,"threads_started":1}
I20260809 05:28:15.008931 4350 heartbeater.cc:347] Connected to a master server at 127.26.185.62:39731
I20260809 05:28:15.009385 4350 heartbeater.cc:464] Registering TS with master...
I20260809 05:28:15.010547 4350 heartbeater.cc:511] Master 127.26.185.62:39731 requested a full tablet report, sending...
I20260809 05:28:15.014017 4054 ts_manager.cc:194] Registered new tserver with Master: fd566ac3935d4d2482ed5a31d9065776 (127.26.185.1:34011)
I20260809 05:28:15.016635 4054 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.1@KRBTEST.COM'} at 127.26.185.1:39229
WARNING: no policy specified for kudu/127.26.185.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
I20260809 05:28:15.063336 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:0
--local_ip_for_outbound_sockets=127.26.185.2
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:39731
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:36753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:28:15.485144 4358 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:15.485565 4358 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:15.485687 4358 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:15.493911 4358 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:15.494081 4358 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:15.494217 4358 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:28:15.505697 4358 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:36753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:39731
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:15.507615 4358 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:15.509320 4358 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:15.525521 4370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:15.525418 4368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:15.525668 4366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:15.526510 4358 server_base.cc:1034] running on GCE node
I20260809 05:28:15.527446 4358 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:15.528682 4358 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:15.529973 4358 hybrid_clock.cc:648] HybridClock initialized: now 1786253295529922 us; error 41 us; skew 500 ppm
I20260809 05:28:15.530395 4358 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:28:15 dist-test-slave-h3ft krb5kdc[3988](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253295, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:15.534559 4358 init.cc:377] Logged in from keytab as kudu/127.26.185.2@KRBTEST.COM (short username kudu)
I20260809 05:28:15.536301 4358 webserver.cc:460] Webserver started at http://127.26.185.2:38887/ using document root <none> and password file <none>
I20260809 05:28:15.537132 4358 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:15.537252 4358 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:15.537592 4358 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:28:15.541460 4358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-1/data/instance:
uuid: "18dc0732de1f43b29b57f63fa303e825"
format_stamp: "Formatted at 2026-08-09 05:28:15 on dist-test-slave-h3ft"
server_key: "b4eaf380a7e656da48271ac02f16a2f5"
server_key_iv: "c598171a76538828cf7c691342b054c5"
server_key_version: "encryptionkey@0"
I20260809 05:28:15.542387 4358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance:
uuid: "18dc0732de1f43b29b57f63fa303e825"
format_stamp: "Formatted at 2026-08-09 05:28:15 on dist-test-slave-h3ft"
server_key: "b4eaf380a7e656da48271ac02f16a2f5"
server_key_iv: "c598171a76538828cf7c691342b054c5"
server_key_version: "encryptionkey@0"
I20260809 05:28:15.549302 4358 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260809 05:28:15.553472 4383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:15.555442 4358 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:28:15.555616 4358 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "18dc0732de1f43b29b57f63fa303e825"
format_stamp: "Formatted at 2026-08-09 05:28:15 on dist-test-slave-h3ft"
server_key: "b4eaf380a7e656da48271ac02f16a2f5"
server_key_iv: "c598171a76538828cf7c691342b054c5"
server_key_version: "encryptionkey@0"
I20260809 05:28:15.555832 4358 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:15.584055 4358 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:15.589679 4358 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:15.590004 4358 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:15.591228 4358 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:28:15.592907 4358 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:28:15.592990 4358 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:15.593092 4358 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:28:15.593140 4358 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:15.633134 4358 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:33401
I20260809 05:28:15.633172 4554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:33401 every 8 connection(s)
I20260809 05:28:15.634938 4358 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:28:15.639182 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 4358
I20260809 05:28:15.639461 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance
I20260809 05:28:15.640189 27364 external_mini_cluster.cc:1428] Setting key 9ec0d9aa8dcc7cf0620d30ea053c88df
Aug 09 05:28:15 dist-test-slave-h3ft krb5kdc[3988](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253295, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:28:15.661502 4557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:15.638275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:40591 (local address 127.26.185.62:39731)
0809 05:28:15.639042 (+ 767us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:15.639052 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:15.640543 (+ 1491us) server_negotiation.cc:407] Connection header received
0809 05:28:15.642932 (+ 2389us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:15.642938 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:15.643065 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:15.643203 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:15.645185 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:15.646031 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:15.648215 (+ 2184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:15.648749 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:15.648899 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:15.653775 (+ 4876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:15.653785 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:15.653791 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:15.653841 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:15.657281 (+ 3440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:15.658251 (+ 970us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:15.658255 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:15.658258 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:15.658415 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:15.658928 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:15.658932 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:15.658934 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:15.659338 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:15.659545 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:15.660688 (+ 1143us) server_negotiation.cc:299] Negotiation successful
0809 05:28:15.661041 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":491,"thread_start_us":325,"threads_started":1}
I20260809 05:28:15.662849 4559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:15.639109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39731 (local address 127.26.185.2:40591)
0809 05:28:15.640287 (+ 1178us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:15.640359 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:15.642607 (+ 2248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:15.643512 (+ 905us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:15.643524 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:15.644245 (+ 721us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:15.644963 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:15.644984 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:15.646213 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:15.646217 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:15.648055 (+ 1838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:15.648069 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:15.649037 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:15.649045 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:15.649324 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:15.650241 (+ 917us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:15.650269 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:15.653428 (+ 3159us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:15.657474 (+ 4046us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:15.657488 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:15.657521 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:15.658084 (+ 563us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:15.658541 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:15.658548 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:15.658552 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:15.658785 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:15.659495 (+ 710us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:15.659505 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:15.660103 (+ 598us) client_negotiation.cc:769] Sending connection context
0809 05:28:15.660581 (+ 478us) client_negotiation.cc:240] Negotiation successful
0809 05:28:15.661322 (+ 741us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":738,"thread_start_us":444,"threads_started":1}
I20260809 05:28:15.665185 4555 heartbeater.cc:347] Connected to a master server at 127.26.185.62:39731
I20260809 05:28:15.665634 4555 heartbeater.cc:464] Registering TS with master...
I20260809 05:28:15.666613 4555 heartbeater.cc:511] Master 127.26.185.62:39731 requested a full tablet report, sending...
I20260809 05:28:15.668920 4054 ts_manager.cc:194] Registered new tserver with Master: 18dc0732de1f43b29b57f63fa303e825 (127.26.185.2:33401)
I20260809 05:28:15.670759 4054 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.2@KRBTEST.COM'} at 127.26.185.2:40591
WARNING: no policy specified for kudu/127.26.185.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
I20260809 05:28:15.719920 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:0
--local_ip_for_outbound_sockets=127.26.185.3
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:39731
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:36753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:28:16.021798 4350 heartbeater.cc:503] Master 127.26.185.62:39731 was elected leader, sending a full tablet report...
W20260809 05:28:16.169618 4563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:16.170048 4563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:16.170233 4563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:16.178244 4563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:16.178423 4563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:16.178660 4563 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:28:16.190486 4563 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:36753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:39731
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:16.192315 4563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:16.194099 4563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:16.212383 4569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:16.212349 4573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:16.212327 4570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:16.213907 4563 server_base.cc:1034] running on GCE node
I20260809 05:28:16.214793 4563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:16.216212 4563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:16.217438 4563 hybrid_clock.cc:648] HybridClock initialized: now 1786253296217379 us; error 45 us; skew 500 ppm
I20260809 05:28:16.217898 4563 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:28:16 dist-test-slave-h3ft krb5kdc[3988](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253296, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:16.221917 4563 init.cc:377] Logged in from keytab as kudu/127.26.185.3@KRBTEST.COM (short username kudu)
I20260809 05:28:16.223845 4563 webserver.cc:460] Webserver started at http://127.26.185.3:45747/ using document root <none> and password file <none>
I20260809 05:28:16.225116 4563 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:16.225294 4563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:16.225771 4563 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:28:16.229429 4563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-2/data/instance:
uuid: "b4598a934ce64906a3773853c317f52c"
format_stamp: "Formatted at 2026-08-09 05:28:16 on dist-test-slave-h3ft"
server_key: "5a54ff6813fb5e18ec81b4115c6d5dba"
server_key_iv: "33206feca8d28a38ff72b9dc24c34e6e"
server_key_version: "encryptionkey@0"
I20260809 05:28:16.230360 4563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance:
uuid: "b4598a934ce64906a3773853c317f52c"
format_stamp: "Formatted at 2026-08-09 05:28:16 on dist-test-slave-h3ft"
server_key: "5a54ff6813fb5e18ec81b4115c6d5dba"
server_key_iv: "33206feca8d28a38ff72b9dc24c34e6e"
server_key_version: "encryptionkey@0"
I20260809 05:28:16.236783 4563 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260809 05:28:16.241128 4582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:16.242982 4563 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.001s
I20260809 05:28:16.243263 4563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "b4598a934ce64906a3773853c317f52c"
format_stamp: "Formatted at 2026-08-09 05:28:16 on dist-test-slave-h3ft"
server_key: "5a54ff6813fb5e18ec81b4115c6d5dba"
server_key_iv: "33206feca8d28a38ff72b9dc24c34e6e"
server_key_version: "encryptionkey@0"
I20260809 05:28:16.243538 4563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:16.256909 4563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:16.262115 4563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:16.262475 4563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:16.263757 4563 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:28:16.265579 4563 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:28:16.265688 4563 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:16.265832 4563 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:28:16.265918 4563 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:16.306118 4563 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:32953
I20260809 05:28:16.306248 4747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:32953 every 8 connection(s)
I20260809 05:28:16.307792 4563 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:28:16.316696 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 4563
I20260809 05:28:16.316926 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance
I20260809 05:28:16.317471 27364 external_mini_cluster.cc:1428] Setting key 707ed54239d17432c6ab9e3b76477790
Aug 09 05:28:16 dist-test-slave-h3ft krb5kdc[3988](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253296, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:28:16.332944 4751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:16.310953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:47045 (local address 127.26.185.62:39731)
0809 05:28:16.311607 (+ 654us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:16.311612 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:16.312612 (+ 1000us) server_negotiation.cc:407] Connection header received
0809 05:28:16.314895 (+ 2283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:16.314902 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:16.315076 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:16.315216 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:16.317223 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:16.318282 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:16.320399 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:16.320897 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:16.321032 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:16.325664 (+ 4632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:16.325670 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:16.325674 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:16.325718 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:16.328676 (+ 2958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:16.329616 (+ 940us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:16.329621 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:16.329624 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:16.329764 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:16.330492 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:16.330498 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:16.330502 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:16.330895 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:16.331099 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:16.332203 (+ 1104us) server_negotiation.cc:299] Negotiation successful
0809 05:28:16.332469 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":526,"thread_start_us":315,"threads_started":1}
I20260809 05:28:16.334538 4752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:16.311560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39731 (local address 127.26.185.3:47045)
0809 05:28:16.312398 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:16.312443 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:16.314577 (+ 2134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:16.315504 (+ 927us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:16.315515 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:16.316263 (+ 748us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:16.317026 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:16.317054 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:16.318476 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:16.318482 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:16.320228 (+ 1746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:16.320241 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:16.321155 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:16.321163 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:16.321598 (+ 435us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:16.322474 (+ 876us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:16.322505 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:16.325426 (+ 2921us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:16.328846 (+ 3420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:16.328860 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:16.328883 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:16.329453 (+ 570us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:16.329967 (+ 514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:16.329975 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:16.329980 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:16.330309 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:16.331069 (+ 760us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:16.331078 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:16.331595 (+ 517us) client_negotiation.cc:769] Sending connection context
0809 05:28:16.332038 (+ 443us) client_negotiation.cc:240] Negotiation successful
0809 05:28:16.332698 (+ 660us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":339,"threads_started":1}
I20260809 05:28:16.336203 4749 heartbeater.cc:347] Connected to a master server at 127.26.185.62:39731
I20260809 05:28:16.336573 4749 heartbeater.cc:464] Registering TS with master...
I20260809 05:28:16.337498 4749 heartbeater.cc:511] Master 127.26.185.62:39731 requested a full tablet report, sending...
I20260809 05:28:16.339239 4054 ts_manager.cc:194] Registered new tserver with Master: b4598a934ce64906a3773853c317f52c (127.26.185.3:32953)
I20260809 05:28:16.340245 4054 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.3@KRBTEST.COM'} at 127.26.185.3:47045
I20260809 05:28:16.346956 27364 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/test-admin.keytab.
Aug 09 05:28:16 dist-test-slave-h3ft krb5kdc[3988](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:16.386210 27364 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260809 05:28:16.392941 4757 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:16.389609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60048 (local address 127.26.185.1:34011)
0809 05:28:16.390458 (+ 849us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:16.390468 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:16.390500 (+ 32us) server_negotiation.cc:407] Connection header received
0809 05:28:16.390584 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:16.390593 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:16.390880 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:16.391130 (+ 250us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:16.392405 (+ 1275us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60048: BlockingRecv error: recv got EOF from 127.0.0.1:60048 (error 108)
Metrics: {"server-negotiator.queue_time_us":679,"thread_start_us":453,"threads_started":1}
W20260809 05:28:16.393020 27364 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/krb5cc' of type FILE
Aug 09 05:28:16 dist-test-slave-h3ft krb5kdc[3988](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:16.394990 27364 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 05:28:16 dist-test-slave-h3ft krb5kdc[3988](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:16.396637 27364 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 05:28:16 dist-test-slave-h3ft krb5kdc[3988](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.1@KRBTEST.COM
I20260809 05:28:16.416036 4757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:16.398455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60050 (local address 127.26.185.1:34011)
0809 05:28:16.398697 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:16.398704 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:16.398988 (+ 284us) server_negotiation.cc:407] Connection header received
0809 05:28:16.399254 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:16.399258 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:16.399330 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:16.399420 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:16.400739 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:16.401889 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:16.403521 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:16.404207 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:16.404317 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:16.408962 (+ 4645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:16.408977 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:16.408997 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:16.409063 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:16.412423 (+ 3360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:16.413374 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:16.413382 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:16.413384 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:16.413534 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:16.414070 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:16.414074 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:16.414077 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:16.414576 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:16.414836 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:16.415366 (+ 530us) server_negotiation.cc:299] Negotiation successful
0809 05:28:16.415690 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260809 05:28:16.423377 27364 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/krb5cc' of type FILE
W20260809 05:28:16.423401 4757 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:16.421339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60056 (local address 127.26.185.1:34011)
0809 05:28:16.421582 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:16.421590 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:16.421697 (+ 107us) server_negotiation.cc:407] Connection header received
0809 05:28:16.421839 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:16.421844 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:16.421974 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:16.422071 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:16.423082 (+ 1011us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60056: BlockingRecv error: recv got EOF from 127.0.0.1:60056 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 09 05:28:16 dist-test-slave-h3ft krb5kdc[3988](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:16.425206 27364 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 05:28:16 dist-test-slave-h3ft krb5kdc[3988](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:16.426620 27364 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 05:28:16 dist-test-slave-h3ft krb5kdc[3988](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.1@KRBTEST.COM
I20260809 05:28:16.443442 4757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:16.428406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60064 (local address 127.26.185.1:34011)
0809 05:28:16.428664 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:16.428671 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:16.428951 (+ 280us) server_negotiation.cc:407] Connection header received
0809 05:28:16.429170 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:16.429174 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:16.429245 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:16.429354 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:16.430457 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:16.431321 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:16.432606 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:16.433097 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:16.433261 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:16.437497 (+ 4236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:16.437504 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:16.437507 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:16.437548 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:16.440661 (+ 3113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:16.441348 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:16.441355 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:16.441359 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:16.441508 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:16.441916 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:16.441923 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:16.441930 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:16.442231 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:16.442552 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:16.442836 (+ 284us) server_negotiation.cc:299] Negotiation successful
0809 05:28:16.443107 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
W20260809 05:28:16.448685 4757 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:16.446446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60076 (local address 127.26.185.1:34011)
0809 05:28:16.446778 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:16.446785 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:16.447174 (+ 389us) server_negotiation.cc:407] Connection header received
0809 05:28:16.447372 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:16.447378 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:16.447468 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:16.447602 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:16.448418 (+ 816us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60076: BlockingRecv error: recv got EOF from 127.0.0.1:60076 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260809 05:28:16.448874 27364 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786253234117492-27364-0/krb5kdc/krb5cc' of type FILE
Aug 09 05:28:16 dist-test-slave-h3ft krb5kdc[3988](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:16.450610 27364 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 05:28:16 dist-test-slave-h3ft krb5kdc[3988](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:16.452075 27364 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 05:28:16 dist-test-slave-h3ft krb5kdc[3988](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.1@KRBTEST.COM
I20260809 05:28:16.467371 4757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:16.453638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60092 (local address 127.26.185.1:34011)
0809 05:28:16.453888 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:16.453894 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:16.453921 (+ 27us) server_negotiation.cc:407] Connection header received
0809 05:28:16.454071 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:16.454075 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:16.454134 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:16.454213 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:16.455313 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:16.456090 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:16.457309 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:16.457767 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:16.457865 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:16.461901 (+ 4036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:16.461906 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:16.461909 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:16.461947 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:16.464695 (+ 2748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:16.465342 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:16.465346 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:16.465348 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:16.465506 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:16.465857 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:16.465861 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:16.465863 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:16.466262 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:16.466541 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:16.466744 (+ 203us) server_negotiation.cc:299] Negotiation successful
0809 05:28:16.466965 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260809 05:28:16.469297 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 4153
I20260809 05:28:16.482946 4757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:16.470093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60104 (local address 127.26.185.1:34011)
0809 05:28:16.470323 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:16.470333 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:16.470704 (+ 371us) server_negotiation.cc:407] Connection header received
0809 05:28:16.470833 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:16.470837 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:16.470899 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:16.470976 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:16.472123 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:16.472872 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:16.474110 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:16.474588 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:16.474686 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:16.476997 (+ 2311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:16.477003 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:16.477006 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:16.477040 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:16.480040 (+ 3000us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:16.480793 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:16.480797 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:16.480800 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:16.480955 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:16.481300 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:16.481303 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:16.481305 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:16.481735 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:16.481981 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:16.482286 (+ 305us) server_negotiation.cc:299] Negotiation successful
0809 05:28:16.482545 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 05:28:16.483793 4340 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:16.577349 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 4153
I20260809 05:28:16.608443 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 4358
Aug 09 05:28:16 dist-test-slave-h3ft krb5kdc[3988](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.2@KRBTEST.COM
I20260809 05:28:16.626302 4776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:16.609653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34662 (local address 127.26.185.2:33401)
0809 05:28:16.610331 (+ 678us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:16.610340 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:16.610372 (+ 32us) server_negotiation.cc:407] Connection header received
0809 05:28:16.610462 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:16.610470 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:16.610743 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:16.610897 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:16.612117 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:16.613287 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:16.614642 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:16.615348 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:16.615466 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:16.619911 (+ 4445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:16.619925 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:16.619946 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:16.619990 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:16.623517 (+ 3527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:16.624289 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:16.624297 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:16.624299 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:16.624444 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:16.624792 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:16.624795 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:16.624797 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:16.625191 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:16.625459 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:16.625723 (+ 264us) server_negotiation.cc:299] Negotiation successful
0809 05:28:16.625962 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":511,"thread_start_us":352,"threads_started":1}
I20260809 05:28:16.628064 4549 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:16.721484 4555 heartbeater.cc:503] Master 127.26.185.62:39731 was elected leader, sending a full tablet report...
I20260809 05:28:16.723608 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 4358
W20260809 05:28:16.752314 4033 connection.cc:535] server connection from 127.26.185.2:40591 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 05:28:16.752789 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 4563
Aug 09 05:28:16 dist-test-slave-h3ft krb5kdc[3988](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.3@KRBTEST.COM
I20260809 05:28:16.771582 4780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:16.754137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59852 (local address 127.26.185.3:32953)
0809 05:28:16.754931 (+ 794us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:16.754940 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:16.754979 (+ 39us) server_negotiation.cc:407] Connection header received
0809 05:28:16.755138 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:16.755147 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:16.755442 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:16.755654 (+ 212us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:16.756963 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:16.758079 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:16.759617 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:16.760269 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:16.760440 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:16.765361 (+ 4921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:16.765377 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:16.765397 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:16.765439 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:16.768660 (+ 3221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:16.769396 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:16.769404 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:16.769407 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:16.769546 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:16.769907 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:16.769910 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:16.769912 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:16.770331 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:16.770599 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:16.770848 (+ 249us) server_negotiation.cc:299] Negotiation successful
0809 05:28:16.771212 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":608,"thread_start_us":427,"threads_started":1}
I20260809 05:28:16.773317 4740 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:16.868206 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 4563
I20260809 05:28:16.899369 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 4011
I20260809 05:28:16.901010 4101 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:17.023730 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 4011
2026-08-09T05:28:17Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (5082 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:28:17 dist-test-slave-h3ft krb5kdc[4786](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:28:17 dist-test-slave-h3ft krb5kdc[4786](info): set up 2 sockets
Aug 09 05:28:17 dist-test-slave-h3ft krb5kdc[4786](info): commencing operation
krb5kdc: starting...
W20260809 05:28:18.450762 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.367s user 0.003s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:28:18 dist-test-slave-h3ft krb5kdc[4786](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253298, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:28:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:28:18Z Disabled control of system clock
WARNING: no policy specified for oryx/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.62.keytab.
Entry for principal oryx/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.62.keytab.
I20260809 05:28:18.779810 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:39159
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.62.keytab
--principal=oryx/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:34197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:39159
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:28:19.220679 4809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:19.221076 4809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:19.221180 4809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:19.229305 4809 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:28:19.229578 4809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:19.229676 4809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:19.229770 4809 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:28:19.229840 4809 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:28:19.240986 4809 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:34197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:39159
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.62.keytab
--principal=oryx/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:39159
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:19.243062 4809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:19.244856 4809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:19.258919 4814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:19.259085 4815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:19.259049 4817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:19.260313 4809 server_base.cc:1034] running on GCE node
I20260809 05:28:19.261379 4809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:19.263276 4809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:19.264551 4809 hybrid_clock.cc:648] HybridClock initialized: now 1786253299264481 us; error 61 us; skew 500 ppm
I20260809 05:28:19.264972 4809 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:28:19 dist-test-slave-h3ft krb5kdc[4786](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253299, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:19.268865 4809 init.cc:377] Logged in from keytab as oryx/127.26.185.62@KRBTEST.COM (short username oryx)
I20260809 05:28:19.270669 4809 webserver.cc:460] Webserver started at http://127.26.185.62:33385/ using document root <none> and password file <none>
I20260809 05:28:19.271623 4809 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:19.271790 4809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:19.272171 4809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:28:19.276043 4809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "83e7c63ef60d4983a1c3047ce9b3008c"
format_stamp: "Formatted at 2026-08-09 05:28:19 on dist-test-slave-h3ft"
server_key: "9545d9be1af124c01a4156174d2ef471"
server_key_iv: "0afc3e63bedae42aed3534f197f480b9"
server_key_version: "encryptionkey@0"
I20260809 05:28:19.276966 4809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "83e7c63ef60d4983a1c3047ce9b3008c"
format_stamp: "Formatted at 2026-08-09 05:28:19 on dist-test-slave-h3ft"
server_key: "9545d9be1af124c01a4156174d2ef471"
server_key_iv: "0afc3e63bedae42aed3534f197f480b9"
server_key_version: "encryptionkey@0"
I20260809 05:28:19.285732 4809 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.009s sys 0.000s
I20260809 05:28:19.292665 4826 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:19.295167 4809 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.005s sys 0.000s
I20260809 05:28:19.295369 4809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "83e7c63ef60d4983a1c3047ce9b3008c"
format_stamp: "Formatted at 2026-08-09 05:28:19 on dist-test-slave-h3ft"
server_key: "9545d9be1af124c01a4156174d2ef471"
server_key_iv: "0afc3e63bedae42aed3534f197f480b9"
server_key_version: "encryptionkey@0"
I20260809 05:28:19.295614 4809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:19.324219 4809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:19.329787 4809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:19.330098 4809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:19.352839 4809 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:39159
I20260809 05:28:19.352872 4895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:39159 every 8 connection(s)
I20260809 05:28:19.354620 4809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:28:19.359627 4896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:19.362740 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 4809
I20260809 05:28:19.363058 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:28:19.363854 27364 external_mini_cluster.cc:1428] Setting key bf6ff39430db0eea306b7c3d6704de5b
I20260809 05:28:19.374181 4896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c: Bootstrap starting.
I20260809 05:28:19.378993 4896 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:19.380694 4896 log.cc:824] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c: Log is configured to *not* fsync() on all Append() calls
Aug 09 05:28:19 dist-test-slave-h3ft krb5kdc[4786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253298, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM
I20260809 05:28:19.384716 4896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c: No bootstrap required, opened a new log
I20260809 05:28:19.391131 4899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:19.366405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49806 (local address 127.26.185.62:39159)
0809 05:28:19.367386 (+ 981us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:19.367404 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:19.367458 (+ 54us) server_negotiation.cc:407] Connection header received
0809 05:28:19.369383 (+ 1925us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:19.369412 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:19.369898 (+ 486us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:19.370311 (+ 413us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:19.372558 (+ 2247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:19.374033 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:19.375975 (+ 1942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:19.376753 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:19.376926 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:19.382528 (+ 5602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:19.382539 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:19.382563 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:19.382612 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:19.386249 (+ 3637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:19.387085 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:19.387096 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:19.387106 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:19.387298 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:19.387746 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:19.387750 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:19.387752 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:19.388390 (+ 638us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:19.388798 (+ 408us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:19.389240 (+ 442us) server_negotiation.cc:299] Negotiation successful
0809 05:28:19.389787 (+ 547us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":731,"thread_start_us":443,"threads_started":1}
I20260809 05:28:19.394268 4896 raft_consensus.cc:348] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } }
I20260809 05:28:19.394771 4896 raft_consensus.cc:374] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:19.394899 4896 raft_consensus.cc:729] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83e7c63ef60d4983a1c3047ce9b3008c, State: Initialized, Role: FOLLOWER
I20260809 05:28:19.395674 4896 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } }
I20260809 05:28:19.395910 4896 raft_consensus.cc:388] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:28:19.396027 4896 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:28:19.396171 4896 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:19.399477 4896 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } }
I20260809 05:28:19.400233 4896 leader_election.cc:302] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 83e7c63ef60d4983a1c3047ce9b3008c; no voters:
I20260809 05:28:19.401047 4896 leader_election.cc:288] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:28:19.401224 4902 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:28:19.402319 4902 raft_consensus.cc:686] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [term 1 LEADER]: Becoming Leader. State: Replica: 83e7c63ef60d4983a1c3047ce9b3008c, State: Running, Role: LEADER
I20260809 05:28:19.403071 4902 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } }
I20260809 05:28:19.404402 4896 sys_catalog.cc:564] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:28:19.407356 4903 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } }
I20260809 05:28:19.407832 4903 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [sys.catalog]: This master's current role is: LEADER
I20260809 05:28:19.407485 4905 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83e7c63ef60d4983a1c3047ce9b3008c. Latest consensus state: current_term: 1 leader_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } }
I20260809 05:28:19.408066 4905 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [sys.catalog]: This master's current role is: LEADER
I20260809 05:28:19.409529 4909 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:28:19.416738 4909 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:28:19.427951 4909 catalog_manager.cc:1347] Generated new cluster ID: abe19a6dbcdc4b1caa79aefec9852bf5
I20260809 05:28:19.428134 4909 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:28:19.442996 4909 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:28:19.444808 4909 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:28:19.467566 4909 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c: Generated new TSK 0
I20260809 05:28:19.469076 4909 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.26.185.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.185.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.185.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.1.keytab.
Entry for principal oryx/127.26.185.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.1.keytab.
I20260809 05:28:19.552386 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:0
--local_ip_for_outbound_sockets=127.26.185.1
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:39159
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.1.keytab
--principal=oryx/127.26.185.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:34197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:28:20.000658 4939 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:20.001176 4939 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:20.001603 4939 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:20.011744 4939 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:20.011932 4939 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:20.012085 4939 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:28:20.024547 4939 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:34197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.1.keytab
--principal=oryx/127.26.185.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:39159
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:20.026445 4939 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:20.028375 4939 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:20.045154 4949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:20.045219 4952 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:20.045305 4948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:20.046080 4939 server_base.cc:1034] running on GCE node
I20260809 05:28:20.046859 4939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:20.048151 4939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:20.049376 4939 hybrid_clock.cc:648] HybridClock initialized: now 1786253300049324 us; error 42 us; skew 500 ppm
I20260809 05:28:20.049803 4939 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:28:20 dist-test-slave-h3ft krb5kdc[4786](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253300, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:20.053891 4939 init.cc:377] Logged in from keytab as oryx/127.26.185.1@KRBTEST.COM (short username oryx)
I20260809 05:28:20.055956 4939 webserver.cc:460] Webserver started at http://127.26.185.1:39421/ using document root <none> and password file <none>
I20260809 05:28:20.056887 4939 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:20.057087 4939 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:20.057476 4939 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:28:20.061281 4939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/data/instance:
uuid: "cfd46d97aa5b4db5bcb371b14e8ed36f"
format_stamp: "Formatted at 2026-08-09 05:28:20 on dist-test-slave-h3ft"
server_key: "8cb864a6777dd6266d5f763a4a7b9f71"
server_key_iv: "7a8eec9d68568caa04a4bd3ccd96427d"
server_key_version: "encryptionkey@0"
I20260809 05:28:20.062245 4939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance:
uuid: "cfd46d97aa5b4db5bcb371b14e8ed36f"
format_stamp: "Formatted at 2026-08-09 05:28:20 on dist-test-slave-h3ft"
server_key: "8cb864a6777dd6266d5f763a4a7b9f71"
server_key_iv: "7a8eec9d68568caa04a4bd3ccd96427d"
server_key_version: "encryptionkey@0"
I20260809 05:28:20.069114 4939 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260809 05:28:20.073894 4962 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:20.076081 4939 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260809 05:28:20.076289 4939 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "cfd46d97aa5b4db5bcb371b14e8ed36f"
format_stamp: "Formatted at 2026-08-09 05:28:20 on dist-test-slave-h3ft"
server_key: "8cb864a6777dd6266d5f763a4a7b9f71"
server_key_iv: "7a8eec9d68568caa04a4bd3ccd96427d"
server_key_version: "encryptionkey@0"
I20260809 05:28:20.076540 4939 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:20.112893 4939 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:20.119264 4939 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:20.119606 4939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:20.120790 4939 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:28:20.122525 4939 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:28:20.122618 4939 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:20.122718 4939 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:28:20.122766 4939 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:20.162354 4939 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:39559
I20260809 05:28:20.162401 5137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:39559 every 8 connection(s)
I20260809 05:28:20.164104 4939 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:28:20.170302 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 4939
I20260809 05:28:20.170558 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance
I20260809 05:28:20.171424 27364 external_mini_cluster.cc:1428] Setting key a6924e8c5d57fc0c47755c106051b55b
Aug 09 05:28:20 dist-test-slave-h3ft krb5kdc[4786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253300, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM
I20260809 05:28:20.188926 5146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:20.167449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:46983 (local address 127.26.185.62:39159)
0809 05:28:20.168043 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:20.168048 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:20.169244 (+ 1196us) server_negotiation.cc:407] Connection header received
0809 05:28:20.171684 (+ 2440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:20.171690 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:20.171821 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:20.171971 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:20.174249 (+ 2278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:20.175105 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:20.176880 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:20.177313 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:20.177480 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:20.181816 (+ 4336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:20.181822 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:20.181825 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:20.181866 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:20.185056 (+ 3190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:20.185950 (+ 894us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:20.185959 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:20.185964 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:20.186118 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:20.186643 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:20.186649 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:20.186652 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:20.187063 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:20.187249 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:20.188165 (+ 916us) server_negotiation.cc:299] Negotiation successful
0809 05:28:20.188469 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":448,"thread_start_us":281,"threads_started":1}
I20260809 05:28:20.190290 5148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:20.168175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.26.185.1:46983)
0809 05:28:20.169013 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:20.169074 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:20.171298 (+ 2224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:20.172282 (+ 984us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:20.172294 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:20.173165 (+ 871us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:20.174045 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:20.174067 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:20.175285 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:20.175296 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:20.176709 (+ 1413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:20.176723 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:20.177601 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:20.177609 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:20.177880 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:20.178778 (+ 898us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:20.178807 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:20.181530 (+ 2723us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:20.185244 (+ 3714us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:20.185255 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:20.185282 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:20.185803 (+ 521us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:20.186248 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:20.186254 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:20.186258 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:20.186510 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:20.187205 (+ 695us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:20.187215 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:20.187695 (+ 480us) client_negotiation.cc:769] Sending connection context
0809 05:28:20.188039 (+ 344us) client_negotiation.cc:240] Negotiation successful
0809 05:28:20.188777 (+ 738us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":309,"threads_started":1}
I20260809 05:28:20.192448 5140 heartbeater.cc:347] Connected to a master server at 127.26.185.62:39159
I20260809 05:28:20.192863 5140 heartbeater.cc:464] Registering TS with master...
I20260809 05:28:20.193809 5140 heartbeater.cc:511] Master 127.26.185.62:39159 requested a full tablet report, sending...
I20260809 05:28:20.196960 4852 ts_manager.cc:194] Registered new tserver with Master: cfd46d97aa5b4db5bcb371b14e8ed36f (127.26.185.1:39559)
I20260809 05:28:20.199572 4852 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.185.1@KRBTEST.COM'} at 127.26.185.1:46983
WARNING: no policy specified for oryx/127.26.185.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.185.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.185.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.2.keytab.
Entry for principal oryx/127.26.185.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.2.keytab.
I20260809 05:28:20.247825 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:0
--local_ip_for_outbound_sockets=127.26.185.2
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:39159
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.2.keytab
--principal=oryx/127.26.185.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:34197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:28:20.670114 5153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:20.670516 5153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:20.670713 5153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:20.678776 5153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:20.678949 5153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:20.679172 5153 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:28:20.690537 5153 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:34197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.2.keytab
--principal=oryx/127.26.185.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:39159
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:20.692430 5153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:20.694168 5153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:20.714731 5160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:20.714625 5161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:20.715164 5164 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:20.716888 5153 server_base.cc:1034] running on GCE node
I20260809 05:28:20.718327 5153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:20.720649 5153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:20.724184 5153 hybrid_clock.cc:648] HybridClock initialized: now 1786253300724000 us; error 167 us; skew 500 ppm
I20260809 05:28:20.724949 5153 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:28:20 dist-test-slave-h3ft krb5kdc[4786](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253300, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:20.732558 5153 init.cc:377] Logged in from keytab as oryx/127.26.185.2@KRBTEST.COM (short username oryx)
I20260809 05:28:20.736552 5153 webserver.cc:460] Webserver started at http://127.26.185.2:35473/ using document root <none> and password file <none>
I20260809 05:28:20.738410 5153 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:20.738775 5153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:20.739590 5153 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:28:20.747429 5153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/data/instance:
uuid: "5d87438b23414edbb5514c4e881a85fc"
format_stamp: "Formatted at 2026-08-09 05:28:20 on dist-test-slave-h3ft"
server_key: "9a4937b9b7cb6c6b91280ad0ab0eafa2"
server_key_iv: "a07447df96032a10ce4f9c04d1deaed4"
server_key_version: "encryptionkey@0"
I20260809 05:28:20.749339 5153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance:
uuid: "5d87438b23414edbb5514c4e881a85fc"
format_stamp: "Formatted at 2026-08-09 05:28:20 on dist-test-slave-h3ft"
server_key: "9a4937b9b7cb6c6b91280ad0ab0eafa2"
server_key_iv: "a07447df96032a10ce4f9c04d1deaed4"
server_key_version: "encryptionkey@0"
I20260809 05:28:20.762741 5153 fs_manager.cc:691] Time spent creating directory manager: real 0.013s user 0.008s sys 0.004s
I20260809 05:28:20.772559 5173 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:20.777333 5153 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.003s sys 0.003s
I20260809 05:28:20.777904 5153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "5d87438b23414edbb5514c4e881a85fc"
format_stamp: "Formatted at 2026-08-09 05:28:20 on dist-test-slave-h3ft"
server_key: "9a4937b9b7cb6c6b91280ad0ab0eafa2"
server_key_iv: "a07447df96032a10ce4f9c04d1deaed4"
server_key_version: "encryptionkey@0"
I20260809 05:28:20.778334 5153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:20.830556 5153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:20.841428 5153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:20.841988 5153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:20.844420 5153 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:28:20.849740 5153 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:28:20.849984 5153 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:20.850265 5153 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:28:20.850419 5153 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:20.932085 5153 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:42851
I20260809 05:28:20.932156 5335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:42851 every 8 connection(s)
I20260809 05:28:20.935417 5153 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:28:20.939108 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 5153
I20260809 05:28:20.939579 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance
I20260809 05:28:20.940582 27364 external_mini_cluster.cc:1428] Setting key b0631d939de14641bb0220fa81248588
Aug 09 05:28:20 dist-test-slave-h3ft krb5kdc[4786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253300, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM
I20260809 05:28:20.999101 5341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:20.942228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:55095 (local address 127.26.185.62:39159)
0809 05:28:20.943542 (+ 1314us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:20.943551 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:20.946825 (+ 3274us) server_negotiation.cc:407] Connection header received
0809 05:28:20.954344 (+ 7519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:20.954351 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:20.954507 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:20.954727 (+ 220us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:20.960934 (+ 6207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:20.962457 (+ 1523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:20.969546 (+ 7089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:20.970594 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:20.970829 (+ 235us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:20.981997 (+ 11168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:20.982019 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:20.982038 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:20.982124 (+ 86us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:20.989316 (+ 7192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:20.991856 (+ 2540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:20.991862 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:20.991874 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:20.992210 (+ 336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:20.993580 (+ 1370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:20.993595 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:20.993598 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:20.994344 (+ 746us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:20.994782 (+ 438us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:20.997040 (+ 2258us) server_negotiation.cc:299] Negotiation successful
0809 05:28:20.997839 (+ 799us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1023,"thread_start_us":690,"threads_started":1}
I20260809 05:28:21.002384 5342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:20.943852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.26.185.2:55095)
0809 05:28:20.946274 (+ 2422us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:20.946455 (+ 181us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:20.953389 (+ 6934us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:20.955612 (+ 2223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:20.955646 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:20.957932 (+ 2286us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:20.960333 (+ 2401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:20.960395 (+ 62us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:20.962838 (+ 2443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:20.962858 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:20.969031 (+ 6173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:20.969085 (+ 54us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:20.971182 (+ 2097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:20.971194 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:20.972118 (+ 924us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:20.973923 (+ 1805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:20.973979 (+ 56us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:20.980818 (+ 6839us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:20.989829 (+ 9011us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:20.989852 (+ 23us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:20.989977 (+ 125us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:20.991546 (+ 1569us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:20.992531 (+ 985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:20.992633 (+ 102us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:20.992637 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:20.993181 (+ 544us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:20.994679 (+ 1498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:20.994706 (+ 27us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:20.996035 (+ 1329us) client_negotiation.cc:769] Sending connection context
0809 05:28:20.996790 (+ 755us) client_negotiation.cc:240] Negotiation successful
0809 05:28:20.998642 (+ 1852us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1628,"thread_start_us":915,"threads_started":1}
WARNING: no policy specified for oryx/127.26.185.3@KRBTEST.COM; defaulting to no policy
I20260809 05:28:21.006716 5337 heartbeater.cc:347] Connected to a master server at 127.26.185.62:39159
I20260809 05:28:21.007705 5337 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.185.3@KRBTEST.COM" created.
I20260809 05:28:21.009841 5337 heartbeater.cc:511] Master 127.26.185.62:39159 requested a full tablet report, sending...
I20260809 05:28:21.015553 4852 ts_manager.cc:194] Registered new tserver with Master: 5d87438b23414edbb5514c4e881a85fc (127.26.185.2:42851)
I20260809 05:28:21.018188 4852 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.185.2@KRBTEST.COM'} at 127.26.185.2:55095
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.185.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.3.keytab.
Entry for principal oryx/127.26.185.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.3.keytab.
W20260809 05:28:21.079792 27364 mini_kdc.cc:262] Time spent creating service keytab for oryx/127.26.185.3: real 0.132s user 0.003s sys 0.049s
I20260809 05:28:21.081959 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:0
--local_ip_for_outbound_sockets=127.26.185.3
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:39159
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.3.keytab
--principal=oryx/127.26.185.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:34197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:28:21.204842 5140 heartbeater.cc:503] Master 127.26.185.62:39159 was elected leader, sending a full tablet report...
W20260809 05:28:21.659713 5345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:21.660168 5345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:21.660342 5345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:21.668738 5345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:21.668947 5345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:21.669152 5345 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:28:21.680845 5345 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:34197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.3.keytab
--principal=oryx/127.26.185.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:39159
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:21.682950 5345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:21.684855 5345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:21.702134 5352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:21.702416 5354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:21.702171 5350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:21.703293 5345 server_base.cc:1034] running on GCE node
I20260809 05:28:21.704276 5345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:21.705754 5345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:21.707090 5345 hybrid_clock.cc:648] HybridClock initialized: now 1786253301706936 us; error 109 us; skew 500 ppm
I20260809 05:28:21.707551 5345 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:28:21 dist-test-slave-h3ft krb5kdc[4786](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253301, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:21.712018 5345 init.cc:377] Logged in from keytab as oryx/127.26.185.3@KRBTEST.COM (short username oryx)
I20260809 05:28:21.714102 5345 webserver.cc:460] Webserver started at http://127.26.185.3:42427/ using document root <none> and password file <none>
I20260809 05:28:21.715153 5345 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:21.715330 5345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:21.715734 5345 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:28:21.719657 5345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/data/instance:
uuid: "a77cb96d675343d8ba6ab3c402df5b6f"
format_stamp: "Formatted at 2026-08-09 05:28:21 on dist-test-slave-h3ft"
server_key: "e51cb9b44cff6c2c66a7d66118505d8d"
server_key_iv: "c9933702416070a9e2953305f2a05599"
server_key_version: "encryptionkey@0"
I20260809 05:28:21.720695 5345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance:
uuid: "a77cb96d675343d8ba6ab3c402df5b6f"
format_stamp: "Formatted at 2026-08-09 05:28:21 on dist-test-slave-h3ft"
server_key: "e51cb9b44cff6c2c66a7d66118505d8d"
server_key_iv: "c9933702416070a9e2953305f2a05599"
server_key_version: "encryptionkey@0"
I20260809 05:28:21.727743 5345 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.003s sys 0.004s
I20260809 05:28:21.732368 5365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:21.734314 5345 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 05:28:21.734567 5345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "a77cb96d675343d8ba6ab3c402df5b6f"
format_stamp: "Formatted at 2026-08-09 05:28:21 on dist-test-slave-h3ft"
server_key: "e51cb9b44cff6c2c66a7d66118505d8d"
server_key_iv: "c9933702416070a9e2953305f2a05599"
server_key_version: "encryptionkey@0"
I20260809 05:28:21.734850 5345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:21.762521 5345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:21.768292 5345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:21.768735 5345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:21.770087 5345 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:28:21.771869 5345 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:28:21.771989 5345 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:21.772161 5345 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:28:21.772248 5345 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:21.812810 5345 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:40925
I20260809 05:28:21.812830 5543 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:40925 every 8 connection(s)
I20260809 05:28:21.814524 5345 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:28:21.818269 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 5345
I20260809 05:28:21.818564 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance
I20260809 05:28:21.819177 27364 external_mini_cluster.cc:1428] Setting key cf36939e66d546064c8dfc4b327a77a7
Aug 09 05:28:21 dist-test-slave-h3ft krb5kdc[4786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253301, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM
I20260809 05:28:21.838765 5551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:21.817895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:51189 (local address 127.26.185.62:39159)
0809 05:28:21.818585 (+ 690us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:21.818593 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:21.819943 (+ 1350us) server_negotiation.cc:407] Connection header received
0809 05:28:21.822363 (+ 2420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:21.822368 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:21.822467 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:21.822604 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:21.824585 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:21.825452 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:21.827149 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:21.827571 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:21.827669 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:21.831894 (+ 4225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:21.831900 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:21.831903 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:21.831942 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:21.835271 (+ 3329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:21.836254 (+ 983us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:21.836258 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:21.836260 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:21.836444 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:21.836907 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:21.836910 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:21.836912 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:21.837233 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:21.837369 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:21.838240 (+ 871us) server_negotiation.cc:299] Negotiation successful
0809 05:28:21.838435 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":509,"thread_start_us":331,"threads_started":1}
I20260809 05:28:21.840409 5552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:21.818670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.26.185.3:51189)
0809 05:28:21.819689 (+ 1019us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:21.819767 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:21.822069 (+ 2302us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:21.822838 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:21.822848 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:21.823707 (+ 859us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:21.824407 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:21.824426 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:21.825602 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:21.825606 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:21.826918 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:21.826931 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:21.827771 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:21.827775 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:21.827985 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:21.828744 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:21.828767 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:21.831635 (+ 2868us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:21.835450 (+ 3815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:21.835461 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:21.835482 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:21.836122 (+ 640us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:21.836572 (+ 450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:21.836576 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:21.836579 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:21.836798 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:21.837356 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:21.837363 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:21.837800 (+ 437us) client_negotiation.cc:769] Sending connection context
0809 05:28:21.838133 (+ 333us) client_negotiation.cc:240] Negotiation successful
0809 05:28:21.838662 (+ 529us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":663,"thread_start_us":424,"threads_started":1}
I20260809 05:28:21.842201 5544 heartbeater.cc:347] Connected to a master server at 127.26.185.62:39159
I20260809 05:28:21.842590 5544 heartbeater.cc:464] Registering TS with master...
I20260809 05:28:21.843533 5544 heartbeater.cc:511] Master 127.26.185.62:39159 requested a full tablet report, sending...
I20260809 05:28:21.845331 4852 ts_manager.cc:194] Registered new tserver with Master: a77cb96d675343d8ba6ab3c402df5b6f (127.26.185.3:40925)
I20260809 05:28:21.846259 4852 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.185.3@KRBTEST.COM'} at 127.26.185.3:51189
I20260809 05:28:21.849334 27364 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.26.185.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.185.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.185.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.61.keytab.
Entry for principal oryx/127.26.185.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.61.keytab.
I20260809 05:28:21.921329 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.61:43997
--webserver_interface=127.26.185.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.61.keytab
--principal=oryx/127.26.185.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:34197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:39159,127.26.185.61:43997
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:28:22.026028 5337 heartbeater.cc:503] Master 127.26.185.62:39159 was elected leader, sending a full tablet report...
W20260809 05:28:22.351343 5555 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:22.351737 5555 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:22.351994 5555 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:22.360548 5555 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:28:22.360704 5555 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:22.360823 5555 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:22.360930 5555 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:28:22.361022 5555 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:28:22.373625 5555 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:34197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:39159,127.26.185.61:43997
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.61.keytab
--principal=oryx/127.26.185.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.61:43997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.185.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
W20260809 05:28:22.374145 5555 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.26.185.62:39159,127.26.185.61:43997'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260809 05:28:22.375758 5555 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:22.377445 5555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:22.392153 5562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:22.392181 5566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:22.392210 5563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:22.393249 5555 server_base.cc:1034] running on GCE node
I20260809 05:28:22.394415 5555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:22.396487 5555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:22.397773 5555 hybrid_clock.cc:648] HybridClock initialized: now 1786253302397703 us; error 48 us; skew 500 ppm
I20260809 05:28:22.398238 5555 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:28:22 dist-test-slave-h3ft krb5kdc[4786](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253302, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:22.408876 5555 init.cc:377] Logged in from keytab as oryx/127.26.185.61@KRBTEST.COM (short username oryx)
I20260809 05:28:22.411331 5555 webserver.cc:460] Webserver started at http://127.26.185.61:34763/ using document root <none> and password file <none>
I20260809 05:28:22.412370 5555 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:22.412541 5555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:22.413024 5555 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:28:22.417178 5555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-1/data/instance:
uuid: "a14cfca86a9d4fbcb28adef6d82b311e"
format_stamp: "Formatted at 2026-08-09 05:28:22 on dist-test-slave-h3ft"
server_key: "688fea56b12ae231987c2c790279dec5"
server_key_iv: "8f5e8b2b90ded05660ee871f9e9828bc"
server_key_version: "encryptionkey@0"
I20260809 05:28:22.418202 5555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-1/wal/instance:
uuid: "a14cfca86a9d4fbcb28adef6d82b311e"
format_stamp: "Formatted at 2026-08-09 05:28:22 on dist-test-slave-h3ft"
server_key: "688fea56b12ae231987c2c790279dec5"
server_key_iv: "8f5e8b2b90ded05660ee871f9e9828bc"
server_key_version: "encryptionkey@0"
I20260809 05:28:22.425019 5555 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.006s
I20260809 05:28:22.429502 5575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:22.431346 5555 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:28:22.431586 5555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-1/wal
uuid: "a14cfca86a9d4fbcb28adef6d82b311e"
format_stamp: "Formatted at 2026-08-09 05:28:22 on dist-test-slave-h3ft"
server_key: "688fea56b12ae231987c2c790279dec5"
server_key_iv: "8f5e8b2b90ded05660ee871f9e9828bc"
server_key_version: "encryptionkey@0"
I20260809 05:28:22.431893 5555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:22.469686 5555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:22.475647 5555 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:22.476042 5555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:22.499835 5555 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.61:43997
I20260809 05:28:22.499876 5653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.61:43997 every 8 connection(s)
I20260809 05:28:22.501811 5555 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-1/data/info.pb
I20260809 05:28:22.507016 5654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:22.507778 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 5555
I20260809 05:28:22.517409 5654 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 05:28:22 dist-test-slave-h3ft krb5kdc[4786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253298, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.185.61@KRBTEST.COM
Aug 09 05:28:22 dist-test-slave-h3ft krb5kdc[4786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253302, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.61@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM
I20260809 05:28:22.537636 5658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:22.510605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39834 (local address 127.26.185.61:43997)
0809 05:28:22.511515 (+ 910us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:22.511530 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:22.511582 (+ 52us) server_negotiation.cc:407] Connection header received
0809 05:28:22.514390 (+ 2808us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:22.514421 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:22.514928 (+ 507us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:22.515478 (+ 550us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:22.517213 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:22.518745 (+ 1532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:22.520244 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:22.521558 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:22.521795 (+ 237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:22.527551 (+ 5756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:22.527559 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:22.527572 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:22.527612 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:22.531930 (+ 4318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:22.532879 (+ 949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:22.532885 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:22.532893 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:22.533061 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:22.533523 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:22.533527 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:22.533529 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:22.534259 (+ 730us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:22.534569 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:22.535266 (+ 697us) server_negotiation.cc:299] Negotiation successful
0809 05:28:22.535805 (+ 539us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":662,"thread_start_us":428,"threads_started":1}
I20260809 05:28:22.539533 5661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:22.520424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49816 (local address 127.26.185.62:39159)
0809 05:28:22.521062 (+ 638us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:22.521071 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:22.521627 (+ 556us) server_negotiation.cc:407] Connection header received
0809 05:28:22.521951 (+ 324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:22.521958 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:22.522077 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:22.522211 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:22.523734 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:22.525121 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:22.527092 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:22.527658 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:22.527756 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:22.532320 (+ 4564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:22.532327 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:22.532331 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:22.532399 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:22.535969 (+ 3570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:22.536929 (+ 960us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:22.536936 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:22.536942 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:22.537111 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:22.537553 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:22.537556 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:22.537559 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:22.538122 (+ 563us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:22.538309 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:22.538827 (+ 518us) server_negotiation.cc:299] Negotiation successful
0809 05:28:22.539129 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":336,"threads_started":1}
I20260809 05:28:22.539636 5662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:22.520472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.0.0.1:49816)
0809 05:28:22.521470 (+ 998us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:22.521514 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:22.521729 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:22.522278 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:22.522283 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:22.523253 (+ 970us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:22.523544 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:22.523553 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:22.525283 (+ 1730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:22.525286 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:22.526886 (+ 1600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:22.526899 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:22.527866 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:22.527872 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:22.528082 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:22.528902 (+ 820us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:22.528926 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:22.532119 (+ 3193us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:22.536094 (+ 3975us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:22.536104 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:22.536111 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:22.536784 (+ 673us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:22.537236 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:22.537241 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:22.537244 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:22.537445 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:22.538268 (+ 823us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:22.538277 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:22.538483 (+ 206us) client_negotiation.cc:769] Sending connection context
0809 05:28:22.538731 (+ 248us) client_negotiation.cc:240] Negotiation successful
0809 05:28:22.539134 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":767,"thread_start_us":602,"threads_started":1}
I20260809 05:28:22.541712 5654 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 05:28:22 dist-test-slave-h3ft krb5kdc[4786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253302, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.61@KRBTEST.COM for oryx/127.26.185.61@KRBTEST.COM
I20260809 05:28:22.554675 5662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:22.542624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:43997 (local address 127.0.0.1:39842)
0809 05:28:22.542808 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:22.542825 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:22.542908 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:22.543285 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:22.543288 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:22.543642 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:22.543792 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:22.543801 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:22.544814 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:22.544817 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:22.545727 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:22.545737 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:22.546411 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:22.546416 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:22.546558 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:22.547229 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:22.547246 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:22.549480 (+ 2234us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:22.552562 (+ 3082us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:22.552566 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:22.552568 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:22.552944 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:22.553276 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:22.553279 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:22.553281 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:22.553410 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:22.553908 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:22.553911 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:22.554059 (+ 148us) client_negotiation.cc:769] Sending connection context
0809 05:28:22.554174 (+ 115us) client_negotiation.cc:240] Negotiation successful
0809 05:28:22.554404 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 05:28:22.554886 5658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:22.542820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39842 (local address 127.26.185.61:43997)
0809 05:28:22.542974 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:22.542978 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:22.542992 (+ 14us) server_negotiation.cc:407] Connection header received
0809 05:28:22.543108 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:22.543111 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:22.543166 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:22.543243 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:22.543915 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:22.544681 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:22.545846 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:22.546263 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:22.546360 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:22.549652 (+ 3292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:22.549656 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:22.549660 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:22.549691 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:22.552439 (+ 2748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:22.553058 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:22.553062 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:22.553065 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:22.553179 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:22.553498 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:22.553501 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:22.553502 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:22.553809 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:22.553922 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:22.554261 (+ 339us) server_negotiation.cc:299] Negotiation successful
0809 05:28:22.554533 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":91,"server-negotiator.queue_time_us":54}
I20260809 05:28:22.560513 5654 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e: Bootstrap starting.
I20260809 05:28:22.564455 5654 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:22.565721 5654 log.cc:824] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e: Log is configured to *not* fsync() on all Append() calls
I20260809 05:28:22.569083 5654 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e: No bootstrap required, opened a new log
I20260809 05:28:22.577247 5654 raft_consensus.cc:348] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } }
I20260809 05:28:22.577708 5654 raft_consensus.cc:374] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:22.577819 5654 raft_consensus.cc:729] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a14cfca86a9d4fbcb28adef6d82b311e, State: Initialized, Role: FOLLOWER
I20260809 05:28:22.578665 5654 consensus_queue.cc:260] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } }
I20260809 05:28:22.579792 5664 sys_catalog.cc:455] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } } }
I20260809 05:28:22.580220 5664 sys_catalog.cc:458] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [sys.catalog]: This master's current role is: FOLLOWER
I20260809 05:28:22.581192 5654 sys_catalog.cc:564] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [sys.catalog]: configured and running, proceeding with master startup.
W20260809 05:28:22.593127 5680 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 05:28:22.593398 5680 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 05:28:22.596451 5555 master_runner.cc:428] Detected that this master a14cfca86a9d4fbcb28adef6d82b311e is joining an existing cluster
I20260809 05:28:22.596590 5555 master_runner.cc:432] Initiating AddMaster RPC to add 127.26.185.61:43997
I20260809 05:28:22.621976 5658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:22.603122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39858 (local address 127.26.185.61:43997)
0809 05:28:22.603768 (+ 646us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:22.603778 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:22.604198 (+ 420us) server_negotiation.cc:407] Connection header received
0809 05:28:22.604579 (+ 381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:22.604585 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:22.604671 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:22.604757 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:22.606602 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:22.607840 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:22.610001 (+ 2161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:22.610762 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:22.610860 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:22.613985 (+ 3125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:22.613992 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:22.613997 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:22.614035 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:22.618324 (+ 4289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:22.619238 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:22.619246 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:22.619253 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:22.619473 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:22.619977 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:22.619982 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:22.619997 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:22.620497 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:22.620660 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:22.621247 (+ 587us) server_negotiation.cc:299] Negotiation successful
0809 05:28:22.621531 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413}
I20260809 05:28:22.623245 5687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:22.603226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:43997 (local address 127.0.0.1:39858)
0809 05:28:22.604069 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:22.604099 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:22.604330 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:22.605015 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:22.605027 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:22.605946 (+ 919us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:22.606425 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:22.606439 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:22.608103 (+ 1664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:22.608108 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:22.609793 (+ 1685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:22.609814 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:22.611277 (+ 1463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:22.611284 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:22.611512 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:22.612390 (+ 878us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:22.612414 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:22.613771 (+ 1357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:22.618484 (+ 4713us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:22.618490 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:22.618494 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:22.619116 (+ 622us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:22.619676 (+ 560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:22.619680 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:22.619683 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:22.619865 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:22.620745 (+ 880us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:22.620754 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:22.620912 (+ 158us) client_negotiation.cc:769] Sending connection context
0809 05:28:22.622323 (+ 1411us) client_negotiation.cc:240] Negotiation successful
0809 05:28:22.622677 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":690,"thread_start_us":523,"threads_started":1}
WARNING: no policy specified for oryx/127.26.185.60@KRBTEST.COM; defaulting to no policy
I20260809 05:28:22.633378 5661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:22.604201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49832 (local address 127.26.185.62:39159)
0809 05:28:22.604439 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:22.604448 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:22.612142 (+ 7694us) server_negotiation.cc:407] Connection header received
0809 05:28:22.615276 (+ 3134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:22.615286 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:22.615427 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:22.615517 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:22.617694 (+ 2177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:22.618948 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:22.621425 (+ 2477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:22.622278 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:22.622432 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:22.625831 (+ 3399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:22.625839 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:22.625845 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:22.625896 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:22.630008 (+ 4112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:22.630932 (+ 924us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:22.630942 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:22.630948 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:22.631166 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:22.631635 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:22.631641 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:22.631644 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:22.632081 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:22.632261 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:22.632714 (+ 453us) server_negotiation.cc:299] Negotiation successful
0809 05:28:22.632998 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 05:28:22.633543 5690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:22.604654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.0.0.1:49832)
0809 05:28:22.611980 (+ 7326us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:22.612005 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:22.612165 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:22.615783 (+ 3618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:22.615790 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:22.617000 (+ 1210us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:22.617456 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:22.617476 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:22.619191 (+ 1715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:22.619199 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:22.621234 (+ 2035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:22.621252 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:22.622794 (+ 1542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:22.622803 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:22.623472 (+ 669us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:22.624232 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:22.624259 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:22.625590 (+ 1331us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:22.630185 (+ 4595us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:22.630191 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:22.630195 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:22.630769 (+ 574us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:22.631312 (+ 543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:22.631317 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:22.631321 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:22.631498 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:22.632243 (+ 745us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:22.632247 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:22.632425 (+ 178us) client_negotiation.cc:769] Sending connection context
0809 05:28:22.632561 (+ 136us) client_negotiation.cc:240] Negotiation successful
0809 05:28:22.633130 (+ 569us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7154,"thread_start_us":6718,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.185.60@KRBTEST.COM" created.
Aug 09 05:28:22 dist-test-slave-h3ft krb5kdc[4786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253299, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.62@KRBTEST.COM for oryx/127.26.185.61@KRBTEST.COM
I20260809 05:28:22.674546 5692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:22.641490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:43997 (local address 127.0.0.1:39862)
0809 05:28:22.652134 (+ 10644us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:22.652206 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:22.652519 (+ 313us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:22.653589 (+ 1070us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:22.653600 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:22.654788 (+ 1188us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:22.655261 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:22.655279 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:22.656921 (+ 1642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:22.656930 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:22.658861 (+ 1931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:22.658884 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:22.660413 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:22.660420 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:22.660671 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:22.661675 (+ 1004us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:22.661707 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:22.665754 (+ 4047us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:22.670851 (+ 5097us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:22.670867 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:22.670876 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:22.671599 (+ 723us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:22.672098 (+ 499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:22.672103 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:22.672107 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:22.672279 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:22.673050 (+ 771us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:22.673061 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:22.673412 (+ 351us) client_negotiation.cc:769] Sending connection context
0809 05:28:22.673684 (+ 272us) client_negotiation.cc:240] Negotiation successful
0809 05:28:22.674097 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10229,"thread_start_us":10961,"threads_started":1}
I20260809 05:28:22.674811 5658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:22.641568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39862 (local address 127.26.185.61:43997)
0809 05:28:22.641829 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:22.641840 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:22.652406 (+ 10566us) server_negotiation.cc:407] Connection header received
0809 05:28:22.652937 (+ 531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:22.652947 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:22.653093 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:22.653184 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:22.655490 (+ 2306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:22.656737 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:22.659124 (+ 2387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:22.659949 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:22.660115 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:22.666102 (+ 5987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:22.666112 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:22.666118 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:22.666186 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:22.670617 (+ 4431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:22.671783 (+ 1166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:22.671789 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:22.671792 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:22.671955 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:22.672491 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:22.672499 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:22.672506 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:22.672885 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:22.673076 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:22.673853 (+ 777us) server_negotiation.cc:299] Negotiation successful
0809 05:28:22.674170 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 05:28:22.677606 4852 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.26.185.61:43997: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e"
member_type: NON_VOTER
last_known_addr {
host: "127.26.185.61"
port: 43997
}
attrs {
promote: true
}
}
dest_uuid: "83e7c63ef60d4983a1c3047ce9b3008c"
cas_config_opid_index: -1
I20260809 05:28:22.679147 4852 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: NON_VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: true } }
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.185.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.60.keytab.
Entry for principal oryx/127.26.185.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.60.keytab.
I20260809 05:28:22.684772 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.60:40007
--webserver_interface=127.26.185.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.60.keytab
--principal=oryx/127.26.185.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:34197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:39159,127.26.185.61:43997,127.26.185.60:40007
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:28:22.691512 5619 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:22.696273 5619 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [term 1 FOLLOWER]: Refusing update from remote peer 83e7c63ef60d4983a1c3047ce9b3008c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260809 05:28:22.690025 5695 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER a14cfca86a9d4fbcb28adef6d82b311e (127.26.185.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: NON_VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: true } } }
I20260809 05:28:22.705076 5697 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: NON_VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.001s
I20260809 05:28:22.718657 5695 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.26.185.61:43997
I20260809 05:28:22.722620 5555 master.cc:537] Master@127.26.185.61:43997 shutting down...
I20260809 05:28:22.724694 5697 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: NON_VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: true } } }
I20260809 05:28:22.725162 5697 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [sys.catalog]: This master's current role is: LEADER
W20260809 05:28:22.729441 5586 tablet.cc:2369] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:28:22.755945 5619 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [term 1 LEARNER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER a14cfca86a9d4fbcb28adef6d82b311e (127.26.185.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: NON_VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: true } } }
I20260809 05:28:22.771836 5710 sys_catalog.cc:455] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: NON_VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: true } } }
I20260809 05:28:22.772373 5664 sys_catalog.cc:455] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83e7c63ef60d4983a1c3047ce9b3008c. Latest consensus state: current_term: 1 leader_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: NON_VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: true } } }
I20260809 05:28:22.772531 5710 sys_catalog.cc:458] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [sys.catalog]: This master's current role is: LEARNER
I20260809 05:28:22.772687 5664 sys_catalog.cc:458] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [sys.catalog]: This master's current role is: LEARNER
I20260809 05:28:22.773017 5704 sys_catalog.cc:455] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: NON_VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: true } } }
I20260809 05:28:22.773365 5704 sys_catalog.cc:458] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [sys.catalog]: This master's current role is: LEARNER
I20260809 05:28:22.776665 5555 raft_consensus.cc:2229] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [term 1 LEARNER]: Raft consensus shutting down.
I20260809 05:28:22.777272 5555 raft_consensus.cc:2258] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [term 1 LEARNER]: Raft consensus is shut down!
I20260809 05:28:22.777464 5555 tablet_replica.cc:330] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e: stopping tablet replica
I20260809 05:28:22.788277 5555 master.cc:552] Master@127.26.185.61:43997 shutdown complete.
I20260809 05:28:22.788553 5555 master_runner.cc:305] Clearing existing system tablet
I20260809 05:28:22.789186 5555 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:22.789354 5555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:22.793183 5555 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260809 05:28:22.795462 5713 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:22.796169 5555 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:22.796784 5555 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 05:28:22.796949 5555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-1/wal
uuid: "a14cfca86a9d4fbcb28adef6d82b311e"
format_stamp: "Formatted at 2026-08-09 05:28:22 on dist-test-slave-h3ft"
server_key: "688fea56b12ae231987c2c790279dec5"
server_key_iv: "8f5e8b2b90ded05660ee871f9e9828bc"
server_key_version: "encryptionkey@0"
I20260809 05:28:22.803365 5555 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:28:22.812952 5555 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 05:28:22.813416 5555 log.cc:1196] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260809 05:28:22.814213 5555 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e: Deleting consensus metadata
I20260809 05:28:22.814654 5555 master_runner.cc:315] Copying system tablet from 127.26.185.62:39159
I20260809 05:28:22.821817 5555 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e: tablet copy: Beginning tablet copy session from remote peer at address 127.26.185.62:39159
I20260809 05:28:22.846671 5661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:22.823170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49846 (local address 127.26.185.62:39159)
0809 05:28:22.823439 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:22.823447 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:22.827458 (+ 4011us) server_negotiation.cc:407] Connection header received
0809 05:28:22.827728 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:22.827735 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:22.827841 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:22.827973 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:22.829303 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:22.830695 (+ 1392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:22.832831 (+ 2136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:22.833650 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:22.833806 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:22.836636 (+ 2830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:22.836644 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:22.836649 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:22.836698 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:22.841247 (+ 4549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:22.842342 (+ 1095us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:22.842352 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:22.842358 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:22.842626 (+ 268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:22.843427 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:22.843433 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:22.843437 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:22.844082 (+ 645us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:22.844280 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:22.845274 (+ 994us) server_negotiation.cc:299] Negotiation successful
0809 05:28:22.845704 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260809 05:28:22.849303 5721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:22.823028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.0.0.1:49846)
0809 05:28:22.827244 (+ 4216us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:22.827273 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:22.827521 (+ 248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:22.828047 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:22.828052 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:22.828755 (+ 703us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:22.829093 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:22.829108 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:22.830921 (+ 1813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:22.830928 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:22.832601 (+ 1673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:22.832626 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:22.833858 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:22.833865 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:22.834060 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:22.834962 (+ 902us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:22.834989 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:22.836374 (+ 1385us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:22.841410 (+ 5036us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:22.841416 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:22.841421 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:22.842109 (+ 688us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:22.842859 (+ 750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:22.842864 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:22.842867 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:22.843214 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:22.844410 (+ 1196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:22.844416 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:22.844765 (+ 349us) client_negotiation.cc:769] Sending connection context
0809 05:28:22.846020 (+ 1255us) client_negotiation.cc:240] Negotiation successful
0809 05:28:22.848192 (+ 2172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4005,"thread_start_us":3794,"threads_started":1}
I20260809 05:28:22.850035 5544 heartbeater.cc:503] Master 127.26.185.62:39159 was elected leader, sending a full tablet report...
I20260809 05:28:22.851987 4877 tablet_copy_service.cc:140] P 83e7c63ef60d4983a1c3047ce9b3008c: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer a14cfca86a9d4fbcb28adef6d82b311e ({username='oryx', principal='oryx/127.26.185.61@KRBTEST.COM'} at 127.0.0.1:49846)
I20260809 05:28:22.852389 4877 tablet_copy_service.cc:161] P 83e7c63ef60d4983a1c3047ce9b3008c: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer a14cfca86a9d4fbcb28adef6d82b311e at {username='oryx', principal='oryx/127.26.185.61@KRBTEST.COM'} at 127.0.0.1:49846: session id = a14cfca86a9d4fbcb28adef6d82b311e-00000000000000000000000000000000
I20260809 05:28:22.856415 4877 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 05:28:22.859531 5555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 05:28:22.867578 5555 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e: tablet copy: Starting download of 0 data blocks...
I20260809 05:28:22.868053 5555 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e: tablet copy: Starting download of 1 WAL segments...
I20260809 05:28:22.871928 5555 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 05:28:22.877416 4877 tablet_copy_service.cc:342] P 83e7c63ef60d4983a1c3047ce9b3008c: Request end of tablet copy session a14cfca86a9d4fbcb28adef6d82b311e-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.26.185.61@KRBTEST.COM'} at 127.0.0.1:49846
I20260809 05:28:22.877880 4877 tablet_copy_service.cc:433] P 83e7c63ef60d4983a1c3047ce9b3008c: ending tablet copy session a14cfca86a9d4fbcb28adef6d82b311e-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer a14cfca86a9d4fbcb28adef6d82b311e
I20260809 05:28:22.895175 5555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:22.898842 5726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:22.900646 5727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:22.908182 5555 server_base.cc:1034] running on GCE node
W20260809 05:28:22.908308 5729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:22.909067 5555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:22.909930 5555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:22.911130 5555 hybrid_clock.cc:648] HybridClock initialized: now 1786253302911050 us; error 55 us; skew 500 ppm
I20260809 05:28:22.911863 5555 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:28:22 dist-test-slave-h3ft krb5kdc[4786](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253302, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:22.914525 5555 init.cc:377] Logged in from keytab as oryx/127.26.185.61@KRBTEST.COM (short username oryx)
I20260809 05:28:22.919915 5555 webserver.cc:460] Webserver started at http://127.26.185.61:39677/ using document root <none> and password file <none>
I20260809 05:28:22.920404 5555 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:22.920506 5555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:22.924436 5555 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 05:28:22.926873 5742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:22.927444 5555 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 05:28:22.927624 5555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-1/wal
uuid: "a14cfca86a9d4fbcb28adef6d82b311e"
format_stamp: "Formatted at 2026-08-09 05:28:22 on dist-test-slave-h3ft"
server_key: "688fea56b12ae231987c2c790279dec5"
server_key_iv: "8f5e8b2b90ded05660ee871f9e9828bc"
server_key_version: "encryptionkey@0"
I20260809 05:28:22.927829 5555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:22.959590 5555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:22.964818 5555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:22.999799 5555 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.61:43997
I20260809 05:28:22.999826 5820 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.61:43997 every 8 connection(s)
I20260809 05:28:23.001482 5555 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-1/data/info.pb
I20260809 05:28:23.008401 5821 sys_catalog.cc:263] Verifying existing consensus state
I20260809 05:28:23.013722 5821 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e: Bootstrap starting.
I20260809 05:28:23.034220 5821 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 05:28:23.035050 5821 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e: Bootstrap complete.
I20260809 05:28:23.036494 5821 raft_consensus.cc:348] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: NON_VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: true } }
I20260809 05:28:23.036859 5821 raft_consensus.cc:729] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a14cfca86a9d4fbcb28adef6d82b311e, State: Initialized, Role: LEARNER
I20260809 05:28:23.037292 5821 consensus_queue.cc:260] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: NON_VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: true } }
I20260809 05:28:23.039306 5821 sys_catalog.cc:564] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:28:23.040232 5825 sys_catalog.cc:455] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: NON_VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: true } } }
I20260809 05:28:23.040746 5825 sys_catalog.cc:458] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [sys.catalog]: This master's current role is: LEARNER
I20260809 05:28:23.053757 5839 catalog_manager.cc:1259] Loaded cluster ID: abe19a6dbcdc4b1caa79aefec9852bf5
I20260809 05:28:23.053942 5839 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e: loading cluster ID for follower catalog manager: success
I20260809 05:28:23.058633 5839 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e: acquiring CA information for follower catalog manager: success
I20260809 05:28:23.062526 5839 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 05:28:23.177345 5695 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: NON_VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: true } } }
I20260809 05:28:23.177805 5695 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [sys.catalog]: This master's current role is: LEADER
I20260809 05:28:23.186792 5840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:23.177701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:43997 (local address 127.0.0.1:39878)
0809 05:28:23.179114 (+ 1413us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:23.179136 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:23.179303 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:23.179862 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:23.179866 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:23.179892 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:28:23.180145 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:23.180154 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.182322 (+ 2168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.182328 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:23.184010 (+ 1682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:23.184028 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.185920 (+ 1892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.185925 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:23.186087 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:23.186192 (+ 105us) client_negotiation.cc:769] Sending connection context
0809 05:28:23.186312 (+ 120us) client_negotiation.cc:240] Negotiation successful
0809 05:28:23.186475 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1168,"thread_start_us":1011,"threads_started":1}
I20260809 05:28:23.186956 5841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:23.177944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39878 (local address 127.26.185.61:43997)
0809 05:28:23.178800 (+ 856us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:23.178808 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:23.179267 (+ 459us) server_negotiation.cc:407] Connection header received
0809 05:28:23.179483 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:23.179489 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:23.179640 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:23.179829 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:28:23.180307 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.182108 (+ 1801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.184205 (+ 2097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.185740 (+ 1535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.185884 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:23.186231 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:23.186337 (+ 106us) server_negotiation.cc:299] Negotiation successful
0809 05:28:23.186500 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":658,"thread_start_us":458,"threads_started":1}
I20260809 05:28:23.188256 5825 sys_catalog.cc:455] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83e7c63ef60d4983a1c3047ce9b3008c. Latest consensus state: current_term: 1 leader_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: NON_VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: true } } }
I20260809 05:28:23.188613 5825 sys_catalog.cc:458] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [sys.catalog]: This master's current role is: LEARNER
I20260809 05:28:23.189399 5697 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c: attempting to promote NON_VOTER a14cfca86a9d4fbcb28adef6d82b311e to VOTER
I20260809 05:28:23.190470 5697 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } }
I20260809 05:28:23.192479 5783 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [term 1 LEARNER]: Refusing update from remote peer 83e7c63ef60d4983a1c3047ce9b3008c: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 05:28:23.193149 5695 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260809 05:28:23.196494 5697 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, a14cfca86a9d4fbcb28adef6d82b311e (127.26.185.61) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } }
I20260809 05:28:23.199764 5695 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } }
I20260809 05:28:23.199812 5697 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } }
I20260809 05:28:23.200079 5695 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [sys.catalog]: This master's current role is: LEADER
I20260809 05:28:23.200079 5697 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [sys.catalog]: This master's current role is: LEADER
I20260809 05:28:23.200570 5783 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, a14cfca86a9d4fbcb28adef6d82b311e (127.26.185.61) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } }
I20260809 05:28:23.205358 5825 sys_catalog.cc:455] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } }
I20260809 05:28:23.205757 5825 sys_catalog.cc:458] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [sys.catalog]: This master's current role is: FOLLOWER
W20260809 05:28:23.243963 5698 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:23.244390 5698 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:23.244508 5698 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:23.252804 5698 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:28:23.252942 5698 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:23.253000 5698 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:23.253072 5698 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:28:23.253120 5698 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:28:23.264504 5698 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:34197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:39159,127.26.185.61:43997,127.26.185.60:40007
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.60.keytab
--principal=oryx/127.26.185.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.60:40007
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.185.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:23.266426 5698 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:23.268245 5698 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:23.282814 5847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:23.283028 5854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:23.282977 5852 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:23.283826 5698 server_base.cc:1034] running on GCE node
I20260809 05:28:23.284893 5698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:23.286738 5698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:23.288057 5698 hybrid_clock.cc:648] HybridClock initialized: now 1786253303287965 us; error 104 us; skew 500 ppm
I20260809 05:28:23.288470 5698 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:28:23 dist-test-slave-h3ft krb5kdc[4786](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253303, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:23.292418 5698 init.cc:377] Logged in from keytab as oryx/127.26.185.60@KRBTEST.COM (short username oryx)
I20260809 05:28:23.294322 5698 webserver.cc:460] Webserver started at http://127.26.185.60:35837/ using document root <none> and password file <none>
I20260809 05:28:23.295279 5698 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:23.295436 5698 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:23.295849 5698 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:28:23.300709 5698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-2/data/instance:
uuid: "e5d610baea574692ab0005f551068264"
format_stamp: "Formatted at 2026-08-09 05:28:23 on dist-test-slave-h3ft"
server_key: "46bdd69b020f7e25ae8e5eb5d716d58c"
server_key_iv: "bc42b8b06907d8a0246e62895ae6d24d"
server_key_version: "encryptionkey@0"
I20260809 05:28:23.302003 5698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-2/wal/instance:
uuid: "e5d610baea574692ab0005f551068264"
format_stamp: "Formatted at 2026-08-09 05:28:23 on dist-test-slave-h3ft"
server_key: "46bdd69b020f7e25ae8e5eb5d716d58c"
server_key_iv: "bc42b8b06907d8a0246e62895ae6d24d"
server_key_version: "encryptionkey@0"
I20260809 05:28:23.309571 5698 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.004s
I20260809 05:28:23.314503 5863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:23.316390 5698 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:28:23.316643 5698 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-2/wal
uuid: "e5d610baea574692ab0005f551068264"
format_stamp: "Formatted at 2026-08-09 05:28:23 on dist-test-slave-h3ft"
server_key: "46bdd69b020f7e25ae8e5eb5d716d58c"
server_key_iv: "bc42b8b06907d8a0246e62895ae6d24d"
server_key_version: "encryptionkey@0"
I20260809 05:28:23.316888 5698 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:23.335281 5698 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:23.341534 5698 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:23.341919 5698 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:23.364518 5698 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.60:40007
I20260809 05:28:23.364570 5939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.60:40007 every 8 connection(s)
I20260809 05:28:23.366343 5698 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-2/data/info.pb
I20260809 05:28:23.370115 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 5698
I20260809 05:28:23.375257 5940 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:23.383903 5940 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 05:28:23 dist-test-slave-h3ft krb5kdc[4786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253298, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.185.60@KRBTEST.COM
Aug 09 05:28:23 dist-test-slave-h3ft krb5kdc[4786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253303, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.60@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM
I20260809 05:28:23.399333 5946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:23.373557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57356 (local address 127.26.185.60:40007)
0809 05:28:23.374516 (+ 959us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:23.374531 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:23.374585 (+ 54us) server_negotiation.cc:407] Connection header received
0809 05:28:23.376544 (+ 1959us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:23.376576 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:23.377067 (+ 491us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:23.377554 (+ 487us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:23.379442 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.380932 (+ 1490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.382493 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.383350 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.383571 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:23.389639 (+ 6068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:23.389656 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:23.389672 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:23.389742 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:23.393894 (+ 4152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:23.394845 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:23.394853 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:23.394862 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:23.395129 (+ 267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:23.395658 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:23.395665 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:23.395667 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:23.396530 (+ 863us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:23.396909 (+ 379us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:23.397330 (+ 421us) server_negotiation.cc:299] Negotiation successful
0809 05:28:23.397882 (+ 552us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":703,"thread_start_us":458,"threads_started":1}
I20260809 05:28:23.406284 5949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:23.387409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49856 (local address 127.26.185.62:39159)
0809 05:28:23.388974 (+ 1565us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:23.388982 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:23.389006 (+ 24us) server_negotiation.cc:407] Connection header received
0809 05:28:23.389105 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:23.389111 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:23.389218 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:23.389378 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:23.391310 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.392460 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.394522 (+ 2062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.395218 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.395365 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:23.399271 (+ 3906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:23.399277 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:23.399280 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:23.399320 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:23.403124 (+ 3804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:23.403884 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:23.403891 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:23.403899 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:23.404056 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:23.404516 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:23.404525 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:23.404529 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:23.404842 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:23.405041 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:23.405580 (+ 539us) server_negotiation.cc:299] Negotiation successful
0809 05:28:23.405841 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1420,"thread_start_us":1258,"threads_started":1}
I20260809 05:28:23.406324 5947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:23.387088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.0.0.1:49856)
0809 05:28:23.388140 (+ 1052us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:23.388209 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:23.388498 (+ 289us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:23.389472 (+ 974us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:23.389480 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:23.390617 (+ 1137us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:23.391110 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:23.391128 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.392654 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.392659 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:23.394365 (+ 1706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:23.394376 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.395403 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.395407 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:23.395542 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:23.396252 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:23.396274 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:23.399072 (+ 2798us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:23.403253 (+ 4181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:23.403262 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:23.403270 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:23.403739 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:23.404182 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:23.404187 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:23.404191 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:23.404394 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:23.405002 (+ 608us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:23.405011 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:23.405208 (+ 197us) client_negotiation.cc:769] Sending connection context
0809 05:28:23.405410 (+ 202us) client_negotiation.cc:240] Negotiation successful
0809 05:28:23.405826 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":352,"threads_started":1}
I20260809 05:28:23.408177 5940 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 05:28:23 dist-test-slave-h3ft krb5kdc[4786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253303, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.60@KRBTEST.COM for oryx/127.26.185.61@KRBTEST.COM
I20260809 05:28:23.422202 5947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:23.409043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:43997 (local address 127.0.0.1:39882)
0809 05:28:23.409273 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:23.409299 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:23.409394 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:23.409718 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:23.409722 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:23.410141 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:23.410309 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:23.410317 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.411594 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.411598 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:23.412599 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:23.412610 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.413312 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.413317 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:23.413455 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:23.414108 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:23.414126 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:23.416540 (+ 2414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:23.419892 (+ 3352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:23.419896 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:23.419899 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:23.420333 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:23.420693 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:23.420696 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:23.420698 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:23.420837 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:23.421392 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:23.421395 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:23.421532 (+ 137us) client_negotiation.cc:769] Sending connection context
0809 05:28:23.421657 (+ 125us) client_negotiation.cc:240] Negotiation successful
0809 05:28:23.421909 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260809 05:28:23.422310 5841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:23.409162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39882 (local address 127.26.185.61:43997)
0809 05:28:23.409382 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:23.409387 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:23.409407 (+ 20us) server_negotiation.cc:407] Connection header received
0809 05:28:23.409515 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:23.409519 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:23.409597 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:23.409686 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:23.410463 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.411469 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.412727 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.413177 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.413274 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:23.416745 (+ 3471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:23.416750 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:23.416754 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:23.416794 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:23.419760 (+ 2966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:23.420439 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:23.420443 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:23.420445 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:23.420596 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:23.420927 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:23.420930 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:23.420932 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:23.421285 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:23.421459 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:23.421752 (+ 293us) server_negotiation.cc:299] Negotiation successful
0809 05:28:23.421958 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260809 05:28:23.423802 5940 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.60" port: 40007 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 05:28:23 dist-test-slave-h3ft krb5kdc[4786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253303, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.60@KRBTEST.COM for oryx/127.26.185.60@KRBTEST.COM
I20260809 05:28:23.437714 5947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:23.424858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:40007 (local address 127.0.0.1:57360)
0809 05:28:23.425034 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:23.425053 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:23.425152 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:23.425410 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:23.425413 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:23.425787 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:23.425936 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:23.425944 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.426921 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.426925 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:23.427858 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:23.427869 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.428724 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.428730 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:23.428929 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:23.429696 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:23.429760 (+ 64us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:23.432190 (+ 2430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:23.435342 (+ 3152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:23.435345 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:23.435348 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:23.435720 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:23.436167 (+ 447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:23.436171 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:23.436173 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:23.436333 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:23.436869 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:23.436872 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:23.437006 (+ 134us) client_negotiation.cc:769] Sending connection context
0809 05:28:23.437129 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 05:28:23.437373 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 05:28:23.438042 5946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:23.424739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57360 (local address 127.26.185.60:40007)
0809 05:28:23.424955 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:23.424961 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:23.425118 (+ 157us) server_negotiation.cc:407] Connection header received
0809 05:28:23.425238 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:23.425242 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:23.425301 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:23.425376 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:23.426068 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.426809 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.427978 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.428460 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.428560 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:23.432363 (+ 3803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:23.432368 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:23.432371 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:23.432401 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:23.435211 (+ 2810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:23.435853 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:23.435858 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:23.435861 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:23.436051 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:23.436453 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:23.436457 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:23.436460 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:23.436766 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:23.436885 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:23.437258 (+ 373us) server_negotiation.cc:299] Negotiation successful
0809 05:28:23.437533 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":67}
I20260809 05:28:23.444456 5940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264: Bootstrap starting.
I20260809 05:28:23.448596 5940 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:23.449906 5940 log.cc:824] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264: Log is configured to *not* fsync() on all Append() calls
I20260809 05:28:23.453588 5940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264: No bootstrap required, opened a new log
I20260809 05:28:23.462381 5940 raft_consensus.cc:348] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 40007 } }
I20260809 05:28:23.462878 5940 raft_consensus.cc:374] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:23.462984 5940 raft_consensus.cc:729] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5d610baea574692ab0005f551068264, State: Initialized, Role: FOLLOWER
I20260809 05:28:23.463794 5940 consensus_queue.cc:260] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 40007 } }
I20260809 05:28:23.464884 5953 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 40007 } } }
I20260809 05:28:23.465263 5953 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 05:28:23.466707 5940 sys_catalog.cc:564] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 05:28:23.477605 5968 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 05:28:23.477859 5968 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 05:28:23.484285 5698 master_runner.cc:428] Detected that this master e5d610baea574692ab0005f551068264 is joining an existing cluster
I20260809 05:28:23.484442 5698 master_runner.cc:432] Initiating AddMaster RPC to add 127.26.185.60:40007
I20260809 05:28:23.507982 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 4939
I20260809 05:28:23.518805 5946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:23.490729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57376 (local address 127.26.185.60:40007)
0809 05:28:23.490952 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:23.490958 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:23.496847 (+ 5889us) server_negotiation.cc:407] Connection header received
0809 05:28:23.497124 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:23.497133 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:23.497224 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:23.497301 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:23.499393 (+ 2092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.500611 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.503281 (+ 2670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.504298 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.504431 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:23.508376 (+ 3945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:23.508386 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:23.508392 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:23.508440 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:23.513369 (+ 4929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:23.515817 (+ 2448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:23.515822 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:23.515826 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:23.515961 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:23.516373 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:23.516378 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:23.516381 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:23.516792 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:23.516960 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:23.518042 (+ 1082us) server_negotiation.cc:299] Negotiation successful
0809 05:28:23.518296 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":70}
I20260809 05:28:23.520057 5979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:23.490947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:40007 (local address 127.0.0.1:57376)
0809 05:28:23.496721 (+ 5774us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:23.496754 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:23.496965 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:23.497557 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:23.497564 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:23.498612 (+ 1048us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:23.499209 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:23.499228 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.500829 (+ 1601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.500838 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:23.503139 (+ 2301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:23.503152 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.505283 (+ 2131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.505297 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:23.505467 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:23.506353 (+ 886us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:23.506375 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:23.508177 (+ 1802us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:23.515109 (+ 6932us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:23.515116 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:23.515120 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:23.515677 (+ 557us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:23.516094 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:23.516099 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:23.516103 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:23.516247 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:23.517032 (+ 785us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:23.517036 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:23.517228 (+ 192us) client_negotiation.cc:769] Sending connection context
0809 05:28:23.519189 (+ 1961us) client_negotiation.cc:240] Negotiation successful
0809 05:28:23.519541 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5599,"thread_start_us":518,"threads_started":1}
I20260809 05:28:23.520943 5841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:23.490154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39892 (local address 127.26.185.61:43997)
0809 05:28:23.490367 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:23.490385 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:23.491998 (+ 1613us) server_negotiation.cc:407] Connection header received
0809 05:28:23.492390 (+ 392us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:23.492401 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:23.492543 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:23.492704 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:23.494284 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.495803 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.498128 (+ 2325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.498827 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.498945 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:23.509317 (+ 10372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:23.509325 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:23.509332 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:23.509390 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:23.513839 (+ 4449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:23.514987 (+ 1148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:23.514997 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:23.515025 (+ 28us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:23.515273 (+ 248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:23.515920 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:23.515928 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:23.515934 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:23.516509 (+ 575us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:23.516653 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:23.517551 (+ 898us) server_negotiation.cc:299] Negotiation successful
0809 05:28:23.520082 (+ 2531us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 05:28:23.522466 5976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:23.490041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:43997 (local address 127.0.0.1:39892)
0809 05:28:23.491842 (+ 1801us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:23.491875 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:23.492161 (+ 286us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:23.492761 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:23.492769 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:23.493644 (+ 875us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:23.494093 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:23.494108 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.496007 (+ 1899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.496014 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:23.497903 (+ 1889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:23.497920 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.503754 (+ 5834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.503764 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:23.504160 (+ 396us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:23.505344 (+ 1184us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:23.505369 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:23.507352 (+ 1983us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:23.514075 (+ 6723us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:23.514084 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:23.514092 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:23.514765 (+ 673us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:23.515487 (+ 722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:23.515495 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:23.515501 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:23.515760 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:23.516779 (+ 1019us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:23.516788 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:23.517140 (+ 352us) client_negotiation.cc:769] Sending connection context
0809 05:28:23.521421 (+ 4281us) client_negotiation.cc:240] Negotiation successful
0809 05:28:23.521877 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1639,"mutex_wait_us":25,"thread_start_us":13107,"threads_started":1}
I20260809 05:28:23.532996 5974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:23.495697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.0.0.1:49864)
0809 05:28:23.502813 (+ 7116us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:23.502836 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:23.503052 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:23.503487 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:23.503492 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:23.504588 (+ 1096us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:23.507412 (+ 2824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:23.507425 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.513548 (+ 6123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.513554 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:23.517760 (+ 4206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:23.517775 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.520921 (+ 3146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.520929 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:23.521146 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:23.522043 (+ 897us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:23.522069 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:23.523364 (+ 1295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:23.528794 (+ 5430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:23.528800 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:23.528804 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:23.529376 (+ 572us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:23.529971 (+ 595us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:23.529976 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:23.529979 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:23.530194 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:23.531729 (+ 1535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:23.531733 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:23.531916 (+ 183us) client_negotiation.cc:769] Sending connection context
0809 05:28:23.532050 (+ 134us) client_negotiation.cc:240] Negotiation successful
0809 05:28:23.532375 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6943,"thread_start_us":805,"threads_started":1}
I20260809 05:28:23.533586 5949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:23.489882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49864 (local address 127.26.185.62:39159)
0809 05:28:23.490143 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:23.490152 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:23.502993 (+ 12841us) server_negotiation.cc:407] Connection header received
0809 05:28:23.503202 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:23.503209 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:23.503325 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:23.503442 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:23.507592 (+ 4150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.508788 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.517963 (+ 9175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.518987 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.519679 (+ 692us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:23.524289 (+ 4610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:23.524295 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:23.524300 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:23.524346 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:23.528610 (+ 4264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:23.529613 (+ 1003us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:23.529620 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:23.529624 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:23.529814 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:23.531122 (+ 1308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:23.531128 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:23.531131 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:23.531605 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:23.531783 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:23.532789 (+ 1006us) server_negotiation.cc:299] Negotiation successful
0809 05:28:23.533103 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
Aug 09 05:28:23 dist-test-slave-h3ft krb5kdc[4786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253298, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.185.1@KRBTEST.COM
Aug 09 05:28:23 dist-test-slave-h3ft krb5kdc[4786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253299, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.62@KRBTEST.COM for oryx/127.26.185.60@KRBTEST.COM
I20260809 05:28:23.548231 5980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:23.510167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35278 (local address 127.26.185.1:39559)
0809 05:28:23.523927 (+ 13760us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:23.523939 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:23.523978 (+ 39us) server_negotiation.cc:407] Connection header received
0809 05:28:23.524071 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:23.524084 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:23.524506 (+ 422us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:23.526695 (+ 2189us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:23.526943 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.528151 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.530223 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.532228 (+ 2005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.532375 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:23.538668 (+ 6293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:23.538689 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:23.538714 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:23.538767 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:23.543368 (+ 4601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:23.544422 (+ 1054us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:23.544432 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:23.544436 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:23.544622 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:23.545129 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:23.545134 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:23.545137 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:23.545658 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:23.547210 (+ 1552us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:23.547404 (+ 194us) server_negotiation.cc:299] Negotiation successful
0809 05:28:23.547738 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13498,"thread_start_us":14496,"threads_started":1}
I20260809 05:28:23.550091 5133 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:23.557260 5840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:23.540357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:40007 (local address 127.0.0.1:57384)
0809 05:28:23.540571 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:23.540594 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:23.540717 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:23.541518 (+ 801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:23.541523 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:23.542011 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:23.542181 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:23.542190 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.543580 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.543586 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:23.544717 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:23.544729 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.545525 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.545531 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:23.545725 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:23.546361 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:23.546379 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:23.548940 (+ 2561us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:23.553993 (+ 5053us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:23.554000 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:23.554004 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:23.554642 (+ 638us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:23.555169 (+ 527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:23.555175 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:23.555179 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:23.555358 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:23.556084 (+ 726us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:23.556089 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:23.556313 (+ 224us) client_negotiation.cc:769] Sending connection context
0809 05:28:23.556481 (+ 168us) client_negotiation.cc:240] Negotiation successful
0809 05:28:23.556819 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260809 05:28:23.557264 5946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:23.540818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57384 (local address 127.26.185.60:40007)
0809 05:28:23.541026 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:23.541032 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:23.541080 (+ 48us) server_negotiation.cc:407] Connection header received
0809 05:28:23.541197 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:23.541204 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:23.541362 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:23.541461 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:23.542345 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.543367 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.544861 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.545370 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.545517 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:23.549151 (+ 3634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:23.549158 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:23.549164 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:23.549209 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:23.553810 (+ 4601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:23.554827 (+ 1017us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:23.554832 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:23.554836 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:23.554990 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:23.555493 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:23.555498 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:23.555502 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:23.555920 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:23.556073 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:23.556624 (+ 551us) server_negotiation.cc:299] Negotiation successful
0809 05:28:23.556893 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 05:28:23.559228 4852 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.26.185.60:40007: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "e5d610baea574692ab0005f551068264"
member_type: NON_VOTER
last_known_addr {
host: "127.26.185.60"
port: 40007
}
attrs {
promote: true
}
}
dest_uuid: "83e7c63ef60d4983a1c3047ce9b3008c"
cas_config_opid_index: 6
I20260809 05:28:23.560206 4852 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: NON_VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: true } }
I20260809 05:28:23.563095 5783 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [term 1 FOLLOWER]: Refusing update from remote peer 83e7c63ef60d4983a1c3047ce9b3008c: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260809 05:28:23.563946 5697 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260809 05:28:23.564832 5908 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:23.569445 5908 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [term 1 FOLLOWER]: Refusing update from remote peer 83e7c63ef60d4983a1c3047ce9b3008c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260809 05:28:23.570806 5697 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: NON_VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:28:23.573246 5699 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER e5d610baea574692ab0005f551068264 (127.26.185.60) added. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: NON_VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: true } } }
I20260809 05:28:23.576156 5783 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER e5d610baea574692ab0005f551068264 (127.26.185.60) added. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: NON_VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: true } } }
I20260809 05:28:23.578059 5699 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.26.185.60:40007
I20260809 05:28:23.578850 5698 master.cc:537] Master@127.26.185.60:40007 shutting down...
I20260809 05:28:23.580837 5825 sys_catalog.cc:455] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: NON_VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: true } } }
I20260809 05:28:23.581313 5825 sys_catalog.cc:458] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [sys.catalog]: This master's current role is: FOLLOWER
I20260809 05:28:23.582614 5695 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: NON_VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: true } } }
I20260809 05:28:23.583097 5695 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [sys.catalog]: This master's current role is: LEADER
I20260809 05:28:23.583704 5699 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: NON_VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: true } } }
I20260809 05:28:23.584190 5699 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [sys.catalog]: This master's current role is: LEADER
I20260809 05:28:23.588914 5908 raft_consensus.cc:858] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 40007 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: NON_VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } }
W20260809 05:28:23.589146 5908 raft_consensus.cc:1565] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 1 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 40007 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: NON_VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } }
W20260809 05:28:23.594707 5876 tablet.cc:2369] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:28:23.615289 5908 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER a14cfca86a9d4fbcb28adef6d82b311e (127.26.185.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: NON_VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: true } } }
I20260809 05:28:23.621184 5992 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: NON_VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: true } } }
I20260809 05:28:23.621817 5992 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260809 05:28:23.621878 5953 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83e7c63ef60d4983a1c3047ce9b3008c. Latest consensus state: current_term: 1 leader_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: NON_VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: true } } }
I20260809 05:28:23.622254 5953 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260809 05:28:23.622529 5986 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: NON_VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: true } } }
I20260809 05:28:23.623886 5986 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260809 05:28:23.625635 5697 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: NON_VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: true } } }
I20260809 05:28:23.625991 5697 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [sys.catalog]: This master's current role is: LEADER
W20260809 05:28:23.627190 4829 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260809 05:28:23.627655 5698 raft_consensus.cc:2229] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260809 05:28:23.628325 5698 raft_consensus.cc:2258] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260809 05:28:23.628551 5698 tablet_replica.cc:330] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264: stopping tablet replica
W20260809 05:28:23.634521 5867 connection.cc:441] server connection from 127.0.0.1:57384 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57384 (request call id 4) could send its response
W20260809 05:28:23.635653 4829 consensus_peers.cc:487] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c -> Peer e5d610baea574692ab0005f551068264 (127.26.185.60:40007): Couldn't send request to peer e5d610baea574692ab0005f551068264. Status: Network error: recv got EOF from 127.26.185.60:40007 (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260809 05:28:23.650400 5698 master.cc:552] Master@127.26.185.60:40007 shutdown complete.
I20260809 05:28:23.650568 5698 master_runner.cc:305] Clearing existing system tablet
I20260809 05:28:23.651103 5698 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:23.651288 5698 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:23.654407 5698 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260809 05:28:23.656435 5998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:23.656948 5698 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:23.657246 5698 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260809 05:28:23.657369 5698 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-2/wal
uuid: "e5d610baea574692ab0005f551068264"
format_stamp: "Formatted at 2026-08-09 05:28:23 on dist-test-slave-h3ft"
server_key: "46bdd69b020f7e25ae8e5eb5d716d58c"
server_key_iv: "bc42b8b06907d8a0246e62895ae6d24d"
server_key_version: "encryptionkey@0"
I20260809 05:28:23.661345 5698 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:28:23.668252 5698 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 05:28:23.668517 5698 log.cc:1196] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260809 05:28:23.669287 5698 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264: Deleting consensus metadata
I20260809 05:28:23.669703 5698 master_runner.cc:315] Copying system tablet from 127.26.185.62:39159
I20260809 05:28:23.679236 5698 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264: tablet copy: Beginning tablet copy session from remote peer at address 127.26.185.62:39159
I20260809 05:28:23.702989 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 4939
I20260809 05:28:23.716090 5949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:23.680490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49870 (local address 127.26.185.62:39159)
0809 05:28:23.680881 (+ 391us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:23.680892 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:23.692190 (+ 11298us) server_negotiation.cc:407] Connection header received
0809 05:28:23.692480 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:23.692487 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:23.692619 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:23.692767 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:23.693934 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.694762 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.696299 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.696850 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.697028 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:23.699982 (+ 2954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:23.699991 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:23.699999 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:23.700056 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:23.712321 (+ 12265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:23.713355 (+ 1034us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:23.713361 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:23.713364 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:23.713557 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:23.714079 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:23.714086 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:23.714094 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:23.714498 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:23.714730 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:23.715319 (+ 589us) server_negotiation.cc:299] Negotiation successful
0809 05:28:23.715642 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171}
I20260809 05:28:23.716132 6007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:23.680485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.0.0.1:49870)
0809 05:28:23.691968 (+ 11483us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:23.691994 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:23.692284 (+ 290us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:23.692814 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:23.692820 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:23.693424 (+ 604us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:23.693717 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:23.693729 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.694952 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.694963 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:23.696120 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:23.696135 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:23.697074 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:23.697081 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:23.697294 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:23.698132 (+ 838us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:23.698155 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:23.699648 (+ 1493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:23.712623 (+ 12975us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:23.712629 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:23.712632 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:23.713154 (+ 522us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:23.713714 (+ 560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:23.713720 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:23.713728 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:23.713924 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:23.714675 (+ 751us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:23.714680 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:23.714918 (+ 238us) client_negotiation.cc:769] Sending connection context
0809 05:28:23.715143 (+ 225us) client_negotiation.cc:240] Negotiation successful
0809 05:28:23.715612 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11282,"thread_start_us":11065,"threads_started":1}
I20260809 05:28:23.717386 4877 tablet_copy_service.cc:140] P 83e7c63ef60d4983a1c3047ce9b3008c: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer e5d610baea574692ab0005f551068264 ({username='oryx', principal='oryx/127.26.185.60@KRBTEST.COM'} at 127.0.0.1:49870)
I20260809 05:28:23.717626 4877 tablet_copy_service.cc:161] P 83e7c63ef60d4983a1c3047ce9b3008c: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer e5d610baea574692ab0005f551068264 at {username='oryx', principal='oryx/127.26.185.60@KRBTEST.COM'} at 127.0.0.1:49870: session id = e5d610baea574692ab0005f551068264-00000000000000000000000000000000
I20260809 05:28:23.721736 4877 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 05:28:23.724534 5698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 05:28:23.733968 5698 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264: tablet copy: Starting download of 0 data blocks...
I20260809 05:28:23.734440 5698 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264: tablet copy: Starting download of 1 WAL segments...
I20260809 05:28:23.738137 5698 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 05:28:23.738621 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:39559
--local_ip_for_outbound_sockets=127.26.185.1
--tserver_master_addrs=127.26.185.62:39159
--webserver_port=39421
--webserver_interface=127.26.185.1
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.1.keytab
--principal=oryx/127.26.185.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:34197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.185.62:39159,127.26.185.61:43997
--tserver_master_addrs=127.26.185.62:39159,127.26.185.61:43997,127.26.185.60:40007 with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:28:23.743331 4877 tablet_copy_service.cc:342] P 83e7c63ef60d4983a1c3047ce9b3008c: Request end of tablet copy session e5d610baea574692ab0005f551068264-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.26.185.60@KRBTEST.COM'} at 127.0.0.1:49870
I20260809 05:28:23.743544 4877 tablet_copy_service.cc:433] P 83e7c63ef60d4983a1c3047ce9b3008c: ending tablet copy session e5d610baea574692ab0005f551068264-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer e5d610baea574692ab0005f551068264
I20260809 05:28:23.758113 5698 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:23.761575 6009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:23.766892 6010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:23.770475 5698 server_base.cc:1034] running on GCE node
W20260809 05:28:23.770886 6012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:23.771554 5698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:23.772504 5698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:23.773765 5698 hybrid_clock.cc:648] HybridClock initialized: now 1786253303773724 us; error 40 us; skew 500 ppm
I20260809 05:28:23.774129 5698 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:28:23 dist-test-slave-h3ft krb5kdc[4786](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253303, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:23.777161 5698 init.cc:377] Logged in from keytab as oryx/127.26.185.60@KRBTEST.COM (short username oryx)
I20260809 05:28:23.780807 5698 webserver.cc:460] Webserver started at http://127.26.185.60:45087/ using document root <none> and password file <none>
I20260809 05:28:23.781266 5698 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:23.781410 5698 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:23.784955 5698 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 05:28:23.795663 6024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:23.796320 5698 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.007s sys 0.003s
I20260809 05:28:23.796525 5698 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-2/wal
uuid: "e5d610baea574692ab0005f551068264"
format_stamp: "Formatted at 2026-08-09 05:28:23 on dist-test-slave-h3ft"
server_key: "46bdd69b020f7e25ae8e5eb5d716d58c"
server_key_iv: "bc42b8b06907d8a0246e62895ae6d24d"
server_key_version: "encryptionkey@0"
I20260809 05:28:23.796792 5698 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:23.831223 5698 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:23.836092 5698 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:23.870582 5698 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.60:40007
I20260809 05:28:23.870608 6110 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.60:40007 every 8 connection(s)
I20260809 05:28:23.871819 5698 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/master-2/data/info.pb
I20260809 05:28:23.879689 6111 sys_catalog.cc:263] Verifying existing consensus state
I20260809 05:28:23.885784 6111 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264: Bootstrap starting.
I20260809 05:28:23.900403 6111 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 05:28:23.901197 6111 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264: Bootstrap complete.
I20260809 05:28:23.902278 6111 raft_consensus.cc:348] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: NON_VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: true } }
I20260809 05:28:23.902608 6111 raft_consensus.cc:729] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e5d610baea574692ab0005f551068264, State: Initialized, Role: LEARNER
I20260809 05:28:23.902871 6111 consensus_queue.cc:260] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: NON_VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: true } }
I20260809 05:28:23.903872 6115 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: NON_VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: true } } }
I20260809 05:28:23.904392 6111 sys_catalog.cc:564] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:28:23.904430 6115 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [sys.catalog]: This master's current role is: LEARNER
I20260809 05:28:23.921984 6128 catalog_manager.cc:1259] Loaded cluster ID: abe19a6dbcdc4b1caa79aefec9852bf5
I20260809 05:28:23.922152 6128 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264: loading cluster ID for follower catalog manager: success
I20260809 05:28:23.925087 6128 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264: acquiring CA information for follower catalog manager: success
I20260809 05:28:23.927245 6128 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 05:28:24.026983 5697 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: NON_VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: true } } }
I20260809 05:28:24.027454 5697 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [sys.catalog]: This master's current role is: LEADER
I20260809 05:28:24.036983 6129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:24.028160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57394 (local address 127.26.185.60:40007)
0809 05:28:24.028976 (+ 816us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:24.028983 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:24.029008 (+ 25us) server_negotiation.cc:407] Connection header received
0809 05:28:24.029106 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:24.029112 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:24.029220 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:24.029424 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:28:24.029969 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:24.031762 (+ 1793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:24.034205 (+ 2443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:24.035652 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:24.035806 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:24.036108 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:24.036384 (+ 276us) server_negotiation.cc:299] Negotiation successful
0809 05:28:24.036551 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":646,"thread_start_us":416,"threads_started":1}
I20260809 05:28:24.037021 5840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:24.027481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:40007 (local address 127.0.0.1:57394)
0809 05:28:24.027762 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:24.027789 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:24.027970 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:24.029481 (+ 1511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:24.029487 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:24.029530 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:28:24.029783 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:24.029794 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:24.031936 (+ 2142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:24.031942 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:24.033955 (+ 2013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:24.033974 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:24.035852 (+ 1878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:24.035859 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:24.036133 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:24.036196 (+ 63us) client_negotiation.cc:769] Sending connection context
0809 05:28:24.036337 (+ 141us) client_negotiation.cc:240] Negotiation successful
0809 05:28:24.036576 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130}
I20260809 05:28:24.038741 6070 raft_consensus.cc:1203] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.5->[1.6-1.7] Dedup: 1.7->[]
I20260809 05:28:24.039587 6115 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83e7c63ef60d4983a1c3047ce9b3008c. Latest consensus state: current_term: 1 leader_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: NON_VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: true } } }
I20260809 05:28:24.039985 6115 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [sys.catalog]: This master's current role is: LEARNER
I20260809 05:28:24.040850 5697 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c: attempting to promote NON_VOTER e5d610baea574692ab0005f551068264 to VOTER
I20260809 05:28:24.041971 5697 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: false } }
I20260809 05:28:24.044699 6070 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [term 1 LEARNER]: Refusing update from remote peer 83e7c63ef60d4983a1c3047ce9b3008c: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260809 05:28:24.044713 5783 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [term 1 FOLLOWER]: Refusing update from remote peer 83e7c63ef60d4983a1c3047ce9b3008c: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260809 05:28:24.045501 5695 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260809 05:28:24.045940 5699 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260809 05:28:24.049831 5695 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, e5d610baea574692ab0005f551068264 (127.26.185.60) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: false } } }
I20260809 05:28:24.051906 5783 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, e5d610baea574692ab0005f551068264 (127.26.185.60) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: false } } }
I20260809 05:28:24.059212 5695 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: false } } }
I20260809 05:28:24.059685 5699 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: false } } }
I20260809 05:28:24.060037 5699 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [sys.catalog]: This master's current role is: LEADER
I20260809 05:28:24.060266 5699 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: false } } }
I20260809 05:28:24.060505 5699 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [sys.catalog]: This master's current role is: LEADER
I20260809 05:28:24.059703 5695 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c [sys.catalog]: This master's current role is: LEADER
I20260809 05:28:24.061817 5825 sys_catalog.cc:455] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: false } } }
I20260809 05:28:24.062151 5825 sys_catalog.cc:458] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [sys.catalog]: This master's current role is: FOLLOWER
I20260809 05:28:24.062353 6070 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, e5d610baea574692ab0005f551068264 (127.26.185.60) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: false } } }
I20260809 05:28:24.067106 6115 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: false } } }
I20260809 05:28:24.067457 6115 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [sys.catalog]: This master's current role is: FOLLOWER
W20260809 05:28:24.249897 6008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:24.250293 6008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:24.250413 6008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:24.258929 6008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:24.259119 6008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:24.259346 6008 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:28:24.270730 6008 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:34197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.1.keytab
--principal=oryx/127.26.185.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:39559
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=39421
--tserver_master_addrs=127.26.185.62:39159,127.26.185.61:43997,127.26.185.60:40007
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:24.272675 6008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:24.274431 6008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:24.291689 6140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:24.291669 6146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:24.291738 6141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:24.292758 6008 server_base.cc:1034] running on GCE node
I20260809 05:28:24.293567 6008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:24.294890 6008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:24.296157 6008 hybrid_clock.cc:648] HybridClock initialized: now 1786253304296080 us; error 75 us; skew 500 ppm
I20260809 05:28:24.296624 6008 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:28:24 dist-test-slave-h3ft krb5kdc[4786](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253304, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:24.302776 6008 init.cc:377] Logged in from keytab as oryx/127.26.185.1@KRBTEST.COM (short username oryx)
I20260809 05:28:24.311627 6008 webserver.cc:460] Webserver started at http://127.26.185.1:39421/ using document root <none> and password file <none>
I20260809 05:28:24.313194 6008 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:24.313397 6008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:24.321733 6008 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 05:28:24.325342 6154 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:24.327189 6008 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:28:24.327411 6008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "cfd46d97aa5b4db5bcb371b14e8ed36f"
format_stamp: "Formatted at 2026-08-09 05:28:20 on dist-test-slave-h3ft"
server_key: "8cb864a6777dd6266d5f763a4a7b9f71"
server_key_iv: "7a8eec9d68568caa04a4bd3ccd96427d"
server_key_version: "encryptionkey@0"
I20260809 05:28:24.328696 6008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:24.372890 6008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:24.378834 6008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:24.379244 6008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:24.380506 6008 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:28:24.382301 6008 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:28:24.382395 6008 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:24.382541 6008 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:28:24.382628 6008 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:24.423079 6008 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:39559
I20260809 05:28:24.423192 6316 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:39559 every 8 connection(s)
I20260809 05:28:24.425101 6008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:28:24.434772 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 6008
I20260809 05:28:24.435319 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 5153
Aug 09 05:28:24 dist-test-slave-h3ft krb5kdc[4786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253298, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.185.2@KRBTEST.COM
Aug 09 05:28:24 dist-test-slave-h3ft krb5kdc[4786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253304, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.61@KRBTEST.COM
Aug 09 05:28:24 dist-test-slave-h3ft krb5kdc[4786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253304, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.60@KRBTEST.COM
Aug 09 05:28:24 dist-test-slave-h3ft krb5kdc[4786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253304, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM
I20260809 05:28:24.483381 6333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:24.436918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55080 (local address 127.26.185.2:42851)
0809 05:28:24.452690 (+ 15772us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:24.452703 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:24.453941 (+ 1238us) server_negotiation.cc:407] Connection header received
0809 05:28:24.454064 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:24.454077 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:24.454466 (+ 389us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:24.454671 (+ 205us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:24.457594 (+ 2923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:24.459411 (+ 1817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:24.461458 (+ 2047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:24.462403 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:24.462557 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:24.470296 (+ 7739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:24.470320 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:24.470343 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:24.470412 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:24.477629 (+ 7217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:24.478943 (+ 1314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:24.478956 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:24.478961 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:24.479235 (+ 274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:24.479810 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:24.479815 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:24.479818 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:24.480406 (+ 588us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:24.480779 (+ 373us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:24.482385 (+ 1606us) server_negotiation.cc:299] Negotiation successful
0809 05:28:24.482751 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15475,"thread_start_us":15791,"threads_started":1}
I20260809 05:28:24.485450 5329 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:24.488469 6330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:24.430550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:33243 (local address 127.26.185.61:43997)
0809 05:28:24.458253 (+ 27703us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:24.458260 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:24.458287 (+ 27us) server_negotiation.cc:407] Connection header received
0809 05:28:24.460585 (+ 2298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:24.460593 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:24.460705 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:24.460820 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:24.464647 (+ 3827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:24.465990 (+ 1343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:24.470109 (+ 4119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:24.470906 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:24.471066 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:24.477493 (+ 6427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:24.477504 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:24.477511 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:24.477576 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:24.483171 (+ 5595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:24.484353 (+ 1182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:24.484359 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:24.484362 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:24.484569 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:24.485093 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:24.485098 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:24.485102 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:24.485552 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:24.485728 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:24.486959 (+ 1231us) server_negotiation.cc:299] Negotiation successful
0809 05:28:24.487489 (+ 530us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27513,"thread_start_us":27326,"threads_started":1}
I20260809 05:28:24.488907 6328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:24.429767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:43997 (local address 127.26.185.1:33243)
0809 05:28:24.452845 (+ 23078us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:24.452938 (+ 93us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:24.460010 (+ 7072us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:24.461344 (+ 1334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:24.461362 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:24.462644 (+ 1282us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:24.464340 (+ 1696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:24.464380 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:24.466292 (+ 1912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:24.466330 (+ 38us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:24.469866 (+ 3536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:24.469887 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:24.471588 (+ 1701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:24.471600 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:24.472163 (+ 563us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:24.473261 (+ 1098us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:24.473311 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:24.477056 (+ 3745us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:24.483394 (+ 6338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:24.483402 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:24.483408 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:24.484190 (+ 782us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:24.484734 (+ 544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:24.484740 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:24.484744 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:24.484932 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:24.485815 (+ 883us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:24.485822 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:24.486360 (+ 538us) client_negotiation.cc:769] Sending connection context
0809 05:28:24.486714 (+ 354us) client_negotiation.cc:240] Negotiation successful
0809 05:28:24.487397 (+ 683us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22518,"mutex_wait_us":661,"spinlock_wait_cycles":21888,"thread_start_us":29422,"threads_started":1}
I20260809 05:28:24.491225 6323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:24.428762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:41669 (local address 127.26.185.62:39159)
0809 05:28:24.457635 (+ 28873us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:24.457642 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:24.460529 (+ 2887us) server_negotiation.cc:407] Connection header received
0809 05:28:24.460632 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:24.460638 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:24.460767 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:24.460911 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:24.464651 (+ 3740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:24.466047 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:24.470118 (+ 4071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:24.470875 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:24.471045 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:24.478224 (+ 7179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:24.478232 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:24.478239 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:24.478306 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:24.482821 (+ 4515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:24.485368 (+ 2547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:24.485375 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:24.485378 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:24.485603 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:24.486151 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:24.486156 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:24.486159 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:24.486600 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:24.486772 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:24.490399 (+ 3627us) server_negotiation.cc:299] Negotiation successful
0809 05:28:24.490705 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28698,"thread_start_us":28526,"threads_started":1}
I20260809 05:28:24.491657 6320 heartbeater.cc:347] Connected to a master server at 127.26.185.61:43997
I20260809 05:28:24.491978 6324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:24.430033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.26.185.1:41669)
0809 05:28:24.459771 (+ 29738us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:24.459792 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:24.460030 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:24.461344 (+ 1314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:24.461361 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:24.462716 (+ 1355us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:24.464340 (+ 1624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:24.464380 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:24.466292 (+ 1912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:24.466298 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:24.469876 (+ 3578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:24.469898 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:24.471588 (+ 1690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:24.471598 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:24.472181 (+ 583us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:24.473400 (+ 1219us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:24.473427 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:24.477884 (+ 4457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:24.483061 (+ 5177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:24.483068 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:24.483072 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:24.485170 (+ 2098us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:24.485745 (+ 575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:24.485750 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:24.485753 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:24.485987 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:24.489682 (+ 3695us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:24.489692 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:24.489968 (+ 276us) client_negotiation.cc:769] Sending connection context
0809 05:28:24.490226 (+ 258us) client_negotiation.cc:240] Negotiation successful
0809 05:28:24.490733 (+ 507us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29586,"mutex_wait_us":735,"spinlock_wait_cycles":89344,"thread_start_us":28293,"threads_started":1}
I20260809 05:28:24.492105 6320 heartbeater.cc:464] Registering TS with master...
I20260809 05:28:24.493314 6318 heartbeater.cc:347] Connected to a master server at 127.26.185.62:39159
I20260809 05:28:24.493489 6318 heartbeater.cc:464] Registering TS with master...
I20260809 05:28:24.493695 6320 heartbeater.cc:511] Master 127.26.185.61:43997 requested a full tablet report, sending...
I20260809 05:28:24.494051 6318 heartbeater.cc:511] Master 127.26.185.62:39159 requested a full tablet report, sending...
I20260809 05:28:24.494249 6129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:24.429196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:60409 (local address 127.26.185.60:40007)
0809 05:28:24.429550 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:24.429560 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:24.456871 (+ 27311us) server_negotiation.cc:407] Connection header received
0809 05:28:24.460494 (+ 3623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:24.460503 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:24.460626 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:24.460714 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:24.464652 (+ 3938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:24.466000 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:24.470575 (+ 4575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:24.471452 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:24.471581 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:24.477648 (+ 6067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:24.477659 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:24.477665 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:24.477727 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:24.482151 (+ 4424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:24.483924 (+ 1773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:24.483935 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:24.483942 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:24.484190 (+ 248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:24.485781 (+ 1591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:24.485788 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:24.485794 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:24.486259 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:24.486379 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:24.493088 (+ 6709us) server_negotiation.cc:299] Negotiation successful
0809 05:28:24.493626 (+ 538us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151}
I20260809 05:28:24.494433 6327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:24.429843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:40007 (local address 127.26.185.1:60409)
0809 05:28:24.456704 (+ 26861us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:24.456728 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:24.460030 (+ 3302us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:24.461344 (+ 1314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:24.461361 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:24.462716 (+ 1355us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:24.464340 (+ 1624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:24.464380 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:24.466292 (+ 1912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:24.466298 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:24.469873 (+ 3575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:24.469891 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:24.471931 (+ 2040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:24.471941 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:24.472219 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:24.473342 (+ 1123us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:24.473375 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:24.477312 (+ 3937us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:24.482391 (+ 5079us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:24.482417 (+ 26us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:24.482446 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:24.483450 (+ 1004us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:24.484407 (+ 957us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:24.484415 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:24.484421 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:24.484715 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:24.491965 (+ 7250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:24.491972 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:24.492194 (+ 222us) client_negotiation.cc:769] Sending connection context
0809 05:28:24.492931 (+ 737us) client_negotiation.cc:240] Negotiation successful
0809 05:28:24.493299 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26708,"mutex_wait_us":774,"spinlock_wait_cycles":88576,"thread_start_us":25105,"threads_started":1}
I20260809 05:28:24.495990 4852 ts_manager.cc:194] Re-registered known tserver with Master: cfd46d97aa5b4db5bcb371b14e8ed36f (127.26.185.1:39559)
I20260809 05:28:24.496136 6317 heartbeater.cc:347] Connected to a master server at 127.26.185.60:40007
I20260809 05:28:24.496264 6317 heartbeater.cc:464] Registering TS with master...
I20260809 05:28:24.496691 6317 heartbeater.cc:511] Master 127.26.185.60:40007 requested a full tablet report, sending...
I20260809 05:28:24.497371 4852 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.185.1@KRBTEST.COM'} at 127.26.185.1:41669
I20260809 05:28:24.499150 5773 ts_manager.cc:194] Registered new tserver with Master: cfd46d97aa5b4db5bcb371b14e8ed36f (127.26.185.1:39559)
I20260809 05:28:24.499476 6055 ts_manager.cc:194] Registered new tserver with Master: cfd46d97aa5b4db5bcb371b14e8ed36f (127.26.185.1:39559)
I20260809 05:28:24.595615 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 5153
I20260809 05:28:24.632037 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:42851
--local_ip_for_outbound_sockets=127.26.185.2
--tserver_master_addrs=127.26.185.62:39159
--webserver_port=35473
--webserver_interface=127.26.185.2
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.2.keytab
--principal=oryx/127.26.185.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:34197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.185.62:39159,127.26.185.61:43997
--tserver_master_addrs=127.26.185.62:39159,127.26.185.61:43997,127.26.185.60:40007 with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:28:25.068002 6335 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:25.068485 6335 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:25.068691 6335 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:25.077093 6335 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:25.077306 6335 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:25.077517 6335 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:28:25.089061 6335 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:34197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.2.keytab
--principal=oryx/127.26.185.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:42851
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=35473
--tserver_master_addrs=127.26.185.62:39159,127.26.185.61:43997,127.26.185.60:40007
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:25.091209 6335 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:25.093009 6335 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:25.111441 6341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:25.112519 6345 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:25.112708 6335 server_base.cc:1034] running on GCE node
W20260809 05:28:25.113010 6343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:25.113926 6335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:25.115293 6335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:25.116559 6335 hybrid_clock.cc:648] HybridClock initialized: now 1786253305116494 us; error 54 us; skew 500 ppm
I20260809 05:28:25.116961 6335 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:28:25 dist-test-slave-h3ft krb5kdc[4786](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253305, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:25.120972 6335 init.cc:377] Logged in from keytab as oryx/127.26.185.2@KRBTEST.COM (short username oryx)
I20260809 05:28:25.122840 6335 webserver.cc:460] Webserver started at http://127.26.185.2:35473/ using document root <none> and password file <none>
I20260809 05:28:25.123776 6335 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:25.123919 6335 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:25.130800 6335 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 05:28:25.134369 6352 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:25.136240 6335 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:28:25.136443 6335 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "5d87438b23414edbb5514c4e881a85fc"
format_stamp: "Formatted at 2026-08-09 05:28:20 on dist-test-slave-h3ft"
server_key: "9a4937b9b7cb6c6b91280ad0ab0eafa2"
server_key_iv: "a07447df96032a10ce4f9c04d1deaed4"
server_key_version: "encryptionkey@0"
I20260809 05:28:25.137646 6335 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:25.180667 6335 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:25.185956 6335 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:25.186375 6335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:25.187723 6335 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:28:25.189456 6335 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:28:25.189599 6335 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:25.189759 6335 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:28:25.189870 6335 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:25.230172 6335 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:42851
I20260809 05:28:25.230299 6526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:42851 every 8 connection(s)
I20260809 05:28:25.232141 6335 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:28:25.238013 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 6335
I20260809 05:28:25.238437 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 5345
Aug 09 05:28:25 dist-test-slave-h3ft krb5kdc[4786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253298, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.185.3@KRBTEST.COM
Aug 09 05:28:25 dist-test-slave-h3ft krb5kdc[4786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253305, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.61@KRBTEST.COM
Aug 09 05:28:25 dist-test-slave-h3ft krb5kdc[4786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253305, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM
Aug 09 05:28:25 dist-test-slave-h3ft krb5kdc[4786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253305, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.60@KRBTEST.COM
I20260809 05:28:25.286516 6539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:25.240652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59260 (local address 127.26.185.3:40925)
0809 05:28:25.261061 (+ 20409us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:25.261071 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:25.261119 (+ 48us) server_negotiation.cc:407] Connection header received
0809 05:28:25.261216 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:25.261227 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:25.261593 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:25.261820 (+ 227us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:25.264542 (+ 2722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:25.266243 (+ 1701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:25.268252 (+ 2009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:25.269291 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:25.276990 (+ 7699us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:25.277320 (+ 330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:25.277332 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:25.277352 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:25.277389 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:25.282274 (+ 4885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:25.283578 (+ 1304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:25.283590 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:25.283594 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:25.283788 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:25.284342 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:25.284347 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:25.284350 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:25.284934 (+ 584us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:25.285297 (+ 363us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:25.285638 (+ 341us) server_negotiation.cc:299] Negotiation successful
0809 05:28:25.285988 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20153,"thread_start_us":19963,"threads_started":1}
I20260809 05:28:25.288872 6531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:25.236259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:47277 (local address 127.26.185.60:40007)
0809 05:28:25.251718 (+ 15459us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:25.251730 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:25.265877 (+ 14147us) server_negotiation.cc:407] Connection header received
0809 05:28:25.266152 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:25.266158 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:25.266260 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:25.266356 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:25.269575 (+ 3219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:25.270800 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:25.273913 (+ 3113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:25.274639 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:25.274751 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:25.279880 (+ 5129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:25.279890 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:25.279897 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:25.279962 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:25.284448 (+ 4486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:25.285397 (+ 949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:25.285403 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:25.285407 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:25.285581 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:25.286891 (+ 1310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:25.286897 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:25.286901 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:25.287442 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:25.287592 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:25.288274 (+ 682us) server_negotiation.cc:299] Negotiation successful
0809 05:28:25.288555 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15208,"thread_start_us":15469,"threads_started":1}
I20260809 05:28:25.288913 5534 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:25.289399 6533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:25.236740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:50181 (local address 127.26.185.62:39159)
0809 05:28:25.263413 (+ 26673us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:25.263421 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:25.263444 (+ 23us) server_negotiation.cc:407] Connection header received
0809 05:28:25.263521 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:25.263527 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:25.263619 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:25.263751 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:25.267533 (+ 3782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:25.268599 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:25.271228 (+ 2629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:25.271807 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:25.271945 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:25.278925 (+ 6980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:25.278933 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:25.278937 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:25.278991 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:25.283387 (+ 4396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:25.285024 (+ 1637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:25.285030 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:25.285035 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:25.285242 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:25.286531 (+ 1289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:25.286546 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:25.286549 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:25.286877 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:25.287100 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:25.288516 (+ 1416us) server_negotiation.cc:299] Negotiation successful
0809 05:28:25.288825 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26518,"thread_start_us":26375,"threads_started":1}
I20260809 05:28:25.290844 6532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:25.236364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:58627 (local address 127.26.185.61:43997)
0809 05:28:25.263519 (+ 27155us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:25.263526 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:25.263559 (+ 33us) server_negotiation.cc:407] Connection header received
0809 05:28:25.263626 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:25.263631 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:25.263730 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:25.263847 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:25.266992 (+ 3145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:25.268225 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:25.271606 (+ 3381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:25.272324 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:25.272472 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:25.278435 (+ 5963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:25.278442 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:25.278449 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:25.278505 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:25.283647 (+ 5142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:25.285511 (+ 1864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:25.285517 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:25.285520 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:25.285715 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:25.286223 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:25.286229 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:25.286233 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:25.287441 (+ 1208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:25.287602 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:25.289868 (+ 2266us) server_negotiation.cc:299] Negotiation successful
0809 05:28:25.290272 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27011,"thread_start_us":26895,"threads_started":1}
I20260809 05:28:25.296383 6536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:25.237130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:43997 (local address 127.26.185.2:58627)
0809 05:28:25.258499 (+ 21369us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:25.258582 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:25.261693 (+ 3111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:25.264154 (+ 2461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:25.264165 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:25.265712 (+ 1547us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:25.266697 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:25.266755 (+ 58us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:25.268430 (+ 1675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:25.268436 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:25.271402 (+ 2966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:25.271419 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:25.272792 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:25.272800 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:25.273004 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:25.273686 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:25.273728 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:25.277965 (+ 4237us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:25.283826 (+ 5861us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:25.283837 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:25.283864 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:25.284882 (+ 1018us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:25.285871 (+ 989us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:25.285879 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:25.285885 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:25.286075 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:25.287680 (+ 1605us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:25.287685 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:25.287929 (+ 244us) client_negotiation.cc:769] Sending connection context
0809 05:28:25.288095 (+ 166us) client_negotiation.cc:240] Negotiation successful
0809 05:28:25.294458 (+ 6363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20911,"mutex_wait_us":5917,"spinlock_wait_cycles":104832,"thread_start_us":28086,"threads_started":1}
I20260809 05:28:25.296455 6534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:25.237337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.26.185.2:50181)
0809 05:28:25.262483 (+ 25146us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:25.262502 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:25.262612 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:25.264166 (+ 1554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:25.264174 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:25.265371 (+ 1197us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:25.267323 (+ 1952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:25.267339 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:25.268752 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:25.268757 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:25.271069 (+ 2312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:25.271086 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:25.272118 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:25.272126 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:25.272597 (+ 471us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:25.273814 (+ 1217us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:25.273857 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:25.278677 (+ 4820us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:25.283839 (+ 5162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:25.283842 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:25.283864 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:25.284882 (+ 1018us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:25.286254 (+ 1372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:25.286258 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:25.286261 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:25.286415 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:25.287067 (+ 652us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:25.287076 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:25.287684 (+ 608us) client_negotiation.cc:769] Sending connection context
0809 05:28:25.288095 (+ 411us) client_negotiation.cc:240] Negotiation successful
0809 05:28:25.294318 (+ 6223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25033,"mutex_wait_us":99,"spinlock_wait_cycles":2688,"thread_start_us":25353,"threads_started":1}
I20260809 05:28:25.296417 6535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:25.237692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:40007 (local address 127.26.185.2:47277)
0809 05:28:25.265736 (+ 28044us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:25.265761 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:25.265990 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:25.266609 (+ 619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:25.266613 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:25.268754 (+ 2141us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:25.269332 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:25.269352 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:25.271044 (+ 1692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:25.271050 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:25.273693 (+ 2643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:25.273712 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:25.275179 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:25.275188 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:25.275452 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:25.276135 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:25.276159 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:25.279510 (+ 3351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:25.284626 (+ 5116us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:25.284631 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:25.284635 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:25.285229 (+ 594us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:25.285729 (+ 500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:25.285735 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:25.285738 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:25.286082 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:25.287677 (+ 1595us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:25.287680 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:25.287942 (+ 262us) client_negotiation.cc:769] Sending connection context
0809 05:28:25.289206 (+ 1264us) client_negotiation.cc:240] Negotiation successful
0809 05:28:25.294668 (+ 5462us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27903,"mutex_wait_us":5024,"spinlock_wait_cycles":40576,"thread_start_us":21457,"threads_started":1}
I20260809 05:28:25.298520 6527 heartbeater.cc:347] Connected to a master server at 127.26.185.60:40007
I20260809 05:28:25.298532 6528 heartbeater.cc:347] Connected to a master server at 127.26.185.62:39159
I20260809 05:28:25.298595 6529 heartbeater.cc:347] Connected to a master server at 127.26.185.61:43997
I20260809 05:28:25.299054 6529 heartbeater.cc:464] Registering TS with master...
I20260809 05:28:25.300319 6529 heartbeater.cc:511] Master 127.26.185.61:43997 requested a full tablet report, sending...
I20260809 05:28:25.301692 6527 heartbeater.cc:464] Registering TS with master...
I20260809 05:28:25.302314 6527 heartbeater.cc:511] Master 127.26.185.60:40007 requested a full tablet report, sending...
I20260809 05:28:25.302686 6528 heartbeater.cc:464] Registering TS with master...
I20260809 05:28:25.303211 6528 heartbeater.cc:511] Master 127.26.185.62:39159 requested a full tablet report, sending...
I20260809 05:28:25.303220 5773 ts_manager.cc:194] Registered new tserver with Master: 5d87438b23414edbb5514c4e881a85fc (127.26.185.2:42851)
I20260809 05:28:25.303884 6055 ts_manager.cc:194] Registered new tserver with Master: 5d87438b23414edbb5514c4e881a85fc (127.26.185.2:42851)
I20260809 05:28:25.304605 4852 ts_manager.cc:194] Re-registered known tserver with Master: 5d87438b23414edbb5514c4e881a85fc (127.26.185.2:42851)
I20260809 05:28:25.306130 4852 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.185.2@KRBTEST.COM'} at 127.26.185.2:50181
I20260809 05:28:25.394407 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 5345
I20260809 05:28:25.425357 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:40925
--local_ip_for_outbound_sockets=127.26.185.3
--tserver_master_addrs=127.26.185.62:39159
--webserver_port=42427
--webserver_interface=127.26.185.3
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.3.keytab
--principal=oryx/127.26.185.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:34197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.185.62:39159,127.26.185.61:43997
--tserver_master_addrs=127.26.185.62:39159,127.26.185.61:43997,127.26.185.60:40007 with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:28:25.503147 6318 heartbeater.cc:503] Master 127.26.185.62:39159 was elected leader, sending a full tablet report...
W20260809 05:28:25.898909 6543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:25.899550 6543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:25.899777 6543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:25.908533 6543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:25.908674 6543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:25.908808 6543 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:28:25.920742 6543 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:34197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.3.keytab
--principal=oryx/127.26.185.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:40925
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=42427
--tserver_master_addrs=127.26.185.62:39159,127.26.185.61:43997,127.26.185.60:40007
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:25.922595 6543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:25.924449 6543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:25.944779 6549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:25.944970 6550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:25.944926 6552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:25.945709 6543 server_base.cc:1034] running on GCE node
I20260809 05:28:25.946852 6543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:25.948534 6543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:25.949798 6543 hybrid_clock.cc:648] HybridClock initialized: now 1786253305949729 us; error 59 us; skew 500 ppm
I20260809 05:28:25.950217 6543 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:28:25 dist-test-slave-h3ft krb5kdc[4786](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253305, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:25.954818 6543 init.cc:377] Logged in from keytab as oryx/127.26.185.3@KRBTEST.COM (short username oryx)
I20260809 05:28:25.956976 6543 webserver.cc:460] Webserver started at http://127.26.185.3:42427/ using document root <none> and password file <none>
I20260809 05:28:25.957907 6543 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:25.958081 6543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:25.965478 6543 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 05:28:25.968880 6559 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:25.970413 6543 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 05:28:25.970618 6543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "a77cb96d675343d8ba6ab3c402df5b6f"
format_stamp: "Formatted at 2026-08-09 05:28:21 on dist-test-slave-h3ft"
server_key: "e51cb9b44cff6c2c66a7d66118505d8d"
server_key_iv: "c9933702416070a9e2953305f2a05599"
server_key_version: "encryptionkey@0"
I20260809 05:28:25.971819 6543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:26.005139 6543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:26.011545 6543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:26.011970 6543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:26.013394 6543 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:28:26.015384 6543 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:28:26.015514 6543 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:26.015663 6543 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:28:26.015776 6543 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:26.055794 6543 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:40925
I20260809 05:28:26.055838 6717 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:40925 every 8 connection(s)
I20260809 05:28:26.057695 6543 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:28:26.066280 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 6543
Aug 09 05:28:26 dist-test-slave-h3ft krb5kdc[4786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253305, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.61@KRBTEST.COM
Aug 09 05:28:26 dist-test-slave-h3ft krb5kdc[4786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253305, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM
Aug 09 05:28:26 dist-test-slave-h3ft krb5kdc[4786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253305, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.60@KRBTEST.COM
I20260809 05:28:26.132300 6728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:26.063059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:34691 (local address 127.26.185.62:39159)
0809 05:28:26.079810 (+ 16751us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:26.079818 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:26.102972 (+ 23154us) server_negotiation.cc:407] Connection header received
0809 05:28:26.103214 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:26.103225 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:26.103384 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:26.103549 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:26.109324 (+ 5775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.110992 (+ 1668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.114173 (+ 3181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.115282 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.115490 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:26.121286 (+ 5796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:26.121298 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:26.121307 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:26.121380 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:26.126692 (+ 5312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:26.128124 (+ 1432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:26.128135 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:26.128141 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:26.128462 (+ 321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:26.129116 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:26.129126 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:26.129131 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:26.129759 (+ 628us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:26.129960 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:26.131268 (+ 1308us) server_negotiation.cc:299] Negotiation successful
0809 05:28:26.131655 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16597,"thread_start_us":16896,"threads_started":1}
I20260809 05:28:26.132342 6731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:26.062455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:43997 (local address 127.26.185.3:53617)
0809 05:28:26.075945 (+ 13490us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:26.076040 (+ 95us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:26.078801 (+ 2761us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:26.080786 (+ 1985us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:26.080809 (+ 23us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:26.082173 (+ 1364us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:26.083658 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:26.083702 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.086907 (+ 3205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.086917 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:26.090138 (+ 3221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:26.090166 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.092403 (+ 2237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.092414 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:26.092851 (+ 437us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:26.094767 (+ 1916us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:26.094820 (+ 53us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:26.104042 (+ 9222us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:26.122881 (+ 18839us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:26.122914 (+ 33us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:26.122959 (+ 45us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:26.124068 (+ 1109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:26.125696 (+ 1628us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:26.125705 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:26.125712 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:26.126214 (+ 502us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:26.127284 (+ 1070us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:26.127301 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:26.128249 (+ 948us) client_negotiation.cc:769] Sending connection context
0809 05:28:26.128734 (+ 485us) client_negotiation.cc:240] Negotiation successful
0809 05:28:26.129845 (+ 1111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13058,"thread_start_us":39252,"threads_started":1}
I20260809 05:28:26.134336 6723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:26.064302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.26.185.3:34691)
0809 05:28:26.102788 (+ 38486us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:26.102816 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:26.103037 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:26.104918 (+ 1881us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:26.104927 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:26.106932 (+ 2005us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:26.107389 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:26.107406 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.111430 (+ 4024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.111439 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:26.113807 (+ 2368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:26.113837 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.115584 (+ 1747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.115594 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:26.115882 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:26.116808 (+ 926us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:26.116845 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:26.120874 (+ 4029us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:26.126940 (+ 6066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:26.126949 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:26.126956 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:26.127839 (+ 883us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:26.128650 (+ 811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:26.128659 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:26.128665 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:26.128931 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:26.130075 (+ 1144us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:26.130083 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:26.130322 (+ 239us) client_negotiation.cc:769] Sending connection context
0809 05:28:26.130499 (+ 177us) client_negotiation.cc:240] Negotiation successful
0809 05:28:26.130969 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38320,"thread_start_us":11121,"threads_started":1}
I20260809 05:28:26.136546 6730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:26.063471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:53617 (local address 127.26.185.61:43997)
0809 05:28:26.079674 (+ 16203us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:26.079681 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:26.079709 (+ 28us) server_negotiation.cc:407] Connection header received
0809 05:28:26.079797 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:26.079804 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:26.079921 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:26.080066 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:26.084739 (+ 4673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.086527 (+ 1788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.090484 (+ 3957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.091583 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.091742 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:26.106142 (+ 14400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:26.106153 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:26.106159 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:26.106235 (+ 76us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:26.120877 (+ 14642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:26.125187 (+ 4310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:26.125197 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:26.125204 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:26.125490 (+ 286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:26.126465 (+ 975us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:26.126474 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:26.126480 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:26.127070 (+ 590us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:26.133539 (+ 6469us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:26.133787 (+ 248us) server_negotiation.cc:299] Negotiation successful
0809 05:28:26.135845 (+ 2058us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16003,"thread_start_us":16345,"threads_started":1}
I20260809 05:28:26.137269 6719 heartbeater.cc:347] Connected to a master server at 127.26.185.62:39159
I20260809 05:28:26.137861 6719 heartbeater.cc:464] Registering TS with master...
I20260809 05:28:26.138020 6720 heartbeater.cc:347] Connected to a master server at 127.26.185.61:43997
I20260809 05:28:26.138218 6720 heartbeater.cc:464] Registering TS with master...
I20260809 05:28:26.140296 6719 heartbeater.cc:511] Master 127.26.185.62:39159 requested a full tablet report, sending...
I20260809 05:28:26.142334 6720 heartbeater.cc:511] Master 127.26.185.61:43997 requested a full tablet report, sending...
I20260809 05:28:26.144991 5773 ts_manager.cc:194] Registered new tserver with Master: a77cb96d675343d8ba6ab3c402df5b6f (127.26.185.3:40925)
I20260809 05:28:26.145218 4852 ts_manager.cc:194] Re-registered known tserver with Master: a77cb96d675343d8ba6ab3c402df5b6f (127.26.185.3:40925)
I20260809 05:28:26.147403 4852 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.185.3@KRBTEST.COM'} at 127.26.185.3:34691
I20260809 05:28:26.161051 6725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:26.062455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:40007 (local address 127.26.185.3:47243)
0809 05:28:26.094314 (+ 31859us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:26.094346 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:26.099228 (+ 4882us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:26.101122 (+ 1894us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:26.101131 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:26.104669 (+ 3538us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:26.106191 (+ 1522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:26.106213 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.109219 (+ 3006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.109228 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:26.114428 (+ 5200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:26.114443 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.119205 (+ 4762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.119212 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:26.119422 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:26.120205 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:26.120229 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:26.138978 (+ 18749us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:26.149756 (+ 10778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:26.149765 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:26.149773 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:26.150728 (+ 955us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:26.158286 (+ 7558us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:26.158294 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:26.158301 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:26.158584 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:26.159573 (+ 989us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:26.159579 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:26.159810 (+ 231us) client_negotiation.cc:769] Sending connection context
0809 05:28:26.159996 (+ 186us) client_negotiation.cc:240] Negotiation successful
0809 05:28:26.160503 (+ 507us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31579,"mutex_wait_us":430,"thread_start_us":30977,"threads_started":1}
I20260809 05:28:26.162289 6722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:26.061681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:47243 (local address 127.26.185.60:40007)
0809 05:28:26.071627 (+ 9946us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:26.071633 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:26.094484 (+ 22851us) server_negotiation.cc:407] Connection header received
0809 05:28:26.100370 (+ 5886us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:26.100382 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:26.100566 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:26.100700 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:26.107169 (+ 6469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.108973 (+ 1804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.115904 (+ 6931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.117423 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.117624 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:26.139916 (+ 22292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:26.139929 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:26.139938 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:26.140021 (+ 83us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:26.149414 (+ 9393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:26.155296 (+ 5882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:26.155308 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:26.155315 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:26.155636 (+ 321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:26.158743 (+ 3107us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:26.158753 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:26.158756 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:26.159282 (+ 526us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:26.159461 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:26.160824 (+ 1363us) server_negotiation.cc:299] Negotiation successful
0809 05:28:26.161797 (+ 973us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9780,"thread_start_us":9564,"threads_started":1}
I20260809 05:28:26.163748 6718 heartbeater.cc:347] Connected to a master server at 127.26.185.60:40007
I20260809 05:28:26.163962 6718 heartbeater.cc:464] Registering TS with master...
I20260809 05:28:26.164563 6718 heartbeater.cc:511] Master 127.26.185.60:40007 requested a full tablet report, sending...
I20260809 05:28:26.166186 6055 ts_manager.cc:194] Registered new tserver with Master: a77cb96d675343d8ba6ab3c402df5b6f (127.26.185.3:40925)
I20260809 05:28:26.176096 6740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:26.081828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39902 (local address 127.26.185.61:43997)
0809 05:28:26.098558 (+ 16730us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:26.098568 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:26.105079 (+ 6511us) server_negotiation.cc:407] Connection header received
0809 05:28:26.151114 (+ 46035us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:26.151125 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:26.151277 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:26.151401 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:26.155677 (+ 4276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.157473 (+ 1796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.161085 (+ 3612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.161834 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.161974 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:26.168363 (+ 6389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:26.168371 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:26.168380 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:26.168458 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:26.171984 (+ 3526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:26.173012 (+ 1028us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:26.173018 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:26.173021 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:26.173189 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:26.174226 (+ 1037us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:26.174237 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:26.174239 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:26.174715 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:26.175013 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:26.175396 (+ 383us) server_negotiation.cc:299] Negotiation successful
0809 05:28:26.175678 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16540,"thread_start_us":16345,"threads_started":1}
I20260809 05:28:26.177775 6741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:26.082377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49886 (local address 127.26.185.62:39159)
0809 05:28:26.097927 (+ 15550us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:26.097939 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:26.157632 (+ 59693us) server_negotiation.cc:407] Connection header received
0809 05:28:26.157719 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:26.157724 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:26.157831 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:26.158001 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:26.160672 (+ 2671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.161718 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.163890 (+ 2172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.164600 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.164734 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:26.168920 (+ 4186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:26.168931 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:26.168939 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:26.168998 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:26.173192 (+ 4194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:26.173999 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:26.174009 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:26.174016 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:26.174225 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:26.174665 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:26.174669 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:26.174673 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:26.175152 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:26.175441 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:26.176967 (+ 1526us) server_negotiation.cc:299] Negotiation successful
0809 05:28:26.177279 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15259,"thread_start_us":16009,"threads_started":1}
I20260809 05:28:26.179541 6743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:26.088350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57410 (local address 127.26.185.60:40007)
0809 05:28:26.104481 (+ 16131us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:26.104491 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:26.157934 (+ 53443us) server_negotiation.cc:407] Connection header received
0809 05:28:26.158924 (+ 990us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:26.158929 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:26.159061 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:26.159152 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:26.164002 (+ 4850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.165022 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.167388 (+ 2366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.167912 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.168152 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:26.171824 (+ 3672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:26.171833 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:26.171842 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:26.171893 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:26.175724 (+ 3831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:26.176684 (+ 960us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:26.176691 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:26.176694 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:26.176923 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:26.177465 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:26.177473 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:26.177477 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:26.177878 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:26.178163 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:26.178750 (+ 587us) server_negotiation.cc:299] Negotiation successful
0809 05:28:26.179062 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15887,"thread_start_us":15647,"threads_started":1}
I20260809 05:28:26.183532 4852 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49886:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 05:28:26.191987 4852 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 05:28:26.229780 6759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:26.217984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55096 (local address 127.26.185.2:42851)
0809 05:28:26.218643 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:26.218659 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:26.219964 (+ 1305us) server_negotiation.cc:407] Connection header received
0809 05:28:26.220181 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:26.220196 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:26.220609 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:26.220903 (+ 294us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:28:26.222785 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.224529 (+ 1744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.226607 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.228307 (+ 1700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.228446 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:26.228792 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:26.228995 (+ 203us) server_negotiation.cc:299] Negotiation successful
0809 05:28:26.229207 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":456,"thread_start_us":329,"threads_started":1}
I20260809 05:28:26.230669 6761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:26.218121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59264 (local address 127.26.185.3:40925)
0809 05:28:26.219271 (+ 1150us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:26.219283 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:26.220770 (+ 1487us) server_negotiation.cc:407] Connection header received
0809 05:28:26.220905 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:26.220913 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:26.221172 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:26.221444 (+ 272us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:28:26.223124 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.224813 (+ 1689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.227604 (+ 2791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.229189 (+ 1585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.229290 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:26.229520 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:26.230102 (+ 582us) server_negotiation.cc:299] Negotiation successful
0809 05:28:26.230286 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":917,"thread_start_us":661,"threads_started":1}
I20260809 05:28:26.231551 6757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:26.217676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:40925 (local address 127.0.0.1:59264)
0809 05:28:26.220455 (+ 2779us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:26.220468 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:26.220624 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:26.221438 (+ 814us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:26.221446 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:26.221486 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:28:26.222796 (+ 1310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:26.222809 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.225014 (+ 2205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.225022 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:26.227403 (+ 2381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:26.227426 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.229708 (+ 2282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.229714 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:26.229886 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:26.229917 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 05:28:26.230913 (+ 996us) client_negotiation.cc:240] Negotiation successful
0809 05:28:26.231102 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2674,"thread_start_us":1838,"threads_started":1}
I20260809 05:28:26.231575 6758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:26.217482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:42851 (local address 127.0.0.1:55096)
0809 05:28:26.219826 (+ 2344us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:26.219843 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:26.219982 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:26.221850 (+ 1868us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:26.221862 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:26.221900 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:28:26.222544 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:26.222563 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.224700 (+ 2137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.224706 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:26.226428 (+ 1722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:26.226441 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.228534 (+ 2093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.228540 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:26.228729 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:26.228769 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 05:28:26.228879 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 05:28:26.229036 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2193,"mutex_wait_us":32,"thread_start_us":2736,"threads_started":1}
I20260809 05:28:26.232703 6762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:26.220632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:39559 (local address 127.0.0.1:35294)
0809 05:28:26.223082 (+ 2450us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:26.223102 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:26.223233 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:26.224177 (+ 944us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:26.224182 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:26.224206 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:28:26.224675 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:26.224690 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.226670 (+ 1980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.226676 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:26.229111 (+ 2435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:26.229132 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.231886 (+ 2754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.231896 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:26.232109 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:26.232141 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 05:28:26.232225 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 05:28:26.232352 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2275,"thread_start_us":2102,"threads_started":1}
I20260809 05:28:26.233640 6763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:26.221012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35294 (local address 127.26.185.1:39559)
0809 05:28:26.222554 (+ 1542us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:26.222562 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:26.223366 (+ 804us) server_negotiation.cc:407] Connection header received
0809 05:28:26.223504 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:26.223512 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:26.223736 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:26.223925 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:28:26.224855 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.226493 (+ 1638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.229319 (+ 2826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.231357 (+ 2038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.231528 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:26.233020 (+ 1492us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:26.233104 (+ 84us) server_negotiation.cc:299] Negotiation successful
0809 05:28:26.233317 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1328,"thread_start_us":1186,"threads_started":1}
I20260809 05:28:26.236879 6627 tablet_service.cc:1467] Processing CreateTablet for tablet ea81f6098f654495a2dc0b41e4e93d53 (DEFAULT_TABLE table=test-table [id=1bda70c88b2d4947a30eb9a5f0af45fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:28:26.237628 6222 tablet_service.cc:1467] Processing CreateTablet for tablet ea81f6098f654495a2dc0b41e4e93d53 (DEFAULT_TABLE table=test-table [id=1bda70c88b2d4947a30eb9a5f0af45fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:28:26.237633 6422 tablet_service.cc:1467] Processing CreateTablet for tablet ea81f6098f654495a2dc0b41e4e93d53 (DEFAULT_TABLE table=test-table [id=1bda70c88b2d4947a30eb9a5f0af45fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:28:26.238794 6627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea81f6098f654495a2dc0b41e4e93d53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:26.239115 6422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea81f6098f654495a2dc0b41e4e93d53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:26.239444 6222 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea81f6098f654495a2dc0b41e4e93d53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:26.254962 6764 tablet_bootstrap.cc:492] T ea81f6098f654495a2dc0b41e4e93d53 P cfd46d97aa5b4db5bcb371b14e8ed36f: Bootstrap starting.
I20260809 05:28:26.260517 6764 tablet_bootstrap.cc:654] T ea81f6098f654495a2dc0b41e4e93d53 P cfd46d97aa5b4db5bcb371b14e8ed36f: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:26.261765 6766 tablet_bootstrap.cc:492] T ea81f6098f654495a2dc0b41e4e93d53 P a77cb96d675343d8ba6ab3c402df5b6f: Bootstrap starting.
I20260809 05:28:26.262354 6764 log.cc:824] T ea81f6098f654495a2dc0b41e4e93d53 P cfd46d97aa5b4db5bcb371b14e8ed36f: Log is configured to *not* fsync() on all Append() calls
I20260809 05:28:26.262945 6765 tablet_bootstrap.cc:492] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc: Bootstrap starting.
I20260809 05:28:26.267565 6766 tablet_bootstrap.cc:654] T ea81f6098f654495a2dc0b41e4e93d53 P a77cb96d675343d8ba6ab3c402df5b6f: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:26.268106 6765 tablet_bootstrap.cc:654] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:26.269030 6766 log.cc:824] T ea81f6098f654495a2dc0b41e4e93d53 P a77cb96d675343d8ba6ab3c402df5b6f: Log is configured to *not* fsync() on all Append() calls
I20260809 05:28:26.269529 6765 log.cc:824] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc: Log is configured to *not* fsync() on all Append() calls
I20260809 05:28:26.271149 6764 tablet_bootstrap.cc:492] T ea81f6098f654495a2dc0b41e4e93d53 P cfd46d97aa5b4db5bcb371b14e8ed36f: No bootstrap required, opened a new log
I20260809 05:28:26.271598 6764 ts_tablet_manager.cc:1397] T ea81f6098f654495a2dc0b41e4e93d53 P cfd46d97aa5b4db5bcb371b14e8ed36f: Time spent bootstrapping tablet: real 0.017s user 0.008s sys 0.006s
I20260809 05:28:26.274260 6765 tablet_bootstrap.cc:492] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc: No bootstrap required, opened a new log
I20260809 05:28:26.274516 6766 tablet_bootstrap.cc:492] T ea81f6098f654495a2dc0b41e4e93d53 P a77cb96d675343d8ba6ab3c402df5b6f: No bootstrap required, opened a new log
I20260809 05:28:26.274626 6765 ts_tablet_manager.cc:1397] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.006s
I20260809 05:28:26.274807 6766 ts_tablet_manager.cc:1397] T ea81f6098f654495a2dc0b41e4e93d53 P a77cb96d675343d8ba6ab3c402df5b6f: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.005s
I20260809 05:28:26.283641 6765 raft_consensus.cc:348] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d87438b23414edbb5514c4e881a85fc" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42851 } } peers { permanent_uuid: "a77cb96d675343d8ba6ab3c402df5b6f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40925 } } peers { permanent_uuid: "cfd46d97aa5b4db5bcb371b14e8ed36f" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39559 } }
I20260809 05:28:26.283654 6764 raft_consensus.cc:348] T ea81f6098f654495a2dc0b41e4e93d53 P cfd46d97aa5b4db5bcb371b14e8ed36f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d87438b23414edbb5514c4e881a85fc" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42851 } } peers { permanent_uuid: "a77cb96d675343d8ba6ab3c402df5b6f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40925 } } peers { permanent_uuid: "cfd46d97aa5b4db5bcb371b14e8ed36f" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39559 } }
I20260809 05:28:26.284152 6765 raft_consensus.cc:374] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:26.284148 6764 raft_consensus.cc:374] T ea81f6098f654495a2dc0b41e4e93d53 P cfd46d97aa5b4db5bcb371b14e8ed36f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:26.284256 6764 raft_consensus.cc:729] T ea81f6098f654495a2dc0b41e4e93d53 P cfd46d97aa5b4db5bcb371b14e8ed36f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfd46d97aa5b4db5bcb371b14e8ed36f, State: Initialized, Role: FOLLOWER
I20260809 05:28:26.284256 6765 raft_consensus.cc:729] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d87438b23414edbb5514c4e881a85fc, State: Initialized, Role: FOLLOWER
I20260809 05:28:26.285108 6764 consensus_queue.cc:260] T ea81f6098f654495a2dc0b41e4e93d53 P cfd46d97aa5b4db5bcb371b14e8ed36f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d87438b23414edbb5514c4e881a85fc" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42851 } } peers { permanent_uuid: "a77cb96d675343d8ba6ab3c402df5b6f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40925 } } peers { permanent_uuid: "cfd46d97aa5b4db5bcb371b14e8ed36f" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39559 } }
I20260809 05:28:26.285383 6765 consensus_queue.cc:260] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d87438b23414edbb5514c4e881a85fc" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42851 } } peers { permanent_uuid: "a77cb96d675343d8ba6ab3c402df5b6f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40925 } } peers { permanent_uuid: "cfd46d97aa5b4db5bcb371b14e8ed36f" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39559 } }
I20260809 05:28:26.286260 6766 raft_consensus.cc:348] T ea81f6098f654495a2dc0b41e4e93d53 P a77cb96d675343d8ba6ab3c402df5b6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d87438b23414edbb5514c4e881a85fc" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42851 } } peers { permanent_uuid: "a77cb96d675343d8ba6ab3c402df5b6f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40925 } } peers { permanent_uuid: "cfd46d97aa5b4db5bcb371b14e8ed36f" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39559 } }
I20260809 05:28:26.286742 6766 raft_consensus.cc:374] T ea81f6098f654495a2dc0b41e4e93d53 P a77cb96d675343d8ba6ab3c402df5b6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:26.286841 6766 raft_consensus.cc:729] T ea81f6098f654495a2dc0b41e4e93d53 P a77cb96d675343d8ba6ab3c402df5b6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a77cb96d675343d8ba6ab3c402df5b6f, State: Initialized, Role: FOLLOWER
I20260809 05:28:26.287544 6764 ts_tablet_manager.cc:1428] T ea81f6098f654495a2dc0b41e4e93d53 P cfd46d97aa5b4db5bcb371b14e8ed36f: Time spent starting tablet: real 0.016s user 0.011s sys 0.005s
I20260809 05:28:26.287577 6766 consensus_queue.cc:260] T ea81f6098f654495a2dc0b41e4e93d53 P a77cb96d675343d8ba6ab3c402df5b6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d87438b23414edbb5514c4e881a85fc" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42851 } } peers { permanent_uuid: "a77cb96d675343d8ba6ab3c402df5b6f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40925 } } peers { permanent_uuid: "cfd46d97aa5b4db5bcb371b14e8ed36f" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39559 } }
I20260809 05:28:26.295946 6765 ts_tablet_manager.cc:1428] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc: Time spent starting tablet: real 0.021s user 0.013s sys 0.005s
I20260809 05:28:26.296118 6528 heartbeater.cc:503] Master 127.26.185.62:39159 was elected leader, sending a full tablet report...
I20260809 05:28:26.297827 6719 heartbeater.cc:503] Master 127.26.185.62:39159 was elected leader, sending a full tablet report...
I20260809 05:28:26.298545 6766 ts_tablet_manager.cc:1428] T ea81f6098f654495a2dc0b41e4e93d53 P a77cb96d675343d8ba6ab3c402df5b6f: Time spent starting tablet: real 0.024s user 0.017s sys 0.008s
W20260809 05:28:26.317580 6721 tablet.cc:2369] T ea81f6098f654495a2dc0b41e4e93d53 P a77cb96d675343d8ba6ab3c402df5b6f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:28:26.357203 6775 raft_consensus.cc:482] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:28:26.357628 6775 raft_consensus.cc:504] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d87438b23414edbb5514c4e881a85fc" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42851 } } peers { permanent_uuid: "a77cb96d675343d8ba6ab3c402df5b6f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40925 } } peers { permanent_uuid: "cfd46d97aa5b4db5bcb371b14e8ed36f" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39559 } }
I20260809 05:28:26.360018 6775 leader_election.cc:288] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a77cb96d675343d8ba6ab3c402df5b6f (127.26.185.3:40925), cfd46d97aa5b4db5bcb371b14e8ed36f (127.26.185.1:39559)
I20260809 05:28:26.369346 6761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:26.361160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:33503 (local address 127.26.185.3:40925)
0809 05:28:26.361382 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:26.361388 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:26.362267 (+ 879us) server_negotiation.cc:407] Connection header received
0809 05:28:26.362564 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:26.362570 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:26.362658 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:26.362770 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:28:26.363526 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.364683 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.367283 (+ 2600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.368268 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.368476 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:26.368568 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:26.368883 (+ 315us) server_negotiation.cc:299] Negotiation successful
0809 05:28:26.369029 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 05:28:26.369460 6777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:26.360481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:40925 (local address 127.26.185.2:33503)
0809 05:28:26.362144 (+ 1663us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:26.362162 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:26.362374 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:26.362799 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:26.362804 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:26.362829 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:28:26.363326 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:26.363340 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.364849 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.364861 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:26.367118 (+ 2257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:26.367130 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.368493 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.368499 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:26.368702 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:26.368728 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 05:28:26.368856 (+ 128us) client_negotiation.cc:240] Negotiation successful
0809 05:28:26.369005 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1517,"mutex_wait_us":57,"thread_start_us":917,"threads_started":1}
I20260809 05:28:26.369673 6763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:26.360647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:52629 (local address 127.26.185.1:39559)
0809 05:28:26.360978 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:26.361033 (+ 55us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:26.361943 (+ 910us) server_negotiation.cc:407] Connection header received
0809 05:28:26.362308 (+ 365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:26.362313 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:26.362385 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:26.362499 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:28:26.363225 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.364148 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.366973 (+ 2825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.368368 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.368556 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:26.368636 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:26.369234 (+ 598us) server_negotiation.cc:299] Negotiation successful
0809 05:28:26.369394 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260809 05:28:26.370703 6778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:26.360310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:39559 (local address 127.26.185.2:52629)
0809 05:28:26.361765 (+ 1455us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:26.361795 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:26.362100 (+ 305us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:26.362521 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:26.362525 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:26.362548 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:28:26.362935 (+ 387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:26.362950 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.364297 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.364305 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:26.366784 (+ 2479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:26.366800 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.368843 (+ 2043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.368849 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:26.369040 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:26.369074 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 05:28:26.370154 (+ 1080us) client_negotiation.cc:240] Negotiation successful
0809 05:28:26.370306 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1257,"mutex_wait_us":82,"thread_start_us":1522,"threads_started":1}
I20260809 05:28:26.370642 6653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea81f6098f654495a2dc0b41e4e93d53" candidate_uuid: "5d87438b23414edbb5514c4e881a85fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a77cb96d675343d8ba6ab3c402df5b6f" is_pre_election: true
I20260809 05:28:26.371454 6653 raft_consensus.cc:2454] T ea81f6098f654495a2dc0b41e4e93d53 P a77cb96d675343d8ba6ab3c402df5b6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d87438b23414edbb5514c4e881a85fc in term 0.
I20260809 05:28:26.372002 6255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea81f6098f654495a2dc0b41e4e93d53" candidate_uuid: "5d87438b23414edbb5514c4e881a85fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfd46d97aa5b4db5bcb371b14e8ed36f" is_pre_election: true
I20260809 05:28:26.372249 6354 leader_election.cc:302] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d87438b23414edbb5514c4e881a85fc, a77cb96d675343d8ba6ab3c402df5b6f; no voters:
I20260809 05:28:26.372624 6255 raft_consensus.cc:2454] T ea81f6098f654495a2dc0b41e4e93d53 P cfd46d97aa5b4db5bcb371b14e8ed36f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d87438b23414edbb5514c4e881a85fc in term 0.
I20260809 05:28:26.372761 6775 raft_consensus.cc:2781] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:28:26.372947 6775 raft_consensus.cc:482] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:28:26.373075 6775 raft_consensus.cc:3037] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:26.375805 6775 raft_consensus.cc:504] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d87438b23414edbb5514c4e881a85fc" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42851 } } peers { permanent_uuid: "a77cb96d675343d8ba6ab3c402df5b6f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40925 } } peers { permanent_uuid: "cfd46d97aa5b4db5bcb371b14e8ed36f" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39559 } }
I20260809 05:28:26.376560 6775 leader_election.cc:288] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc [CANDIDATE]: Term 1 election: Requested vote from peers a77cb96d675343d8ba6ab3c402df5b6f (127.26.185.3:40925), cfd46d97aa5b4db5bcb371b14e8ed36f (127.26.185.1:39559)
I20260809 05:28:26.377031 6653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea81f6098f654495a2dc0b41e4e93d53" candidate_uuid: "5d87438b23414edbb5514c4e881a85fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a77cb96d675343d8ba6ab3c402df5b6f"
I20260809 05:28:26.377141 6255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea81f6098f654495a2dc0b41e4e93d53" candidate_uuid: "5d87438b23414edbb5514c4e881a85fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfd46d97aa5b4db5bcb371b14e8ed36f"
I20260809 05:28:26.377291 6653 raft_consensus.cc:3037] T ea81f6098f654495a2dc0b41e4e93d53 P a77cb96d675343d8ba6ab3c402df5b6f [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:26.377345 6255 raft_consensus.cc:3037] T ea81f6098f654495a2dc0b41e4e93d53 P cfd46d97aa5b4db5bcb371b14e8ed36f [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:26.381000 6653 raft_consensus.cc:2454] T ea81f6098f654495a2dc0b41e4e93d53 P a77cb96d675343d8ba6ab3c402df5b6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d87438b23414edbb5514c4e881a85fc in term 1.
I20260809 05:28:26.381026 6255 raft_consensus.cc:2454] T ea81f6098f654495a2dc0b41e4e93d53 P cfd46d97aa5b4db5bcb371b14e8ed36f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d87438b23414edbb5514c4e881a85fc in term 1.
I20260809 05:28:26.381639 6357 leader_election.cc:302] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d87438b23414edbb5514c4e881a85fc, cfd46d97aa5b4db5bcb371b14e8ed36f; no voters:
I20260809 05:28:26.382082 6775 raft_consensus.cc:2781] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:28:26.383484 6775 raft_consensus.cc:686] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc [term 1 LEADER]: Becoming Leader. State: Replica: 5d87438b23414edbb5514c4e881a85fc, State: Running, Role: LEADER
I20260809 05:28:26.384194 6775 consensus_queue.cc:237] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d87438b23414edbb5514c4e881a85fc" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42851 } } peers { permanent_uuid: "a77cb96d675343d8ba6ab3c402df5b6f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40925 } } peers { permanent_uuid: "cfd46d97aa5b4db5bcb371b14e8ed36f" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39559 } }
I20260809 05:28:26.390446 4852 catalog_manager.cc:5495] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d87438b23414edbb5514c4e881a85fc (127.26.185.2). New cstate: current_term: 1 leader_uuid: "5d87438b23414edbb5514c4e881a85fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d87438b23414edbb5514c4e881a85fc" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a77cb96d675343d8ba6ab3c402df5b6f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfd46d97aa5b4db5bcb371b14e8ed36f" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39559 } health_report { overall_health: UNKNOWN } } }
W20260809 05:28:26.430863 6322 tablet.cc:2369] T ea81f6098f654495a2dc0b41e4e93d53 P cfd46d97aa5b4db5bcb371b14e8ed36f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:28:26.436786 6759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:26.430297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55108 (local address 127.26.185.2:42851)
0809 05:28:26.430560 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:26.430567 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:26.430591 (+ 24us) server_negotiation.cc:407] Connection header received
0809 05:28:26.430826 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:26.430831 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:26.430945 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:26.431165 (+ 220us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:28:26.431825 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.432609 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.434103 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.434617 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.434777 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:26.435381 (+ 604us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:28:26.436062 (+ 681us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:28:26.436251 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:26.436374 (+ 123us) server_negotiation.cc:299] Negotiation successful
0809 05:28:26.436473 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 05:28:26.447355 6653 raft_consensus.cc:1261] T ea81f6098f654495a2dc0b41e4e93d53 P a77cb96d675343d8ba6ab3c402df5b6f [term 1 FOLLOWER]: Refusing update from remote peer 5d87438b23414edbb5514c4e881a85fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:28:26.447353 6255 raft_consensus.cc:1261] T ea81f6098f654495a2dc0b41e4e93d53 P cfd46d97aa5b4db5bcb371b14e8ed36f [term 1 FOLLOWER]: Refusing update from remote peer 5d87438b23414edbb5514c4e881a85fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:28:26.448530 6781 consensus_queue.cc:1035] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a77cb96d675343d8ba6ab3c402df5b6f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:28:26.448959 6775 consensus_queue.cc:1035] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfd46d97aa5b4db5bcb371b14e8ed36f" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:28:26.464525 6788 mvcc.cc:205] Tried to move back new op lower bound from 7316493543195779072 to 7316493542954733568. Current Snapshot: MvccSnapshot[applied={T|T < 7316493543195779072}]
I20260809 05:28:26.490099 4852 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49886:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:28:26.490500 4852 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49886:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:28:26.499819 4852 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83e7c63ef60d4983a1c3047ce9b3008c: Sending DeleteTablet for 3 replicas of tablet ea81f6098f654495a2dc0b41e4e93d53
I20260809 05:28:26.501449 6422 tablet_service.cc:1514] Processing DeleteTablet for tablet ea81f6098f654495a2dc0b41e4e93d53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:28:26 UTC) from {username='oryx', principal='oryx/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:55096
I20260809 05:28:26.501682 6627 tablet_service.cc:1514] Processing DeleteTablet for tablet ea81f6098f654495a2dc0b41e4e93d53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:28:26 UTC) from {username='oryx', principal='oryx/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:59264
I20260809 05:28:26.502063 6222 tablet_service.cc:1514] Processing DeleteTablet for tablet ea81f6098f654495a2dc0b41e4e93d53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:28:26 UTC) from {username='oryx', principal='oryx/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:35294
I20260809 05:28:26.507714 6801 tablet_replica.cc:330] T ea81f6098f654495a2dc0b41e4e93d53 P cfd46d97aa5b4db5bcb371b14e8ed36f: stopping tablet replica
I20260809 05:28:26.508428 6801 raft_consensus.cc:2229] T ea81f6098f654495a2dc0b41e4e93d53 P cfd46d97aa5b4db5bcb371b14e8ed36f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:28:26.509212 6801 raft_consensus.cc:2258] T ea81f6098f654495a2dc0b41e4e93d53 P cfd46d97aa5b4db5bcb371b14e8ed36f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:28:26.512748 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 4809
I20260809 05:28:26.523219 4889 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:26.523841 6801 ts_tablet_manager.cc:1905] T ea81f6098f654495a2dc0b41e4e93d53 P cfd46d97aa5b4db5bcb371b14e8ed36f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:28:26.526902 6800 tablet_replica.cc:330] T ea81f6098f654495a2dc0b41e4e93d53 P a77cb96d675343d8ba6ab3c402df5b6f: stopping tablet replica
I20260809 05:28:26.527590 6800 raft_consensus.cc:2229] T ea81f6098f654495a2dc0b41e4e93d53 P a77cb96d675343d8ba6ab3c402df5b6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:28:26.530339 6800 raft_consensus.cc:2258] T ea81f6098f654495a2dc0b41e4e93d53 P a77cb96d675343d8ba6ab3c402df5b6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:28:26.533505 6801 ts_tablet_manager.cc:1918] T ea81f6098f654495a2dc0b41e4e93d53 P cfd46d97aa5b4db5bcb371b14e8ed36f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:28:26.537190 6800 ts_tablet_manager.cc:1905] T ea81f6098f654495a2dc0b41e4e93d53 P a77cb96d675343d8ba6ab3c402df5b6f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:28:26.539294 6801 log.cc:1196] T ea81f6098f654495a2dc0b41e4e93d53 P cfd46d97aa5b4db5bcb371b14e8ed36f: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/wal/wals/ea81f6098f654495a2dc0b41e4e93d53
I20260809 05:28:26.541138 6801 ts_tablet_manager.cc:1939] T ea81f6098f654495a2dc0b41e4e93d53 P cfd46d97aa5b4db5bcb371b14e8ed36f: Deleting consensus metadata
I20260809 05:28:26.541137 6799 tablet_replica.cc:330] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc: stopping tablet replica
I20260809 05:28:26.542732 6799 raft_consensus.cc:2229] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc [term 1 LEADER]: Raft consensus shutting down.
I20260809 05:28:26.545560 6799 raft_consensus.cc:2258] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:28:26.552832 6800 ts_tablet_manager.cc:1918] T ea81f6098f654495a2dc0b41e4e93d53 P a77cb96d675343d8ba6ab3c402df5b6f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:28:26.553112 6800 log.cc:1196] T ea81f6098f654495a2dc0b41e4e93d53 P a77cb96d675343d8ba6ab3c402df5b6f: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/wal/wals/ea81f6098f654495a2dc0b41e4e93d53
I20260809 05:28:26.553804 6800 ts_tablet_manager.cc:1939] T ea81f6098f654495a2dc0b41e4e93d53 P a77cb96d675343d8ba6ab3c402df5b6f: Deleting consensus metadata
I20260809 05:28:26.554303 6740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:26.511621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39908 (local address 127.26.185.61:43997)
0809 05:28:26.511902 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:26.511913 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:26.520955 (+ 9042us) server_negotiation.cc:407] Connection header received
0809 05:28:26.523241 (+ 2286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:26.523248 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:26.523357 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:26.523449 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:26.527927 (+ 4478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.529173 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.532772 (+ 3599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.533582 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.533725 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:26.545108 (+ 11383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:26.545120 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:26.545150 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:26.545243 (+ 93us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:26.550150 (+ 4907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:26.551284 (+ 1134us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:26.551292 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:26.551295 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:26.551488 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:26.551952 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:26.551957 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:26.551960 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:26.552365 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:26.552616 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:26.553507 (+ 891us) server_negotiation.cc:299] Negotiation successful
0809 05:28:26.553826 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260809 05:28:26.560235 6799 ts_tablet_manager.cc:1905] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:28:26.569451 6799 ts_tablet_manager.cc:1918] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:28:26.569710 6799 log.cc:1196] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/wal/wals/ea81f6098f654495a2dc0b41e4e93d53
I20260809 05:28:26.570498 6799 ts_tablet_manager.cc:1939] T ea81f6098f654495a2dc0b41e4e93d53 P 5d87438b23414edbb5514c4e881a85fc: Deleting consensus metadata
I20260809 05:28:26.575670 6743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:26.521759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57422 (local address 127.26.185.60:40007)
0809 05:28:26.522087 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:26.522097 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:26.555913 (+ 33816us) server_negotiation.cc:407] Connection header received
0809 05:28:26.556241 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:26.556248 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:26.556353 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:26.556425 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:26.558669 (+ 2244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.559938 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.562030 (+ 2092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.562720 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.562838 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:26.567390 (+ 4552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:26.567400 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:26.567406 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:26.567463 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:26.571746 (+ 4283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:26.572884 (+ 1138us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:26.572891 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:26.572895 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:26.573096 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:26.573596 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:26.573602 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:26.573606 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:26.574028 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:26.574307 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:26.574952 (+ 645us) server_negotiation.cc:299] Negotiation successful
0809 05:28:26.575280 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 05:28:26.692220 4830 catalog_manager.cc:4841] TS 5d87438b23414edbb5514c4e881a85fc (127.26.185.2:42851): tablet ea81f6098f654495a2dc0b41e4e93d53 (table test-table [id=1bda70c88b2d4947a30eb9a5f0af45fd]) successfully deleted
I20260809 05:28:26.692785 4830 catalog_manager.cc:4841] TS cfd46d97aa5b4db5bcb371b14e8ed36f (127.26.185.1:39559): tablet ea81f6098f654495a2dc0b41e4e93d53 (table test-table [id=1bda70c88b2d4947a30eb9a5f0af45fd]) successfully deleted
I20260809 05:28:26.692986 4827 catalog_manager.cc:4841] TS a77cb96d675343d8ba6ab3c402df5b6f (127.26.185.3:40925): tablet ea81f6098f654495a2dc0b41e4e93d53 (table test-table [id=1bda70c88b2d4947a30eb9a5f0af45fd]) successfully deleted
I20260809 05:28:26.693581 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 4809
I20260809 05:28:26.759444 6740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:26.738971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39924 (local address 127.26.185.61:43997)
0809 05:28:26.739296 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:26.739303 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:26.741360 (+ 2057us) server_negotiation.cc:407] Connection header received
0809 05:28:26.741677 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:26.741684 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:26.741791 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:26.741857 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:26.744448 (+ 2591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.745683 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.747668 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.748162 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.748294 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:26.752239 (+ 3945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:26.752247 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:26.752252 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:26.752311 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:26.756058 (+ 3747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:26.756959 (+ 901us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:26.756966 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:26.756972 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:26.757159 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:26.757585 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:26.757591 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:26.757595 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:26.757998 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:26.758297 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:26.758665 (+ 368us) server_negotiation.cc:299] Negotiation successful
0809 05:28:26.758905 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169}
I20260809 05:28:26.759893 6743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:26.738965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57424 (local address 127.26.185.60:40007)
0809 05:28:26.739273 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:26.739284 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:26.740619 (+ 1335us) server_negotiation.cc:407] Connection header received
0809 05:28:26.741268 (+ 649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:26.741277 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:26.741436 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:26.741563 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:26.744285 (+ 2722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.745281 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.747341 (+ 2060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:26.748028 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:26.748184 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:26.751580 (+ 3396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:26.751587 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:26.751590 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:26.751634 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:26.755553 (+ 3919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:26.756618 (+ 1065us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:26.756627 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:26.756633 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:26.756806 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:26.757712 (+ 906us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:26.757718 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:26.757722 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:26.758169 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:26.758477 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:26.759195 (+ 718us) server_negotiation.cc:299] Negotiation successful
0809 05:28:26.759510 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260809 05:28:27.480167 6815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:27.479221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.26.185.2:60189)
0809 05:28:27.479781 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:27.479927 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":279,"threads_started":1}
W20260809 05:28:27.480701 6528 heartbeater.cc:644] Failed to heartbeat to 127.26.185.62:39159 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
I20260809 05:28:27.484026 6816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:27.482878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.26.185.3:35119)
0809 05:28:27.483479 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:27.483713 (+ 234us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":339,"threads_started":1}
W20260809 05:28:27.484932 6719 heartbeater.cc:644] Failed to heartbeat to 127.26.185.62:39159 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
I20260809 05:28:27.485278 6817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:27.484357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.26.185.1:38777)
0809 05:28:27.484899 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:27.485084 (+ 185us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":280,"threads_started":1}
W20260809 05:28:27.485702 6318 heartbeater.cc:644] Failed to heartbeat to 127.26.185.62:39159 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
I20260809 05:28:27.998771 6819 raft_consensus.cc:482] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83e7c63ef60d4983a1c3047ce9b3008c)
I20260809 05:28:27.999250 6819 raft_consensus.cc:504] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: false } }
I20260809 05:28:28.000168 6821 raft_consensus.cc:482] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83e7c63ef60d4983a1c3047ce9b3008c)
I20260809 05:28:28.000649 6821 raft_consensus.cc:504] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: false } }
I20260809 05:28:28.001509 6819 leader_election.cc:288] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83e7c63ef60d4983a1c3047ce9b3008c (127.26.185.62:39159), e5d610baea574692ab0005f551068264 (127.26.185.60:40007)
I20260809 05:28:28.003419 6823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.001667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.0.0.1:50312)
0809 05:28:28.002716 (+ 1049us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:28.003046 (+ 330us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":825,"threads_started":1}
I20260809 05:28:28.010589 6821 leader_election.cc:288] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83e7c63ef60d4983a1c3047ce9b3008c (127.26.185.62:39159), a14cfca86a9d4fbcb28adef6d82b311e (127.26.185.61:43997)
I20260809 05:28:28.015568 6823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.001744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:40007 (local address 127.0.0.1:57436)
0809 05:28:28.003871 (+ 2127us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:28.003898 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:28.004130 (+ 232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:28.005435 (+ 1305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:28.005445 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:28.005509 (+ 64us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:28:28.005953 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:28.005971 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.008349 (+ 2378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.008359 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:28.011468 (+ 3109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:28.011493 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.014210 (+ 2717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.014220 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:28.014579 (+ 359us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:28.014655 (+ 76us) client_negotiation.cc:769] Sending connection context
0809 05:28:28.014756 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 05:28:28.015026 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1985,"thread_start_us":586,"threads_started":1}
I20260809 05:28:28.017309 6825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.002210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57436 (local address 127.26.185.60:40007)
0809 05:28:28.004874 (+ 2664us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:28.004884 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:28.004912 (+ 28us) server_negotiation.cc:407] Connection header received
0809 05:28:28.005029 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:28.005036 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:28.005151 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:28.006151 (+ 1000us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:28:28.006423 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.008108 (+ 1685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.011813 (+ 3705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.013935 (+ 2122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.016355 (+ 2420us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:28.016547 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:28.016621 (+ 74us) server_negotiation.cc:299] Negotiation successful
0809 05:28:28.016842 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2476,"thread_start_us":2284,"threads_started":1}
I20260809 05:28:28.018771 6828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.005827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.0.0.1:50322)
0809 05:28:28.018165 (+ 12338us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:28.018468 (+ 303us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12198,"thread_start_us":11824,"threads_started":1}
I20260809 05:28:28.018661 6070 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e5d610baea574692ab0005f551068264" is_pre_election: true
W20260809 05:28:28.017974 5749 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
I20260809 05:28:28.019279 6070 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a14cfca86a9d4fbcb28adef6d82b311e in term 1.
W20260809 05:28:28.019755 6029 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
I20260809 05:28:28.020977 5747 leader_election.cc:302] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a14cfca86a9d4fbcb28adef6d82b311e, e5d610baea574692ab0005f551068264; no voters:
I20260809 05:28:28.021494 6819 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 05:28:28.021637 6822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.020884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.0.0.1:50334)
0809 05:28:28.021088 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:28.021328 (+ 240us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260809 05:28:28.021672 6819 raft_consensus.cc:482] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 83e7c63ef60d4983a1c3047ce9b3008c)
I20260809 05:28:28.021795 6819 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [term 1 FOLLOWER]: Advancing to term 2
W20260809 05:28:28.021955 5749 leader_election.cc:334] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 83e7c63ef60d4983a1c3047ce9b3008c (127.26.185.62:39159): Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
I20260809 05:28:28.022490 6826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.021513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.0.0.1:50348)
0809 05:28:28.022006 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:28.022255 (+ 249us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":325}
W20260809 05:28:28.022725 6029 leader_election.cc:334] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 83e7c63ef60d4983a1c3047ce9b3008c (127.26.185.62:39159): Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
I20260809 05:28:28.024991 6819 raft_consensus.cc:504] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: false } }
I20260809 05:28:28.025856 6819 leader_election.cc:288] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [CANDIDATE]: Term 2 election: Requested vote from peers 83e7c63ef60d4983a1c3047ce9b3008c (127.26.185.62:39159), e5d610baea574692ab0005f551068264 (127.26.185.60:40007)
I20260809 05:28:28.026486 6822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.026024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.0.0.1:50358)
0809 05:28:28.026227 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:28.026332 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260809 05:28:28.026396 6070 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e5d610baea574692ab0005f551068264"
I20260809 05:28:28.026652 6070 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [term 1 FOLLOWER]: Advancing to term 2
I20260809 05:28:28.028380 6822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.027875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.0.0.1:50374)
0809 05:28:28.028072 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:28.028172 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260809 05:28:28.028570 6828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.010886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:43997 (local address 127.0.0.1:39938)
0809 05:28:28.019303 (+ 8417us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:28.019333 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:28.019591 (+ 258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:28.021363 (+ 1772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:28.021371 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:28.021405 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:28:28.021696 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:28.021710 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.023730 (+ 2020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.023734 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:28.025109 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:28.025121 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.027597 (+ 2476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.027603 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:28.027838 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:28.027879 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 05:28:28.027995 (+ 116us) client_negotiation.cc:240] Negotiation successful
0809 05:28:28.028187 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8216,"thread_start_us":8007,"threads_started":1}
W20260809 05:28:28.028891 5749 leader_election.cc:334] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 83e7c63ef60d4983a1c3047ce9b3008c (127.26.185.62:39159): Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
I20260809 05:28:28.029264 6833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.020019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39938 (local address 127.26.185.61:43997)
0809 05:28:28.020947 (+ 928us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:28.020958 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:28.020986 (+ 28us) server_negotiation.cc:407] Connection header received
0809 05:28:28.021063 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:28.021068 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:28.021165 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:28.021861 (+ 696us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:28:28.022255 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.023580 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.025293 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.027359 (+ 2066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.027523 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:28.027650 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:28.028061 (+ 411us) server_negotiation.cc:299] Negotiation successful
0809 05:28:28.028196 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":744,"thread_start_us":491,"threads_started":1}
I20260809 05:28:28.029785 6070 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a14cfca86a9d4fbcb28adef6d82b311e in term 2.
I20260809 05:28:28.029975 5783 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e5d610baea574692ab0005f551068264" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" is_pre_election: true
I20260809 05:28:28.030207 5747 leader_election.cc:302] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a14cfca86a9d4fbcb28adef6d82b311e, e5d610baea574692ab0005f551068264; no voters: 83e7c63ef60d4983a1c3047ce9b3008c
I20260809 05:28:28.030494 5783 raft_consensus.cc:2379] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5d610baea574692ab0005f551068264 in current term 2: Already voted for candidate a14cfca86a9d4fbcb28adef6d82b311e in this term.
I20260809 05:28:28.030687 6819 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [term 2 FOLLOWER]: Leader election won for term 2
I20260809 05:28:28.031297 6819 raft_consensus.cc:686] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [term 2 LEADER]: Becoming Leader. State: Replica: a14cfca86a9d4fbcb28adef6d82b311e, State: Running, Role: LEADER
I20260809 05:28:28.031337 6028 leader_election.cc:302] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5d610baea574692ab0005f551068264; no voters: 83e7c63ef60d4983a1c3047ce9b3008c, a14cfca86a9d4fbcb28adef6d82b311e
I20260809 05:28:28.031735 6821 raft_consensus.cc:2726] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 05:28:28.031847 6819 consensus_queue.cc:237] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: false } }
I20260809 05:28:28.033929 6834 sys_catalog.cc:455] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [sys.catalog]: SysCatalogTable state changed. Reason: New leader a14cfca86a9d4fbcb28adef6d82b311e. Latest consensus state: current_term: 2 leader_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: false } } }
I20260809 05:28:28.034386 6834 sys_catalog.cc:458] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [sys.catalog]: This master's current role is: LEADER
I20260809 05:28:28.035377 6836 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:28:28.039597 6836 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:28:28.040501 6836 catalog_manager.cc:1259] Loaded cluster ID: abe19a6dbcdc4b1caa79aefec9852bf5
I20260809 05:28:28.040611 6836 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:28:28.041929 6836 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:28:28.042877 6836 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e: Loaded TSK: 0
I20260809 05:28:28.044078 6836 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 05:28:28.080986 5773 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39924:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 05:28:28.089962 5773 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 05:28:28.095706 6822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.095173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.0.0.1:50390)
0809 05:28:28.095379 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:28.095504 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260809 05:28:28.095963 6070 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [term 2 FOLLOWER]: Refusing update from remote peer a14cfca86a9d4fbcb28adef6d82b311e: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260809 05:28:28.097046 6822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.096510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.0.0.1:50404)
0809 05:28:28.096697 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:28.096806 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260809 05:28:28.097057 6834 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260809 05:28:28.097476 5749 consensus_peers.cc:487] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e -> Peer 83e7c63ef60d4983a1c3047ce9b3008c (127.26.185.62:39159): Couldn't send request to peer 83e7c63ef60d4983a1c3047ce9b3008c. Status: Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 05:28:28.100703 6821 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a14cfca86a9d4fbcb28adef6d82b311e. Latest consensus state: current_term: 2 leader_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: false } } }
I20260809 05:28:28.101018 6821 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 05:28:28.103250 6819 sys_catalog.cc:455] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: false } } }
I20260809 05:28:28.103752 6819 sys_catalog.cc:458] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e [sys.catalog]: This master's current role is: LEADER
I20260809 05:28:28.103869 6821 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "83e7c63ef60d4983a1c3047ce9b3008c" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 39159 } } peers { permanent_uuid: "a14cfca86a9d4fbcb28adef6d82b311e" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43997 } attrs { promote: false } } peers { permanent_uuid: "e5d610baea574692ab0005f551068264" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 40007 } attrs { promote: false } } }
I20260809 05:28:28.104223 6821 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5d610baea574692ab0005f551068264 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 05:28:28.124905 6822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.113967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:40925 (local address 127.0.0.1:59268)
0809 05:28:28.114351 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:28.114380 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:28.114578 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:28.115677 (+ 1099us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:28.115686 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:28.115726 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:28:28.116136 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:28.116152 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.118369 (+ 2217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.118379 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:28.121434 (+ 3055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:28.121462 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.123644 (+ 2182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.123654 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:28.123953 (+ 299us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:28.124022 (+ 69us) client_negotiation.cc:769] Sending connection context
0809 05:28:28.124120 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 05:28:28.124351 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246}
I20260809 05:28:28.126587 6848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.114197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59268 (local address 127.26.185.3:40925)
0809 05:28:28.115171 (+ 974us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:28.115178 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:28.115199 (+ 21us) server_negotiation.cc:407] Connection header received
0809 05:28:28.115288 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:28.115294 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:28.115418 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:28.116308 (+ 890us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:28:28.116592 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.118147 (+ 1555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.121759 (+ 3612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.123277 (+ 1518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.125843 (+ 2566us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:28.125989 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:28.126051 (+ 62us) server_negotiation.cc:299] Negotiation successful
0809 05:28:28.126216 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":821,"thread_start_us":665,"threads_started":1}
I20260809 05:28:28.127656 6627 tablet_service.cc:1467] Processing CreateTablet for tablet 3c13cf4d77da4b8094f102b8aa4969cd (DEFAULT_TABLE table=test-table [id=cf1c3b20bde6423788e992206e8e619b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:28:28.128291 6627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c13cf4d77da4b8094f102b8aa4969cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:28.134632 6823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.114553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:39559 (local address 127.0.0.1:35296)
0809 05:28:28.114978 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:28.115024 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:28.115126 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:28.128130 (+ 13004us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:28.128136 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:28.128164 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:28:28.128411 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:28.128425 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.130145 (+ 1720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.130152 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:28.131981 (+ 1829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:28.131995 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.133696 (+ 1701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.133705 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:28.133926 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:28.133970 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 05:28:28.134048 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 05:28:28.134215 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317}
I20260809 05:28:28.135661 6850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.115219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35296 (local address 127.26.185.1:39559)
0809 05:28:28.127708 (+ 12489us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:28.127716 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:28.127739 (+ 23us) server_negotiation.cc:407] Connection header received
0809 05:28:28.127831 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:28.127839 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:28.127936 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:28.128635 (+ 699us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:28:28.128847 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.129961 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.132196 (+ 2235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.133459 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.134914 (+ 1455us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:28.135073 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:28.135130 (+ 57us) server_negotiation.cc:299] Negotiation successful
0809 05:28:28.135289 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12300,"threads_started":1}
I20260809 05:28:28.137154 6855 tablet_bootstrap.cc:492] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f: Bootstrap starting.
I20260809 05:28:28.138577 6222 tablet_service.cc:1467] Processing CreateTablet for tablet 3c13cf4d77da4b8094f102b8aa4969cd (DEFAULT_TABLE table=test-table [id=cf1c3b20bde6423788e992206e8e619b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:28:28.139210 6222 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c13cf4d77da4b8094f102b8aa4969cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:28.139532 6855 tablet_bootstrap.cc:654] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:28.139679 6822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.115446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:42851 (local address 127.0.0.1:55112)
0809 05:28:28.125481 (+ 10035us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:28.125505 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:28.125641 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:28.129238 (+ 3597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:28.129246 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:28.129283 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:28:28.129639 (+ 356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:28.129655 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.132471 (+ 2816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.132480 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:28.136051 (+ 3571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:28.136075 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.138771 (+ 2696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.138777 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:28.138992 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:28.139068 (+ 76us) client_negotiation.cc:769] Sending connection context
0809 05:28:28.139144 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 05:28:28.139316 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9913,"thread_start_us":22063,"threads_started":1}
I20260809 05:28:28.140650 6854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.115626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55112 (local address 127.26.185.2:42851)
0809 05:28:28.128734 (+ 13108us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:28.128744 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:28.128773 (+ 29us) server_negotiation.cc:407] Connection header received
0809 05:28:28.128885 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:28.128894 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:28.129008 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:28.129824 (+ 816us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:28:28.130123 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.132264 (+ 2141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.136483 (+ 4219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.138574 (+ 2091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.139972 (+ 1398us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:28.140109 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:28.140170 (+ 61us) server_negotiation.cc:299] Negotiation successful
0809 05:28:28.140334 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12928,"thread_start_us":12789,"threads_started":1}
I20260809 05:28:28.144546 6422 tablet_service.cc:1467] Processing CreateTablet for tablet 3c13cf4d77da4b8094f102b8aa4969cd (DEFAULT_TABLE table=test-table [id=cf1c3b20bde6423788e992206e8e619b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:28:28.145047 6855 tablet_bootstrap.cc:492] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f: No bootstrap required, opened a new log
I20260809 05:28:28.145152 6422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c13cf4d77da4b8094f102b8aa4969cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:28.145263 6855 ts_tablet_manager.cc:1397] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260809 05:28:28.146111 6855 raft_consensus.cc:348] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a77cb96d675343d8ba6ab3c402df5b6f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40925 } } peers { permanent_uuid: "cfd46d97aa5b4db5bcb371b14e8ed36f" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39559 } } peers { permanent_uuid: "5d87438b23414edbb5514c4e881a85fc" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42851 } }
I20260809 05:28:28.146432 6855 raft_consensus.cc:374] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:28.146543 6855 raft_consensus.cc:729] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a77cb96d675343d8ba6ab3c402df5b6f, State: Initialized, Role: FOLLOWER
I20260809 05:28:28.146808 6857 tablet_bootstrap.cc:492] T 3c13cf4d77da4b8094f102b8aa4969cd P cfd46d97aa5b4db5bcb371b14e8ed36f: Bootstrap starting.
I20260809 05:28:28.146827 6855 consensus_queue.cc:260] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a77cb96d675343d8ba6ab3c402df5b6f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40925 } } peers { permanent_uuid: "cfd46d97aa5b4db5bcb371b14e8ed36f" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39559 } } peers { permanent_uuid: "5d87438b23414edbb5514c4e881a85fc" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42851 } }
I20260809 05:28:28.147814 6855 ts_tablet_manager.cc:1428] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 05:28:28.149710 6857 tablet_bootstrap.cc:654] T 3c13cf4d77da4b8094f102b8aa4969cd P cfd46d97aa5b4db5bcb371b14e8ed36f: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:28.155439 6863 tablet_bootstrap.cc:492] T 3c13cf4d77da4b8094f102b8aa4969cd P 5d87438b23414edbb5514c4e881a85fc: Bootstrap starting.
I20260809 05:28:28.157441 6863 tablet_bootstrap.cc:654] T 3c13cf4d77da4b8094f102b8aa4969cd P 5d87438b23414edbb5514c4e881a85fc: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:28.157747 6720 heartbeater.cc:503] Master 127.26.185.61:43997 was elected leader, sending a full tablet report...
I20260809 05:28:28.158524 6857 tablet_bootstrap.cc:492] T 3c13cf4d77da4b8094f102b8aa4969cd P cfd46d97aa5b4db5bcb371b14e8ed36f: No bootstrap required, opened a new log
I20260809 05:28:28.158705 6857 ts_tablet_manager.cc:1397] T 3c13cf4d77da4b8094f102b8aa4969cd P cfd46d97aa5b4db5bcb371b14e8ed36f: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.003s
I20260809 05:28:28.159920 6863 tablet_bootstrap.cc:492] T 3c13cf4d77da4b8094f102b8aa4969cd P 5d87438b23414edbb5514c4e881a85fc: No bootstrap required, opened a new log
I20260809 05:28:28.160106 6863 ts_tablet_manager.cc:1397] T 3c13cf4d77da4b8094f102b8aa4969cd P 5d87438b23414edbb5514c4e881a85fc: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 05:28:28.160924 6863 raft_consensus.cc:348] T 3c13cf4d77da4b8094f102b8aa4969cd P 5d87438b23414edbb5514c4e881a85fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a77cb96d675343d8ba6ab3c402df5b6f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40925 } } peers { permanent_uuid: "cfd46d97aa5b4db5bcb371b14e8ed36f" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39559 } } peers { permanent_uuid: "5d87438b23414edbb5514c4e881a85fc" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42851 } }
I20260809 05:28:28.160928 6857 raft_consensus.cc:348] T 3c13cf4d77da4b8094f102b8aa4969cd P cfd46d97aa5b4db5bcb371b14e8ed36f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a77cb96d675343d8ba6ab3c402df5b6f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40925 } } peers { permanent_uuid: "cfd46d97aa5b4db5bcb371b14e8ed36f" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39559 } } peers { permanent_uuid: "5d87438b23414edbb5514c4e881a85fc" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42851 } }
I20260809 05:28:28.161157 6863 raft_consensus.cc:374] T 3c13cf4d77da4b8094f102b8aa4969cd P 5d87438b23414edbb5514c4e881a85fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:28.161171 6857 raft_consensus.cc:374] T 3c13cf4d77da4b8094f102b8aa4969cd P cfd46d97aa5b4db5bcb371b14e8ed36f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:28.161283 6863 raft_consensus.cc:729] T 3c13cf4d77da4b8094f102b8aa4969cd P 5d87438b23414edbb5514c4e881a85fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d87438b23414edbb5514c4e881a85fc, State: Initialized, Role: FOLLOWER
I20260809 05:28:28.161305 6857 raft_consensus.cc:729] T 3c13cf4d77da4b8094f102b8aa4969cd P cfd46d97aa5b4db5bcb371b14e8ed36f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfd46d97aa5b4db5bcb371b14e8ed36f, State: Initialized, Role: FOLLOWER
I20260809 05:28:28.161584 6857 consensus_queue.cc:260] T 3c13cf4d77da4b8094f102b8aa4969cd P cfd46d97aa5b4db5bcb371b14e8ed36f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a77cb96d675343d8ba6ab3c402df5b6f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40925 } } peers { permanent_uuid: "cfd46d97aa5b4db5bcb371b14e8ed36f" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39559 } } peers { permanent_uuid: "5d87438b23414edbb5514c4e881a85fc" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42851 } }
I20260809 05:28:28.161587 6863 consensus_queue.cc:260] T 3c13cf4d77da4b8094f102b8aa4969cd P 5d87438b23414edbb5514c4e881a85fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a77cb96d675343d8ba6ab3c402df5b6f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40925 } } peers { permanent_uuid: "cfd46d97aa5b4db5bcb371b14e8ed36f" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39559 } } peers { permanent_uuid: "5d87438b23414edbb5514c4e881a85fc" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42851 } }
I20260809 05:28:28.165817 6859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.148890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.26.185.3:57687)
0809 05:28:28.165350 (+ 16460us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:28.165518 (+ 168us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16328,"threads_started":1}
I20260809 05:28:28.167565 6859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.166972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.26.185.3:34293)
0809 05:28:28.167214 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:28.167357 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260809 05:28:28.169258 6863 ts_tablet_manager.cc:1428] T 3c13cf4d77da4b8094f102b8aa4969cd P 5d87438b23414edbb5514c4e881a85fc: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260809 05:28:28.169972 6529 heartbeater.cc:503] Master 127.26.185.61:43997 was elected leader, sending a full tablet report...
I20260809 05:28:28.174198 6857 ts_tablet_manager.cc:1428] T 3c13cf4d77da4b8094f102b8aa4969cd P cfd46d97aa5b4db5bcb371b14e8ed36f: Time spent starting tablet: real 0.015s user 0.007s sys 0.004s
I20260809 05:28:28.175503 6870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.162874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.26.185.2:40403)
0809 05:28:28.175061 (+ 12187us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:28.175209 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12006,"threads_started":1}
I20260809 05:28:28.176550 6320 heartbeater.cc:503] Master 127.26.185.61:43997 was elected leader, sending a full tablet report...
I20260809 05:28:28.178151 6870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.177666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.26.185.2:54149)
0809 05:28:28.177897 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:28.177999 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130}
I20260809 05:28:28.179142 6871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.174497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.26.185.1:41571)
0809 05:28:28.178701 (+ 4204us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:28.178850 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4077,"thread_start_us":3907,"threads_started":1}
I20260809 05:28:28.180049 6871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.179732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.26.185.1:34861)
0809 05:28:28.179873 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:28.179943 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260809 05:28:28.242113 6530 tablet.cc:2369] T 3c13cf4d77da4b8094f102b8aa4969cd P 5d87438b23414edbb5514c4e881a85fc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:28:28.266157 6858 raft_consensus.cc:482] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:28:28.266503 6858 raft_consensus.cc:504] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a77cb96d675343d8ba6ab3c402df5b6f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40925 } } peers { permanent_uuid: "cfd46d97aa5b4db5bcb371b14e8ed36f" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39559 } } peers { permanent_uuid: "5d87438b23414edbb5514c4e881a85fc" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42851 } }
I20260809 05:28:28.268666 6858 leader_election.cc:288] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfd46d97aa5b4db5bcb371b14e8ed36f (127.26.185.1:39559), 5d87438b23414edbb5514c4e881a85fc (127.26.185.2:42851)
I20260809 05:28:28.275929 6859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.268958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:39559 (local address 127.26.185.3:46663)
0809 05:28:28.269217 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:28.269264 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:28.269463 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:28.270010 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:28.270018 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:28.270076 (+ 58us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:28:28.270404 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:28.270418 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.271809 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.271814 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:28.273591 (+ 1777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:28.273604 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.274955 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.274961 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:28.275211 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:28.275251 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 05:28:28.275360 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 05:28:28.275529 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"mutex_wait_us":43}
I20260809 05:28:28.275923 6850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.269199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:46663 (local address 127.26.185.1:39559)
0809 05:28:28.269469 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:28.269476 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:28.269502 (+ 26us) server_negotiation.cc:407] Connection header received
0809 05:28:28.269625 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:28.269631 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:28.269741 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:28.269853 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:28:28.270611 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.271666 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.273770 (+ 2104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.274757 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.274899 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:28.274964 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:28.275409 (+ 445us) server_negotiation.cc:299] Negotiation successful
0809 05:28:28.275595 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 05:28:28.276290 6854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.269628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:55873 (local address 127.26.185.2:42851)
0809 05:28:28.269899 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:28.269906 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:28.270284 (+ 378us) server_negotiation.cc:407] Connection header received
0809 05:28:28.270395 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:28.270400 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:28.270518 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:28.270625 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:28:28.271293 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.272258 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.274192 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.275212 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.275414 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:28.275492 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:28.275813 (+ 321us) server_negotiation.cc:299] Negotiation successful
0809 05:28:28.275980 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260809 05:28:28.276610 6872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.269402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:42851 (local address 127.26.185.3:55873)
0809 05:28:28.270147 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:28.270162 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:28.270271 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:28.270676 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:28.270684 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:28.270714 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:28:28.271115 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:28.271132 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.272397 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.272400 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:28.274007 (+ 1607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:28.274022 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.275423 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.275429 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:28.275631 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:28.275662 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 05:28:28.275748 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 05:28:28.275875 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"mutex_wait_us":44,"thread_start_us":423,"threads_started":1}
I20260809 05:28:28.277011 6255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c13cf4d77da4b8094f102b8aa4969cd" candidate_uuid: "a77cb96d675343d8ba6ab3c402df5b6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfd46d97aa5b4db5bcb371b14e8ed36f" is_pre_election: true
I20260809 05:28:28.277367 6255 raft_consensus.cc:2454] T 3c13cf4d77da4b8094f102b8aa4969cd P cfd46d97aa5b4db5bcb371b14e8ed36f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a77cb96d675343d8ba6ab3c402df5b6f in term 0.
I20260809 05:28:28.277709 6455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c13cf4d77da4b8094f102b8aa4969cd" candidate_uuid: "a77cb96d675343d8ba6ab3c402df5b6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d87438b23414edbb5514c4e881a85fc" is_pre_election: true
I20260809 05:28:28.277989 6562 leader_election.cc:302] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a77cb96d675343d8ba6ab3c402df5b6f, cfd46d97aa5b4db5bcb371b14e8ed36f; no voters:
I20260809 05:28:28.278283 6455 raft_consensus.cc:2454] T 3c13cf4d77da4b8094f102b8aa4969cd P 5d87438b23414edbb5514c4e881a85fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a77cb96d675343d8ba6ab3c402df5b6f in term 0.
I20260809 05:28:28.278481 6858 raft_consensus.cc:2781] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:28:28.278610 6858 raft_consensus.cc:482] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:28:28.278723 6858 raft_consensus.cc:3037] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:28.281649 6858 raft_consensus.cc:504] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a77cb96d675343d8ba6ab3c402df5b6f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40925 } } peers { permanent_uuid: "cfd46d97aa5b4db5bcb371b14e8ed36f" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39559 } } peers { permanent_uuid: "5d87438b23414edbb5514c4e881a85fc" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42851 } }
I20260809 05:28:28.282406 6858 leader_election.cc:288] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f [CANDIDATE]: Term 1 election: Requested vote from peers cfd46d97aa5b4db5bcb371b14e8ed36f (127.26.185.1:39559), 5d87438b23414edbb5514c4e881a85fc (127.26.185.2:42851)
I20260809 05:28:28.282961 6255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c13cf4d77da4b8094f102b8aa4969cd" candidate_uuid: "a77cb96d675343d8ba6ab3c402df5b6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfd46d97aa5b4db5bcb371b14e8ed36f"
I20260809 05:28:28.282986 6455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c13cf4d77da4b8094f102b8aa4969cd" candidate_uuid: "a77cb96d675343d8ba6ab3c402df5b6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d87438b23414edbb5514c4e881a85fc"
I20260809 05:28:28.283267 6255 raft_consensus.cc:3037] T 3c13cf4d77da4b8094f102b8aa4969cd P cfd46d97aa5b4db5bcb371b14e8ed36f [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:28.283262 6455 raft_consensus.cc:3037] T 3c13cf4d77da4b8094f102b8aa4969cd P 5d87438b23414edbb5514c4e881a85fc [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:28.285561 6255 raft_consensus.cc:2454] T 3c13cf4d77da4b8094f102b8aa4969cd P cfd46d97aa5b4db5bcb371b14e8ed36f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a77cb96d675343d8ba6ab3c402df5b6f in term 1.
I20260809 05:28:28.285590 6455 raft_consensus.cc:2454] T 3c13cf4d77da4b8094f102b8aa4969cd P 5d87438b23414edbb5514c4e881a85fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a77cb96d675343d8ba6ab3c402df5b6f in term 1.
I20260809 05:28:28.285981 6562 leader_election.cc:302] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a77cb96d675343d8ba6ab3c402df5b6f, cfd46d97aa5b4db5bcb371b14e8ed36f; no voters:
I20260809 05:28:28.286342 6858 raft_consensus.cc:2781] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:28:28.286847 6858 raft_consensus.cc:686] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f [term 1 LEADER]: Becoming Leader. State: Replica: a77cb96d675343d8ba6ab3c402df5b6f, State: Running, Role: LEADER
I20260809 05:28:28.287369 6858 consensus_queue.cc:237] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a77cb96d675343d8ba6ab3c402df5b6f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40925 } } peers { permanent_uuid: "cfd46d97aa5b4db5bcb371b14e8ed36f" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39559 } } peers { permanent_uuid: "5d87438b23414edbb5514c4e881a85fc" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42851 } }
I20260809 05:28:28.287971 6872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.287520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.26.185.3:33935)
0809 05:28:28.287726 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:28.287826 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260809 05:28:28.291765 5772 catalog_manager.cc:5495] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f reported cstate change: term changed from 0 to 1, leader changed from <none> to a77cb96d675343d8ba6ab3c402df5b6f (127.26.185.3). New cstate: current_term: 1 leader_uuid: "a77cb96d675343d8ba6ab3c402df5b6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a77cb96d675343d8ba6ab3c402df5b6f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfd46d97aa5b4db5bcb371b14e8ed36f" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d87438b23414edbb5514c4e881a85fc" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42851 } health_report { overall_health: UNKNOWN } } }
I20260809 05:28:28.334441 6848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.328334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59278 (local address 127.26.185.3:40925)
0809 05:28:28.328584 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:28.328590 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:28.328618 (+ 28us) server_negotiation.cc:407] Connection header received
0809 05:28:28.328795 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:28.328799 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:28.328898 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:28.329089 (+ 191us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:28:28.329465 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.330339 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.331760 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.332223 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.332326 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:28.332745 (+ 419us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:28:28.333488 (+ 743us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:28:28.333685 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:28.333769 (+ 84us) server_negotiation.cc:299] Negotiation successful
0809 05:28:28.333863 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 05:28:28.339674 6255 raft_consensus.cc:1261] T 3c13cf4d77da4b8094f102b8aa4969cd P cfd46d97aa5b4db5bcb371b14e8ed36f [term 1 FOLLOWER]: Refusing update from remote peer a77cb96d675343d8ba6ab3c402df5b6f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:28:28.340351 6455 raft_consensus.cc:1261] T 3c13cf4d77da4b8094f102b8aa4969cd P 5d87438b23414edbb5514c4e881a85fc [term 1 FOLLOWER]: Refusing update from remote peer a77cb96d675343d8ba6ab3c402df5b6f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:28:28.340590 6874 consensus_queue.cc:1035] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfd46d97aa5b4db5bcb371b14e8ed36f" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:28:28.341181 6858 consensus_queue.cc:1035] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d87438b23414edbb5514c4e881a85fc" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:28:28.344158 6871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.343253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.26.185.1:41789)
0809 05:28:28.343750 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:28.343886 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350}
I20260809 05:28:28.344439 6870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.343697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.26.185.2:50125)
0809 05:28:28.344015 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:28.344142 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160}
I20260809 05:28:28.348670 6879 mvcc.cc:205] Tried to move back new op lower bound from 7316493550949904384 to 7316493550749212672. Current Snapshot: MvccSnapshot[applied={T|T < 7316493550949904384}]
I20260809 05:28:28.351969 6872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.351369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.26.185.3:48149)
0809 05:28:28.351635 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:28.351761 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151}
I20260809 05:28:28.354425 6871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.353485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.26.185.1:45453)
0809 05:28:28.354182 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:28.354287 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":578}
I20260809 05:28:28.358765 6870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.358057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.26.185.2:41827)
0809 05:28:28.358350 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:28.358499 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260809 05:28:28.373452 6872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.372811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.26.185.3:33781)
0809 05:28:28.373071 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:28.373189 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
I20260809 05:28:28.373391 5772 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:28:28.373767 5772 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:28:28.381095 5772 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a14cfca86a9d4fbcb28adef6d82b311e: Sending DeleteTablet for 3 replicas of tablet 3c13cf4d77da4b8094f102b8aa4969cd
I20260809 05:28:28.382267 6627 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c13cf4d77da4b8094f102b8aa4969cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:28:28 UTC) from {username='oryx', principal='oryx/127.26.185.61@KRBTEST.COM'} at 127.0.0.1:59268
I20260809 05:28:28.382824 6422 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c13cf4d77da4b8094f102b8aa4969cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:28:28 UTC) from {username='oryx', principal='oryx/127.26.185.61@KRBTEST.COM'} at 127.0.0.1:55112
I20260809 05:28:28.382934 6222 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c13cf4d77da4b8094f102b8aa4969cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:28:28 UTC) from {username='oryx', principal='oryx/127.26.185.61@KRBTEST.COM'} at 127.0.0.1:35296
I20260809 05:28:28.383443 6893 tablet_replica.cc:330] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f: stopping tablet replica
I20260809 05:28:28.383867 6893 raft_consensus.cc:2229] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f [term 1 LEADER]: Raft consensus shutting down.
I20260809 05:28:28.384639 6893 raft_consensus.cc:2258] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:28:28.386206 6893 ts_tablet_manager.cc:1905] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:28:28.386607 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 6008
I20260809 05:28:28.399806 6893 ts_tablet_manager.cc:1918] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:28:28.400046 6893 log.cc:1196] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-2/wal/wals/3c13cf4d77da4b8094f102b8aa4969cd
I20260809 05:28:28.400687 6893 ts_tablet_manager.cc:1939] T 3c13cf4d77da4b8094f102b8aa4969cd P a77cb96d675343d8ba6ab3c402df5b6f: Deleting consensus metadata
I20260809 05:28:28.402558 5743 catalog_manager.cc:4841] TS a77cb96d675343d8ba6ab3c402df5b6f (127.26.185.3:40925): tablet 3c13cf4d77da4b8094f102b8aa4969cd (table test-table [id=cf1c3b20bde6423788e992206e8e619b]) successfully deleted
I20260809 05:28:28.404740 6895 tablet_replica.cc:330] T 3c13cf4d77da4b8094f102b8aa4969cd P cfd46d97aa5b4db5bcb371b14e8ed36f: stopping tablet replica
I20260809 05:28:28.404996 6895 raft_consensus.cc:2229] T 3c13cf4d77da4b8094f102b8aa4969cd P cfd46d97aa5b4db5bcb371b14e8ed36f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:28:28.405440 6895 raft_consensus.cc:2258] T 3c13cf4d77da4b8094f102b8aa4969cd P cfd46d97aa5b4db5bcb371b14e8ed36f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:28:28.406917 6895 ts_tablet_manager.cc:1905] T 3c13cf4d77da4b8094f102b8aa4969cd P cfd46d97aa5b4db5bcb371b14e8ed36f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:28:28.415334 6895 ts_tablet_manager.cc:1918] T 3c13cf4d77da4b8094f102b8aa4969cd P cfd46d97aa5b4db5bcb371b14e8ed36f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:28:28.415537 6895 log.cc:1196] T 3c13cf4d77da4b8094f102b8aa4969cd P cfd46d97aa5b4db5bcb371b14e8ed36f: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-0/wal/wals/3c13cf4d77da4b8094f102b8aa4969cd
I20260809 05:28:28.416077 6895 ts_tablet_manager.cc:1939] T 3c13cf4d77da4b8094f102b8aa4969cd P cfd46d97aa5b4db5bcb371b14e8ed36f: Deleting consensus metadata
I20260809 05:28:28.417732 5748 catalog_manager.cc:4841] TS cfd46d97aa5b4db5bcb371b14e8ed36f (127.26.185.1:39559): tablet 3c13cf4d77da4b8094f102b8aa4969cd (table test-table [id=cf1c3b20bde6423788e992206e8e619b]) successfully deleted
I20260809 05:28:28.418685 6894 tablet_replica.cc:330] T 3c13cf4d77da4b8094f102b8aa4969cd P 5d87438b23414edbb5514c4e881a85fc: stopping tablet replica
I20260809 05:28:28.418985 6894 raft_consensus.cc:2229] T 3c13cf4d77da4b8094f102b8aa4969cd P 5d87438b23414edbb5514c4e881a85fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:28:28.419495 6894 raft_consensus.cc:2258] T 3c13cf4d77da4b8094f102b8aa4969cd P 5d87438b23414edbb5514c4e881a85fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:28:28.420852 6894 ts_tablet_manager.cc:1905] T 3c13cf4d77da4b8094f102b8aa4969cd P 5d87438b23414edbb5514c4e881a85fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:28:28.425189 6850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.391874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35312 (local address 127.26.185.1:39559)
0809 05:28:28.392165 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:28.392175 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:28.403735 (+ 11560us) server_negotiation.cc:407] Connection header received
0809 05:28:28.404647 (+ 912us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:28.404653 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:28.404771 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:28.404888 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:28.407745 (+ 2857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.408944 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.410953 (+ 2009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.411659 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.411772 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:28.416597 (+ 4825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:28.416625 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:28.416654 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:28.416718 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:28.421186 (+ 4468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:28.422170 (+ 984us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:28.422181 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:28.422185 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:28.422374 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:28.422848 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:28.422854 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:28.422857 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:28.423468 (+ 611us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:28.423807 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:28.424463 (+ 656us) server_negotiation.cc:299] Negotiation successful
0809 05:28:28.424758 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260809 05:28:28.427165 6311 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:28.428656 6894 ts_tablet_manager.cc:1918] T 3c13cf4d77da4b8094f102b8aa4969cd P 5d87438b23414edbb5514c4e881a85fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:28:28.428834 6894 log.cc:1196] T 3c13cf4d77da4b8094f102b8aa4969cd P 5d87438b23414edbb5514c4e881a85fc: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786253234117492-27364-0/minicluster-data/ts-1/wal/wals/3c13cf4d77da4b8094f102b8aa4969cd
I20260809 05:28:28.429703 6894 ts_tablet_manager.cc:1939] T 3c13cf4d77da4b8094f102b8aa4969cd P 5d87438b23414edbb5514c4e881a85fc: Deleting consensus metadata
I20260809 05:28:28.431483 5748 catalog_manager.cc:4841] TS 5d87438b23414edbb5514c4e881a85fc (127.26.185.2:42851): tablet 3c13cf4d77da4b8094f102b8aa4969cd (table test-table [id=cf1c3b20bde6423788e992206e8e619b]) successfully deleted
I20260809 05:28:28.531245 6822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.530412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.0.0.1:37298)
0809 05:28:28.530834 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:28.530976 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240}
I20260809 05:28:28.533048 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 6008
I20260809 05:28:28.533237 6822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.532812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.0.0.1:37306)
0809 05:28:28.532980 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:28.533060 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260809 05:28:28.565644 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 6335
I20260809 05:28:28.584053 6854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.566734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57250 (local address 127.26.185.2:42851)
0809 05:28:28.566985 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:28.566992 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:28.567048 (+ 56us) server_negotiation.cc:407] Connection header received
0809 05:28:28.567298 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:28.567306 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:28.567455 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:28.567599 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:28.569280 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.570532 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.572253 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.572963 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.573111 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:28.576164 (+ 3053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:28.576189 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:28.576216 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:28.576268 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:28.580660 (+ 4392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:28.581469 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:28.581481 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:28.581487 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:28.581671 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:28.582106 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:28.582111 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:28.582114 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:28.582642 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:28.582988 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:28.583434 (+ 446us) server_negotiation.cc:299] Negotiation successful
0809 05:28:28.583674 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260809 05:28:28.585032 6518 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:28.728562 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 6335
I20260809 05:28:28.769598 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 6543
I20260809 05:28:28.788719 6848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:28.771195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60964 (local address 127.26.185.3:40925)
0809 05:28:28.771409 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:28.771413 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:28.771433 (+ 20us) server_negotiation.cc:407] Connection header received
0809 05:28:28.771509 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:28.771513 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:28.771610 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:28.771710 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:28.774019 (+ 2309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.774965 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.776961 (+ 1996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:28.777516 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:28.777649 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:28.781448 (+ 3799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:28.781469 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:28.781491 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:28.781533 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:28.785419 (+ 3886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:28.786344 (+ 925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:28.786353 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:28.786355 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:28.786544 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:28.786994 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:28.787035 (+ 41us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:28.787041 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:28.787494 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:28.787791 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:28.788155 (+ 364us) server_negotiation.cc:299] Negotiation successful
0809 05:28:28.788350 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 05:28:28.789669 6710 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:28.953996 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 6543
I20260809 05:28:28.983803 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 5555
I20260809 05:28:28.985234 5814 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:29.132656 6902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:29.131690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:39159 (local address 127.0.0.1:37322)
0809 05:28:29.132256 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:29.132379 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:39159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":319,"threads_started":1}
I20260809 05:28:29.132771 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 5555
I20260809 05:28:29.168437 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 5698
I20260809 05:28:29.169921 6105 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:29.307035 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 5698
2026-08-09T05:28:29Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (12288 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:28:29 dist-test-slave-h3ft krb5kdc[6907](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:28:29 dist-test-slave-h3ft krb5kdc[6907](info): set up 2 sockets
Aug 09 05:28:29 dist-test-slave-h3ft krb5kdc[6907](info): commencing operation
krb5kdc: starting...
W20260809 05:28:30.697440 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.325s user 0.004s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:28:30 dist-test-slave-h3ft krb5kdc[6907](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253310, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:28:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:28:30Z Disabled control of system clock
WARNING: no policy specified for oryx/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.62.keytab.
Entry for principal oryx/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.62.keytab.
I20260809 05:28:31.035735 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:44603
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.62.keytab
--principal=oryx/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:39573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:44603
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:28:31.453644 6926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:31.454061 6926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:31.454269 6926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:31.462303 6926 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:28:31.462435 6926 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 05:28:31.462520 6926 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:31.462630 6926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:31.462715 6926 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:28:31.462842 6926 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:28:31.474082 6926 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:39573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:44603
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.62.keytab
--principal=oryx/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:44603
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:31.475917 6926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:31.477635 6926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:31.492372 6933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:31.492987 6932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:31.492990 6935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:31.493358 6926 server_base.cc:1034] running on GCE node
I20260809 05:28:31.494390 6926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:31.496376 6926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:31.497663 6926 hybrid_clock.cc:648] HybridClock initialized: now 1786253311497572 us; error 65 us; skew 500 ppm
I20260809 05:28:31.498152 6926 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:28:31 dist-test-slave-h3ft krb5kdc[6907](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253311, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:31.501947 6926 init.cc:377] Logged in from keytab as oryx/127.26.185.62@KRBTEST.COM (short username oryx)
I20260809 05:28:31.503711 6926 webserver.cc:460] Webserver started at http://127.26.185.62:38539/ using document root <none> and password file <none>
I20260809 05:28:31.504570 6926 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:31.504666 6926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:31.505003 6926 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:28:31.508818 6926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "6a1b142f671d41ebb0a89f828720f546"
format_stamp: "Formatted at 2026-08-09 05:28:31 on dist-test-slave-h3ft"
server_key: "b059af898e221118e787a252c6575c34"
server_key_iv: "6807afe12ba71fcb66257e6c635c69c1"
server_key_version: "encryptionkey@0"
I20260809 05:28:31.509701 6926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "6a1b142f671d41ebb0a89f828720f546"
format_stamp: "Formatted at 2026-08-09 05:28:31 on dist-test-slave-h3ft"
server_key: "b059af898e221118e787a252c6575c34"
server_key_iv: "6807afe12ba71fcb66257e6c635c69c1"
server_key_version: "encryptionkey@0"
I20260809 05:28:31.515825 6926 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260809 05:28:31.520191 6946 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:31.522008 6926 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260809 05:28:31.522251 6926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "6a1b142f671d41ebb0a89f828720f546"
format_stamp: "Formatted at 2026-08-09 05:28:31 on dist-test-slave-h3ft"
server_key: "b059af898e221118e787a252c6575c34"
server_key_iv: "6807afe12ba71fcb66257e6c635c69c1"
server_key_version: "encryptionkey@0"
I20260809 05:28:31.522553 6926 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:31.542788 6926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:31.548035 6926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:31.548393 6926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:31.573545 6926 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:44603
I20260809 05:28:31.573570 7034 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:44603 every 8 connection(s)
I20260809 05:28:31.575313 6926 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:28:31.580053 7036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:31.580257 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 6926
I20260809 05:28:31.580510 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:28:31.581241 27364 external_mini_cluster.cc:1428] Setting key 9a7385a3a4083b32cdad8878ec7d761e
I20260809 05:28:31.597465 7036 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a1b142f671d41ebb0a89f828720f546: Bootstrap starting.
Aug 09 05:28:31 dist-test-slave-h3ft krb5kdc[6907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253310, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM
I20260809 05:28:31.601825 7036 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a1b142f671d41ebb0a89f828720f546: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:31.603665 7036 log.cc:824] T 00000000000000000000000000000000 P 6a1b142f671d41ebb0a89f828720f546: Log is configured to *not* fsync() on all Append() calls
I20260809 05:28:31.607897 7036 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a1b142f671d41ebb0a89f828720f546: No bootstrap required, opened a new log
I20260809 05:28:31.610653 7039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:31.583745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46256 (local address 127.26.185.62:44603)
0809 05:28:31.584745 (+ 1000us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:31.584764 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:31.584831 (+ 67us) server_negotiation.cc:407] Connection header received
0809 05:28:31.587872 (+ 3041us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:31.587913 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:31.588636 (+ 723us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:31.589236 (+ 600us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:31.590926 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:31.593206 (+ 2280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:31.594679 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:31.595942 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:31.596162 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:31.600983 (+ 4821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:31.600995 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:31.601020 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:31.601078 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:31.605496 (+ 4418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:31.606404 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:31.606413 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:31.606424 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:31.606681 (+ 257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:31.607193 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:31.607198 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:31.607201 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:31.608031 (+ 830us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:31.608349 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:31.608873 (+ 524us) server_negotiation.cc:299] Negotiation successful
0809 05:28:31.609390 (+ 517us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":680,"thread_start_us":411,"threads_started":1}
I20260809 05:28:31.617544 7036 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6a1b142f671d41ebb0a89f828720f546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a1b142f671d41ebb0a89f828720f546" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44603 } }
I20260809 05:28:31.618070 7036 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6a1b142f671d41ebb0a89f828720f546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:31.618202 7036 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6a1b142f671d41ebb0a89f828720f546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a1b142f671d41ebb0a89f828720f546, State: Initialized, Role: FOLLOWER
I20260809 05:28:31.618964 7036 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a1b142f671d41ebb0a89f828720f546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a1b142f671d41ebb0a89f828720f546" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44603 } }
I20260809 05:28:31.619369 7036 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6a1b142f671d41ebb0a89f828720f546 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:28:31.619557 7036 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6a1b142f671d41ebb0a89f828720f546 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:28:31.619771 7036 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6a1b142f671d41ebb0a89f828720f546 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:31.622430 7036 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6a1b142f671d41ebb0a89f828720f546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a1b142f671d41ebb0a89f828720f546" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44603 } }
I20260809 05:28:31.623097 7036 leader_election.cc:302] T 00000000000000000000000000000000 P 6a1b142f671d41ebb0a89f828720f546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a1b142f671d41ebb0a89f828720f546; no voters:
I20260809 05:28:31.623793 7036 leader_election.cc:288] T 00000000000000000000000000000000 P 6a1b142f671d41ebb0a89f828720f546 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:28:31.623914 7042 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6a1b142f671d41ebb0a89f828720f546 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:28:31.624967 7042 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6a1b142f671d41ebb0a89f828720f546 [term 1 LEADER]: Becoming Leader. State: Replica: 6a1b142f671d41ebb0a89f828720f546, State: Running, Role: LEADER
I20260809 05:28:31.625705 7042 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a1b142f671d41ebb0a89f828720f546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a1b142f671d41ebb0a89f828720f546" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44603 } }
I20260809 05:28:31.627229 7036 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6a1b142f671d41ebb0a89f828720f546 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:28:31.629544 7047 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a1b142f671d41ebb0a89f828720f546 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6a1b142f671d41ebb0a89f828720f546" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a1b142f671d41ebb0a89f828720f546" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44603 } } }
I20260809 05:28:31.630016 7047 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a1b142f671d41ebb0a89f828720f546 [sys.catalog]: This master's current role is: LEADER
I20260809 05:28:31.629514 7044 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a1b142f671d41ebb0a89f828720f546 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a1b142f671d41ebb0a89f828720f546. Latest consensus state: current_term: 1 leader_uuid: "6a1b142f671d41ebb0a89f828720f546" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a1b142f671d41ebb0a89f828720f546" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44603 } } }
I20260809 05:28:31.630304 7044 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a1b142f671d41ebb0a89f828720f546 [sys.catalog]: This master's current role is: LEADER
I20260809 05:28:31.631670 7054 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:28:31.637485 7054 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:28:31.648694 7054 catalog_manager.cc:1347] Generated new cluster ID: 54e623f8df814d42865580570354d6a8
I20260809 05:28:31.648859 7054 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:28:31.668901 7054 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:28:31.670488 7054 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:28:31.679385 7054 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6a1b142f671d41ebb0a89f828720f546: Generated new TSK 0
I20260809 05:28:31.680539 7054 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.26.185.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.185.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.185.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.1.keytab.
Entry for principal oryx/127.26.185.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.1.keytab.
I20260809 05:28:31.769737 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:0
--local_ip_for_outbound_sockets=127.26.185.1
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:44603
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.1.keytab
--principal=oryx/127.26.185.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:39573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:28:32.194619 7077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:32.195075 7077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:32.195274 7077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:32.203043 7077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:32.203233 7077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:32.203393 7077 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 05:28:32.203549 7077 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:28:32.214614 7077 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:39573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.1.keytab
--principal=oryx/127.26.185.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.185.62:44603
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:32.216496 7077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:32.218211 7077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:32.234567 7082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:32.234567 7085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:32.234822 7087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:32.235472 7077 server_base.cc:1034] running on GCE node
I20260809 05:28:32.236207 7077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:32.237413 7077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:32.238654 7077 hybrid_clock.cc:648] HybridClock initialized: now 1786253312238575 us; error 55 us; skew 500 ppm
I20260809 05:28:32.239046 7077 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:28:32 dist-test-slave-h3ft krb5kdc[6907](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253312, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:32.242883 7077 init.cc:377] Logged in from keytab as oryx/127.26.185.1@KRBTEST.COM (short username oryx)
I20260809 05:28:32.244645 7077 webserver.cc:460] Webserver started at http://127.26.185.1:33789/ using document root <none> and password file <none>
I20260809 05:28:32.245463 7077 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:32.245569 7077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:32.245985 7077 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:28:32.249394 7077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-0/data/instance:
uuid: "0b2af3406f404ecbbefaa61ac1e7ed28"
format_stamp: "Formatted at 2026-08-09 05:28:32 on dist-test-slave-h3ft"
server_key: "ee60c7d2c40b5845181248446633a0aa"
server_key_iv: "01b1203588c8514a529b3e67a98c5735"
server_key_version: "encryptionkey@0"
I20260809 05:28:32.250248 7077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance:
uuid: "0b2af3406f404ecbbefaa61ac1e7ed28"
format_stamp: "Formatted at 2026-08-09 05:28:32 on dist-test-slave-h3ft"
server_key: "ee60c7d2c40b5845181248446633a0aa"
server_key_iv: "01b1203588c8514a529b3e67a98c5735"
server_key_version: "encryptionkey@0"
I20260809 05:28:32.256280 7077 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260809 05:28:32.260231 7096 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:32.261798 7077 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 05:28:32.262022 7077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "0b2af3406f404ecbbefaa61ac1e7ed28"
format_stamp: "Formatted at 2026-08-09 05:28:32 on dist-test-slave-h3ft"
server_key: "ee60c7d2c40b5845181248446633a0aa"
server_key_iv: "01b1203588c8514a529b3e67a98c5735"
server_key_version: "encryptionkey@0"
I20260809 05:28:32.262315 7077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:32.278064 7077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:32.283161 7077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:32.283493 7077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:32.286749 7077 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:28:32.286893 7077 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:32.287115 7077 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:28:32.287204 7077 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 05:28:32 dist-test-slave-h3ft krb5kdc[6907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253312, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM
I20260809 05:28:32.316596 7109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:32.287803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:53379 (local address 127.26.185.62:44603)
0809 05:28:32.288431 (+ 628us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:32.288436 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:32.289907 (+ 1471us) server_negotiation.cc:407] Connection header received
0809 05:28:32.292285 (+ 2378us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:32.292292 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:32.292406 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:32.292554 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:32.295294 (+ 2740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:32.296751 (+ 1457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:32.299599 (+ 2848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:32.300586 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:32.300797 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:32.306735 (+ 5938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:32.306744 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:32.306751 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:32.306800 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:32.311335 (+ 4535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:32.312699 (+ 1364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:32.312706 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:32.312711 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:32.312973 (+ 262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:32.313822 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:32.313829 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:32.313834 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:32.314223 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:32.314442 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:32.316000 (+ 1558us) server_negotiation.cc:299] Negotiation successful
0809 05:28:32.316280 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":491,"thread_start_us":368,"threads_started":1}
I20260809 05:28:32.319303 7110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:32.288683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44603 (local address 127.26.185.1:53379)
0809 05:28:32.289697 (+ 1014us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:32.289743 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:32.291943 (+ 2200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:32.292893 (+ 950us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:32.292910 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:32.293918 (+ 1008us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:32.294999 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:32.295062 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:32.296970 (+ 1908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:32.296982 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:32.299402 (+ 2420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:32.299418 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:32.300876 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:32.300882 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:32.301108 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:32.302159 (+ 1051us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:32.302206 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:32.306281 (+ 4075us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:32.311551 (+ 5270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:32.311565 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:32.311598 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:32.312515 (+ 917us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:32.313159 (+ 644us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:32.313167 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:32.313172 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:32.313635 (+ 463us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:32.314413 (+ 778us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:32.314428 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:32.315312 (+ 884us) client_negotiation.cc:769] Sending connection context
0809 05:28:32.315814 (+ 502us) client_negotiation.cc:240] Negotiation successful
0809 05:28:32.316769 (+ 955us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":686,"thread_start_us":428,"threads_started":1}
I20260809 05:28:32.348390 7077 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:36911
I20260809 05:28:32.348418 7274 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:36911 every 8 connection(s)
I20260809 05:28:32.348764 7109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:32.330746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:54567 (local address 127.26.185.62:44603)
0809 05:28:32.331059 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:32.331069 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:32.331683 (+ 614us) server_negotiation.cc:407] Connection header received
0809 05:28:32.331925 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:32.331929 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:32.332005 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:32.332116 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:32.333787 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:32.334562 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:32.337312 (+ 2750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:32.338049 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:32.338204 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:32.341281 (+ 3077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:32.341287 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:32.341290 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:32.341327 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:32.345446 (+ 4119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:32.346251 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:32.346259 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:32.346266 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:32.346454 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:32.346971 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:32.346976 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:32.346979 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:32.347362 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:32.347560 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:32.348014 (+ 454us) server_negotiation.cc:299] Negotiation successful
0809 05:28:32.348275 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 05:28:32.349057 7236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:32.330701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44603 (local address 127.26.185.1:54567)
0809 05:28:32.331537 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:32.331565 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:32.331774 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:32.332187 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:32.332194 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:32.333079 (+ 885us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:32.333617 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:32.333636 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:32.334717 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:32.334723 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:32.337122 (+ 2399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:32.337147 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:32.338328 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:32.338337 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:32.338588 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:32.339475 (+ 887us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:32.339511 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:32.341063 (+ 1552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:32.345624 (+ 4561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:32.345631 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:32.345636 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:32.346104 (+ 468us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:32.346613 (+ 509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:32.346621 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:32.346627 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:32.346827 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:32.347493 (+ 666us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:32.347498 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:32.347727 (+ 229us) client_negotiation.cc:769] Sending connection context
0809 05:28:32.347886 (+ 159us) client_negotiation.cc:240] Negotiation successful
0809 05:28:32.348306 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":619,"thread_start_us":435,"threads_started":1}
I20260809 05:28:32.350384 7077 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:28:32.353339 7275 heartbeater.cc:347] Connected to a master server at 127.26.185.62:44603
I20260809 05:28:32.353765 7275 heartbeater.cc:464] Registering TS with master...
I20260809 05:28:32.354789 7275 heartbeater.cc:511] Master 127.26.185.62:44603 requested a full tablet report, sending...
I20260809 05:28:32.357314 6967 ts_manager.cc:194] Registered new tserver with Master: 0b2af3406f404ecbbefaa61ac1e7ed28 (127.26.185.1:36911)
I20260809 05:28:32.358732 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 7077
I20260809 05:28:32.359082 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance
I20260809 05:28:32.359156 6967 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.185.1@KRBTEST.COM'} at 127.26.185.1:53379
I20260809 05:28:32.359908 27364 external_mini_cluster.cc:1428] Setting key c44aedf8ee21726f3238626e4c198a80
WARNING: no policy specified for oryx/127.26.185.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.185.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.185.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.2.keytab.
Entry for principal oryx/127.26.185.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.2.keytab.
I20260809 05:28:32.434855 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:0
--local_ip_for_outbound_sockets=127.26.185.2
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:44603
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.2.keytab
--principal=oryx/127.26.185.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:39573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:28:32.867471 7279 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:32.867940 7279 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:32.868134 7279 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:32.876600 7279 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:32.876753 7279 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:32.876915 7279 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 05:28:32.877065 7279 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:28:32.888569 7279 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:39573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.2.keytab
--principal=oryx/127.26.185.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.185.62:44603
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:32.890535 7279 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:32.892355 7279 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:32.908959 7285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:32.908996 7290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:32.908964 7286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:32.913067 7279 server_base.cc:1034] running on GCE node
I20260809 05:28:32.914055 7279 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:32.915437 7279 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:32.916816 7279 hybrid_clock.cc:648] HybridClock initialized: now 1786253312916734 us; error 59 us; skew 500 ppm
I20260809 05:28:32.917235 7279 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:28:32 dist-test-slave-h3ft krb5kdc[6907](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253312, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:32.921418 7279 init.cc:377] Logged in from keytab as oryx/127.26.185.2@KRBTEST.COM (short username oryx)
I20260809 05:28:32.923643 7279 webserver.cc:460] Webserver started at http://127.26.185.2:40977/ using document root <none> and password file <none>
I20260809 05:28:32.924656 7279 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:32.924813 7279 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:32.925230 7279 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:28:32.929364 7279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-1/data/instance:
uuid: "572338af92db459a8f5280a611127d14"
format_stamp: "Formatted at 2026-08-09 05:28:32 on dist-test-slave-h3ft"
server_key: "ab8291a4af1fd82984ce93818a95536a"
server_key_iv: "ce3992784c72d67c19afe8b0107cbf74"
server_key_version: "encryptionkey@0"
I20260809 05:28:32.930388 7279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance:
uuid: "572338af92db459a8f5280a611127d14"
format_stamp: "Formatted at 2026-08-09 05:28:32 on dist-test-slave-h3ft"
server_key: "ab8291a4af1fd82984ce93818a95536a"
server_key_iv: "ce3992784c72d67c19afe8b0107cbf74"
server_key_version: "encryptionkey@0"
I20260809 05:28:32.937433 7279 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260809 05:28:32.942301 7298 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:32.944235 7279 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260809 05:28:32.944465 7279 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "572338af92db459a8f5280a611127d14"
format_stamp: "Formatted at 2026-08-09 05:28:32 on dist-test-slave-h3ft"
server_key: "ab8291a4af1fd82984ce93818a95536a"
server_key_iv: "ce3992784c72d67c19afe8b0107cbf74"
server_key_version: "encryptionkey@0"
I20260809 05:28:32.944777 7279 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:32.973268 7279 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:32.979113 7279 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:32.979502 7279 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:32.982980 7279 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:28:32.983163 7279 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260809 05:28:32.983366 7279 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:28:32.983454 7279 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 05:28:32 dist-test-slave-h3ft krb5kdc[6907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253312, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM
I20260809 05:28:33.014907 7311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:32.984248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:51937 (local address 127.26.185.62:44603)
0809 05:28:32.984827 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:32.984832 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:32.986427 (+ 1595us) server_negotiation.cc:407] Connection header received
0809 05:28:32.989009 (+ 2582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:32.989021 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:32.989170 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:32.989366 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:32.992431 (+ 3065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:32.993958 (+ 1527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:32.996420 (+ 2462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:32.997067 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:32.997231 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:33.003986 (+ 6755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:33.003995 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:33.004000 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:33.004063 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:33.008675 (+ 4612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:33.010096 (+ 1421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:33.010102 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:33.010105 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:33.010320 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:33.011263 (+ 943us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:33.011269 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:33.011275 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:33.011842 (+ 567us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:33.012047 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:33.013895 (+ 1848us) server_negotiation.cc:299] Negotiation successful
0809 05:28:33.014298 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":446,"thread_start_us":320,"threads_started":1}
I20260809 05:28:33.017302 7312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:32.985168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44603 (local address 127.26.185.2:51937)
0809 05:28:32.986230 (+ 1062us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:32.986278 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:32.988512 (+ 2234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:32.989726 (+ 1214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:32.989738 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:32.990936 (+ 1198us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:32.992119 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:32.992165 (+ 46us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:32.994183 (+ 2018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:32.994190 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:32.996237 (+ 2047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:32.996251 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:32.997689 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:32.997704 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:32.998095 (+ 391us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:32.999339 (+ 1244us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:32.999394 (+ 55us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:33.003570 (+ 4176us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:33.008922 (+ 5352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:33.008939 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:33.008974 (+ 35us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:33.009898 (+ 924us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:33.010490 (+ 592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:33.010497 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:33.010507 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:33.011028 (+ 521us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:33.012163 (+ 1135us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:33.012178 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:33.013158 (+ 980us) client_negotiation.cc:769] Sending connection context
0809 05:28:33.013695 (+ 537us) client_negotiation.cc:240] Negotiation successful
0809 05:28:33.014738 (+ 1043us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":743,"thread_start_us":447,"threads_started":1}
I20260809 05:28:33.040278 7469 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:36731 every 8 connection(s)
I20260809 05:28:33.040309 7279 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:36731
I20260809 05:28:33.042379 7279 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:28:33.045928 7470 heartbeater.cc:347] Connected to a master server at 127.26.185.62:44603
I20260809 05:28:33.046264 7470 heartbeater.cc:464] Registering TS with master...
I20260809 05:28:33.047372 7470 heartbeater.cc:511] Master 127.26.185.62:44603 requested a full tablet report, sending...
I20260809 05:28:33.049302 6967 ts_manager.cc:194] Registered new tserver with Master: 572338af92db459a8f5280a611127d14 (127.26.185.2:36731)
I20260809 05:28:33.050693 6967 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.185.2@KRBTEST.COM'} at 127.26.185.2:51937
I20260809 05:28:33.050881 7311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:33.034562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:46683 (local address 127.26.185.62:44603)
0809 05:28:33.034846 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:33.034854 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:33.035629 (+ 775us) server_negotiation.cc:407] Connection header received
0809 05:28:33.035903 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:33.035910 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:33.036008 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:33.036127 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:33.037353 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:33.038202 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:33.039934 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:33.040724 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:33.040877 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:33.043376 (+ 2499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:33.043386 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:33.043395 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:33.043459 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:33.047584 (+ 4125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:33.048399 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:33.048404 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:33.048406 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:33.048545 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:33.048978 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:33.048985 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:33.048988 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:33.049434 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:33.049646 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:33.050269 (+ 623us) server_negotiation.cc:299] Negotiation successful
0809 05:28:33.050544 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260809 05:28:33.050902 7464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:33.034662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44603 (local address 127.26.185.2:46683)
0809 05:28:33.035470 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:33.035496 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:33.035735 (+ 239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:33.036170 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:33.036175 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:33.036776 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:33.037143 (+ 367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:33.037156 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:33.038355 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:33.038361 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:33.039724 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:33.039749 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:33.040925 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:33.040930 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:33.041104 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:33.041940 (+ 836us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:33.041960 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:33.042978 (+ 1018us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:33.047731 (+ 4753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:33.047735 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:33.047738 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:33.048238 (+ 500us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:33.048685 (+ 447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:33.048690 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:33.048694 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:33.048846 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:33.049574 (+ 728us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:33.049581 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:33.049800 (+ 219us) client_negotiation.cc:769] Sending connection context
0809 05:28:33.049964 (+ 164us) client_negotiation.cc:240] Negotiation successful
0809 05:28:33.050369 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"thread_start_us":451,"threads_started":1}
I20260809 05:28:33.052069 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 7279
I20260809 05:28:33.052317 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance
I20260809 05:28:33.053001 27364 external_mini_cluster.cc:1428] Setting key 81a8bb8e8535f203aee4b9aba0bf7940
WARNING: no policy specified for oryx/127.26.185.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.185.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.185.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.3.keytab.
Entry for principal oryx/127.26.185.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.3.keytab.
I20260809 05:28:33.128233 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:0
--local_ip_for_outbound_sockets=127.26.185.3
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:44603
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.3.keytab
--principal=oryx/127.26.185.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:39573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:28:33.363142 7275 heartbeater.cc:503] Master 127.26.185.62:44603 was elected leader, sending a full tablet report...
W20260809 05:28:33.550021 7475 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:33.550477 7475 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:33.550655 7475 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:33.558799 7475 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:33.558970 7475 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:33.559162 7475 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 05:28:33.559317 7475 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:28:33.571328 7475 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:39573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.3.keytab
--principal=oryx/127.26.185.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.185.62:44603
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:33.573326 7475 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:33.575650 7475 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:33.592120 7483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:33.592063 7482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:33.592044 7485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:33.593041 7475 server_base.cc:1034] running on GCE node
I20260809 05:28:33.593909 7475 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:33.595150 7475 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:33.596385 7475 hybrid_clock.cc:648] HybridClock initialized: now 1786253313596289 us; error 72 us; skew 500 ppm
I20260809 05:28:33.596714 7475 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:28:33 dist-test-slave-h3ft krb5kdc[6907](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253313, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:33.604672 7475 init.cc:377] Logged in from keytab as oryx/127.26.185.3@KRBTEST.COM (short username oryx)
I20260809 05:28:33.606657 7475 webserver.cc:460] Webserver started at http://127.26.185.3:33137/ using document root <none> and password file <none>
I20260809 05:28:33.607641 7475 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:33.607751 7475 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:33.608101 7475 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:28:33.611794 7475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-2/data/instance:
uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5"
format_stamp: "Formatted at 2026-08-09 05:28:33 on dist-test-slave-h3ft"
server_key: "9c7be7904aa2337f388393333e7bdbe3"
server_key_iv: "00df630985345e21657b2d07c2307083"
server_key_version: "encryptionkey@0"
I20260809 05:28:33.612690 7475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance:
uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5"
format_stamp: "Formatted at 2026-08-09 05:28:33 on dist-test-slave-h3ft"
server_key: "9c7be7904aa2337f388393333e7bdbe3"
server_key_iv: "00df630985345e21657b2d07c2307083"
server_key_version: "encryptionkey@0"
I20260809 05:28:33.619174 7475 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260809 05:28:33.624722 7495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:33.626466 7475 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260809 05:28:33.626632 7475 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5"
format_stamp: "Formatted at 2026-08-09 05:28:33 on dist-test-slave-h3ft"
server_key: "9c7be7904aa2337f388393333e7bdbe3"
server_key_iv: "00df630985345e21657b2d07c2307083"
server_key_version: "encryptionkey@0"
I20260809 05:28:33.626861 7475 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:33.646139 7475 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:33.651695 7475 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:33.651983 7475 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:33.655568 7475 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:28:33.655673 7475 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:33.655872 7475 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:28:33.655941 7475 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 05:28:33 dist-test-slave-h3ft krb5kdc[6907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253313, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM
I20260809 05:28:33.689589 7508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:33.656436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:42457 (local address 127.26.185.62:44603)
0809 05:28:33.657113 (+ 677us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:33.657121 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:33.658703 (+ 1582us) server_negotiation.cc:407] Connection header received
0809 05:28:33.662524 (+ 3821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:33.662547 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:33.662688 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:33.662826 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:33.666878 (+ 4052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:33.668477 (+ 1599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:33.670665 (+ 2188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:33.671492 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:33.671655 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:33.678901 (+ 7246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:33.678913 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:33.678922 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:33.679026 (+ 104us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:33.684050 (+ 5024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:33.685522 (+ 1472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:33.685540 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:33.685547 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:33.685793 (+ 246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:33.686592 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:33.686598 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:33.686602 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:33.686990 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:33.687252 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:33.688858 (+ 1606us) server_negotiation.cc:299] Negotiation successful
0809 05:28:33.689202 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":352,"threads_started":1}
I20260809 05:28:33.692209 7509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:33.657287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44603 (local address 127.26.185.3:42457)
0809 05:28:33.658389 (+ 1102us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:33.658476 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:33.661976 (+ 3500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:33.663728 (+ 1752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:33.663751 (+ 23us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:33.664962 (+ 1211us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:33.666485 (+ 1523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:33.666520 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:33.668727 (+ 2207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:33.668732 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:33.670468 (+ 1736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:33.670484 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:33.671791 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:33.671802 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:33.672114 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:33.673135 (+ 1021us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:33.673187 (+ 52us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:33.678411 (+ 5224us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:33.684367 (+ 5956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:33.684423 (+ 56us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:33.684453 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:33.685299 (+ 846us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:33.685998 (+ 699us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:33.686011 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:33.686016 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:33.686395 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:33.687240 (+ 845us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:33.687255 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:33.688121 (+ 866us) client_negotiation.cc:769] Sending connection context
0809 05:28:33.688655 (+ 534us) client_negotiation.cc:240] Negotiation successful
0809 05:28:33.689648 (+ 993us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":728,"thread_start_us":414,"threads_started":1}
I20260809 05:28:33.719523 7607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:33.700610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44603 (local address 127.26.185.3:34379)
0809 05:28:33.701323 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:33.701343 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:33.701572 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:33.701977 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:33.701982 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:33.702609 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:33.702973 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:33.702984 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:33.704651 (+ 1667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:33.704657 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:33.706333 (+ 1676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:33.706360 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:33.707675 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:33.707682 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:33.707916 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:33.708963 (+ 1047us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:33.708989 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:33.710511 (+ 1522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:33.715044 (+ 4533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:33.715052 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:33.715058 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:33.715914 (+ 856us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:33.716531 (+ 617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:33.716538 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:33.716545 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:33.716764 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:33.717595 (+ 831us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:33.717601 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:33.717941 (+ 340us) client_negotiation.cc:769] Sending connection context
0809 05:28:33.718157 (+ 216us) client_negotiation.cc:240] Negotiation successful
0809 05:28:33.718693 (+ 536us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":403,"threads_started":1}
I20260809 05:28:33.719740 7508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:33.700569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:34379 (local address 127.26.185.62:44603)
0809 05:28:33.700795 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:33.700800 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:33.701473 (+ 673us) server_negotiation.cc:407] Connection header received
0809 05:28:33.701731 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:33.701736 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:33.701819 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:33.701993 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:33.703202 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:33.704474 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:33.706538 (+ 2064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:33.707425 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:33.707606 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:33.710791 (+ 3185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:33.710798 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:33.710802 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:33.710845 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:33.714725 (+ 3880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:33.716160 (+ 1435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:33.716165 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:33.716168 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:33.716320 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:33.716907 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:33.716913 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:33.716917 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:33.717449 (+ 532us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:33.717644 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:33.718926 (+ 1282us) server_negotiation.cc:299] Negotiation successful
0809 05:28:33.719308 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 05:28:33.725934 7475 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:34453
I20260809 05:28:33.725971 7667 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:34453 every 8 connection(s)
I20260809 05:28:33.727934 7475 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:28:33.730996 7668 heartbeater.cc:347] Connected to a master server at 127.26.185.62:44603
I20260809 05:28:33.731388 7668 heartbeater.cc:464] Registering TS with master...
I20260809 05:28:33.732340 7668 heartbeater.cc:511] Master 127.26.185.62:44603 requested a full tablet report, sending...
I20260809 05:28:33.734501 6966 ts_manager.cc:194] Registered new tserver with Master: 7a8b9f85fd17482d9ad4b5a6f513e2e5 (127.26.185.3:34453)
I20260809 05:28:33.735738 6966 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.185.3@KRBTEST.COM'} at 127.26.185.3:42457
I20260809 05:28:33.736560 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 7475
I20260809 05:28:33.736838 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance
I20260809 05:28:33.737502 27364 external_mini_cluster.cc:1428] Setting key b651cdba6088195512a9b9191451f1c9
I20260809 05:28:33.741712 27364 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 05:28:33 dist-test-slave-h3ft krb5kdc[6907](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253313, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 05:28:33 dist-test-slave-h3ft krb5kdc[6907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:33 dist-test-slave-h3ft krb5kdc[6907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:34.055615 7470 heartbeater.cc:503] Master 127.26.185.62:44603 was elected leader, sending a full tablet report...
I20260809 05:28:34.739868 7668 heartbeater.cc:503] Master 127.26.185.62:44603 was elected leader, sending a full tablet report...
W20260809 05:28:34.941053 7678 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.125s user 0.005s sys 0.021s
W20260809 05:28:34.942888 7508 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:33.808718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46260 (local address 127.26.185.62:44603)
0809 05:28:33.808953 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:33.808959 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:33.809407 (+ 448us) server_negotiation.cc:407] Connection header received
0809 05:28:33.809637 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:33.809643 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:33.809793 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:33.809928 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:33.811820 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:33.812679 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:33.814250 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:33.814695 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:33.814809 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:34.942457 (+1127648us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46260: BlockingRecv error: recv got EOF from 127.0.0.1:46260 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 09 05:28:34 dist-test-slave-h3ft krb5kdc[6907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253313, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM
I20260809 05:28:34.965138 7508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:34.947643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46270 (local address 127.26.185.62:44603)
0809 05:28:34.947868 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:34.947873 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:34.948388 (+ 515us) server_negotiation.cc:407] Connection header received
0809 05:28:34.948572 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:34.948577 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:34.948668 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:34.948773 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:34.950671 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:34.951649 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:34.953126 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:34.953621 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:34.953748 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:34.958741 (+ 4993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:34.958747 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:34.958751 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:34.958801 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:34.962103 (+ 3302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:34.962940 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:34.962944 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:34.962947 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:34.963174 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:34.963634 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:34.963638 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:34.963640 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:34.963971 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:34.964239 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:34.964524 (+ 285us) server_negotiation.cc:299] Negotiation successful
0809 05:28:34.964749 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 05:28:34.970811 6966 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46270:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 05:28:34.979067 6966 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 05:28:35.015098 7700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:34.997105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49002 (local address 127.26.185.2:36731)
0809 05:28:34.999794 (+ 2689us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:34.999807 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:35.004414 (+ 4607us) server_negotiation.cc:407] Connection header received
0809 05:28:35.004578 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:35.004595 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:35.004959 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:35.005200 (+ 241us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:28:35.006751 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.008080 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.011243 (+ 3163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.012932 (+ 1689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.013073 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:35.013302 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:35.014288 (+ 986us) server_negotiation.cc:299] Negotiation successful
0809 05:28:35.014605 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2425,"thread_start_us":2242,"threads_started":1}
I20260809 05:28:35.015136 7699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:34.997088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:34453 (local address 127.0.0.1:35100)
0809 05:28:35.004549 (+ 7461us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:35.004567 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:35.004685 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:35.006016 (+ 1331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:35.006022 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:35.006066 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:28:35.006986 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:35.007023 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.009079 (+ 2056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.009087 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:35.011482 (+ 2395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:35.011493 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.013478 (+ 1985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.013486 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:35.013826 (+ 340us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:35.013952 (+ 126us) client_negotiation.cc:769] Sending connection context
0809 05:28:35.014147 (+ 195us) client_negotiation.cc:240] Negotiation successful
0809 05:28:35.014509 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7323,"mutex_wait_us":105,"thread_start_us":7166,"threads_started":1}
I20260809 05:28:35.015803 7703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:34.997960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35100 (local address 127.26.185.3:34453)
0809 05:28:35.005305 (+ 7345us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:35.005317 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:35.005347 (+ 30us) server_negotiation.cc:407] Connection header received
0809 05:28:35.005469 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:35.005479 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:35.005747 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:35.006227 (+ 480us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:28:35.007238 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.008901 (+ 1663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.011646 (+ 2745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.012746 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.012923 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:35.013208 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:35.015178 (+ 1970us) server_negotiation.cc:299] Negotiation successful
0809 05:28:35.015410 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7151,"thread_start_us":6959,"threads_started":1}
I20260809 05:28:35.016260 7697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:34.996573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:36731 (local address 127.0.0.1:49002)
0809 05:28:35.003793 (+ 7220us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:35.003843 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:35.004109 (+ 266us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:35.005553 (+ 1444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:35.005562 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:35.005601 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:28:35.006551 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:35.006571 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.008225 (+ 1654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.008234 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:35.011008 (+ 2774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:35.011056 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.013534 (+ 2478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.013542 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:35.013811 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:35.013933 (+ 122us) client_negotiation.cc:769] Sending connection context
0809 05:28:35.015696 (+ 1763us) client_negotiation.cc:240] Negotiation successful
0809 05:28:35.015867 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6854,"mutex_wait_us":136,"thread_start_us":6636,"threads_started":1}
I20260809 05:28:35.017899 7702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:34.996573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:36911 (local address 127.0.0.1:33940)
0809 05:28:35.006728 (+ 10155us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:35.006752 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:35.006986 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:35.008091 (+ 1105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:35.008096 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:35.008120 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:28:35.008985 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:35.009001 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.011124 (+ 2123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.011129 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:35.013263 (+ 2134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:35.013280 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.016949 (+ 3669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.016956 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:35.017211 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:35.017248 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 05:28:35.017354 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 05:28:35.017509 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9997,"mutex_wait_us":733,"thread_start_us":8954,"threads_started":1}
I20260809 05:28:35.017982 7698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:34.996725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33940 (local address 127.26.185.1:36911)
0809 05:28:34.997512 (+ 787us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:34.997540 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:35.006930 (+ 9390us) server_negotiation.cc:407] Connection header received
0809 05:28:35.007311 (+ 381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:35.007323 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:35.007592 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:35.007780 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:28:35.009234 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.010935 (+ 1701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.013490 (+ 2555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.016680 (+ 3190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.016847 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:35.017116 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:35.017442 (+ 326us) server_negotiation.cc:299] Negotiation successful
0809 05:28:35.017651 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":581,"thread_start_us":397,"threads_started":1}
I20260809 05:28:35.021391 7364 tablet_service.cc:1467] Processing CreateTablet for tablet 83abe9facabf4430837a5023e11b771f (DEFAULT_TABLE table=test-table [id=90c2923167e94169b097db81f8ee5916]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:28:35.021379 7565 tablet_service.cc:1467] Processing CreateTablet for tablet 83abe9facabf4430837a5023e11b771f (DEFAULT_TABLE table=test-table [id=90c2923167e94169b097db81f8ee5916]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:28:35.021953 7169 tablet_service.cc:1467] Processing CreateTablet for tablet 83abe9facabf4430837a5023e11b771f (DEFAULT_TABLE table=test-table [id=90c2923167e94169b097db81f8ee5916]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:28:35.023329 7565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83abe9facabf4430837a5023e11b771f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:35.023486 7169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83abe9facabf4430837a5023e11b771f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:35.023490 7364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83abe9facabf4430837a5023e11b771f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:35.046353 7705 tablet_bootstrap.cc:492] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28: Bootstrap starting.
I20260809 05:28:35.047569 7706 tablet_bootstrap.cc:492] T 83abe9facabf4430837a5023e11b771f P 572338af92db459a8f5280a611127d14: Bootstrap starting.
I20260809 05:28:35.048846 7704 tablet_bootstrap.cc:492] T 83abe9facabf4430837a5023e11b771f P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Bootstrap starting.
I20260809 05:28:35.052942 7704 tablet_bootstrap.cc:654] T 83abe9facabf4430837a5023e11b771f P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:35.053161 7705 tablet_bootstrap.cc:654] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:35.053181 7706 tablet_bootstrap.cc:654] T 83abe9facabf4430837a5023e11b771f P 572338af92db459a8f5280a611127d14: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:35.054664 7706 log.cc:824] T 83abe9facabf4430837a5023e11b771f P 572338af92db459a8f5280a611127d14: Log is configured to *not* fsync() on all Append() calls
I20260809 05:28:35.054661 7704 log.cc:824] T 83abe9facabf4430837a5023e11b771f P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Log is configured to *not* fsync() on all Append() calls
I20260809 05:28:35.054663 7705 log.cc:824] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28: Log is configured to *not* fsync() on all Append() calls
I20260809 05:28:35.058614 7705 tablet_bootstrap.cc:492] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28: No bootstrap required, opened a new log
I20260809 05:28:35.058658 7704 tablet_bootstrap.cc:492] T 83abe9facabf4430837a5023e11b771f P 7a8b9f85fd17482d9ad4b5a6f513e2e5: No bootstrap required, opened a new log
I20260809 05:28:35.058707 7706 tablet_bootstrap.cc:492] T 83abe9facabf4430837a5023e11b771f P 572338af92db459a8f5280a611127d14: No bootstrap required, opened a new log
I20260809 05:28:35.059064 7704 ts_tablet_manager.cc:1397] T 83abe9facabf4430837a5023e11b771f P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260809 05:28:35.059124 7705 ts_tablet_manager.cc:1397] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28: Time spent bootstrapping tablet: real 0.013s user 0.010s sys 0.000s
I20260809 05:28:35.059459 7706 ts_tablet_manager.cc:1397] T 83abe9facabf4430837a5023e11b771f P 572338af92db459a8f5280a611127d14: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.003s
I20260809 05:28:35.068879 7705 raft_consensus.cc:348] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:35.069541 7705 raft_consensus.cc:374] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:35.069681 7705 raft_consensus.cc:729] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b2af3406f404ecbbefaa61ac1e7ed28, State: Initialized, Role: FOLLOWER
I20260809 05:28:35.070568 7705 consensus_queue.cc:260] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:35.071473 7704 raft_consensus.cc:348] T 83abe9facabf4430837a5023e11b771f P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:35.071480 7706 raft_consensus.cc:348] T 83abe9facabf4430837a5023e11b771f P 572338af92db459a8f5280a611127d14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:35.072044 7706 raft_consensus.cc:374] T 83abe9facabf4430837a5023e11b771f P 572338af92db459a8f5280a611127d14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:35.072139 7704 raft_consensus.cc:374] T 83abe9facabf4430837a5023e11b771f P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:35.072206 7706 raft_consensus.cc:729] T 83abe9facabf4430837a5023e11b771f P 572338af92db459a8f5280a611127d14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572338af92db459a8f5280a611127d14, State: Initialized, Role: FOLLOWER
I20260809 05:28:35.072343 7704 raft_consensus.cc:729] T 83abe9facabf4430837a5023e11b771f P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a8b9f85fd17482d9ad4b5a6f513e2e5, State: Initialized, Role: FOLLOWER
I20260809 05:28:35.073055 7706 consensus_queue.cc:260] T 83abe9facabf4430837a5023e11b771f P 572338af92db459a8f5280a611127d14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:35.073092 7704 consensus_queue.cc:260] T 83abe9facabf4430837a5023e11b771f P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:35.080554 7705 ts_tablet_manager.cc:1428] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28: Time spent starting tablet: real 0.021s user 0.015s sys 0.004s
I20260809 05:28:35.081525 7712 raft_consensus.cc:482] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:28:35.081832 7712 raft_consensus.cc:504] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:35.085245 7706 ts_tablet_manager.cc:1428] T 83abe9facabf4430837a5023e11b771f P 572338af92db459a8f5280a611127d14: Time spent starting tablet: real 0.026s user 0.007s sys 0.017s
I20260809 05:28:35.087423 7704 ts_tablet_manager.cc:1428] T 83abe9facabf4430837a5023e11b771f P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Time spent starting tablet: real 0.028s user 0.010s sys 0.018s
I20260809 05:28:35.092435 7712 leader_election.cc:288] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572338af92db459a8f5280a611127d14 (127.26.185.2:36731), 7a8b9f85fd17482d9ad4b5a6f513e2e5 (127.26.185.3:34453)
I20260809 05:28:35.099216 7703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:35.090344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:40839 (local address 127.26.185.3:34453)
0809 05:28:35.090626 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:35.090633 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:35.092144 (+ 1511us) server_negotiation.cc:407] Connection header received
0809 05:28:35.092506 (+ 362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:35.092513 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:35.092630 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:35.092702 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:28:35.093756 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.094646 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.097108 (+ 2462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.097987 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.098208 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:35.098314 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:35.098664 (+ 350us) server_negotiation.cc:299] Negotiation successful
0809 05:28:35.098833 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 05:28:35.099203 7700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:35.090864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:51205 (local address 127.26.185.2:36731)
0809 05:28:35.091140 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:35.091148 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:35.092451 (+ 1303us) server_negotiation.cc:407] Connection header received
0809 05:28:35.092748 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:35.092758 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:35.092836 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:35.092908 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:28:35.094051 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.094814 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.097103 (+ 2289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.097973 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.098215 (+ 242us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:35.098306 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:35.098662 (+ 356us) server_negotiation.cc:299] Negotiation successful
0809 05:28:35.098829 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 05:28:35.099360 7717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:35.089766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:36731 (local address 127.26.185.1:51205)
0809 05:28:35.092332 (+ 2566us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:35.092354 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:35.092552 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:35.093136 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:35.093143 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:35.093189 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:28:35.093859 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:35.093869 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.094977 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.094982 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:35.096927 (+ 1945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:35.096942 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.098249 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.098256 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:35.098442 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:35.098516 (+ 74us) client_negotiation.cc:769] Sending connection context
0809 05:28:35.098628 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 05:28:35.098837 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2412,"mutex_wait_us":490,"thread_start_us":1421,"threads_started":1}
I20260809 05:28:35.099606 7719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:35.089768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:34453 (local address 127.26.185.1:40839)
0809 05:28:35.091998 (+ 2230us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:35.092025 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:35.092291 (+ 266us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:35.092951 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:35.092958 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:35.092990 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:28:35.093557 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:35.093576 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.094791 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.094798 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:35.096921 (+ 2123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:35.096938 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.098300 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.098306 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:35.098480 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:35.098508 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 05:28:35.098629 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 05:28:35.098841 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2037,"mutex_wait_us":44,"spinlock_wait_cycles":36608,"thread_start_us":2212,"threads_started":1}
I20260809 05:28:35.100907 7397 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83abe9facabf4430837a5023e11b771f" candidate_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572338af92db459a8f5280a611127d14" is_pre_election: true
I20260809 05:28:35.100951 7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83abe9facabf4430837a5023e11b771f" candidate_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" is_pre_election: true
I20260809 05:28:35.101738 7397 raft_consensus.cc:2454] T 83abe9facabf4430837a5023e11b771f P 572338af92db459a8f5280a611127d14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b2af3406f404ecbbefaa61ac1e7ed28 in term 0.
I20260809 05:28:35.101727 7594 raft_consensus.cc:2454] T 83abe9facabf4430837a5023e11b771f P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b2af3406f404ecbbefaa61ac1e7ed28 in term 0.
I20260809 05:28:35.102650 7098 leader_election.cc:302] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b2af3406f404ecbbefaa61ac1e7ed28, 572338af92db459a8f5280a611127d14; no voters:
I20260809 05:28:35.103278 7712 raft_consensus.cc:2781] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:28:35.103497 7712 raft_consensus.cc:482] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:28:35.103631 7712 raft_consensus.cc:3037] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Advancing to term 1
W20260809 05:28:35.104993 7276 tablet.cc:2369] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:28:35.107208 7712 raft_consensus.cc:504] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:35.108060 7712 leader_election.cc:288] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28 [CANDIDATE]: Term 1 election: Requested vote from peers 572338af92db459a8f5280a611127d14 (127.26.185.2:36731), 7a8b9f85fd17482d9ad4b5a6f513e2e5 (127.26.185.3:34453)
I20260809 05:28:35.108747 7397 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83abe9facabf4430837a5023e11b771f" candidate_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572338af92db459a8f5280a611127d14"
I20260809 05:28:35.108806 7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83abe9facabf4430837a5023e11b771f" candidate_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5"
I20260809 05:28:35.109028 7397 raft_consensus.cc:3037] T 83abe9facabf4430837a5023e11b771f P 572338af92db459a8f5280a611127d14 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:35.109069 7594 raft_consensus.cc:3037] T 83abe9facabf4430837a5023e11b771f P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:35.111836 7594 raft_consensus.cc:2454] T 83abe9facabf4430837a5023e11b771f P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b2af3406f404ecbbefaa61ac1e7ed28 in term 1.
I20260809 05:28:35.111847 7397 raft_consensus.cc:2454] T 83abe9facabf4430837a5023e11b771f P 572338af92db459a8f5280a611127d14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b2af3406f404ecbbefaa61ac1e7ed28 in term 1.
I20260809 05:28:35.112483 7099 leader_election.cc:302] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0b2af3406f404ecbbefaa61ac1e7ed28, 572338af92db459a8f5280a611127d14, 7a8b9f85fd17482d9ad4b5a6f513e2e5; no voters:
I20260809 05:28:35.112893 7712 raft_consensus.cc:2781] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:28:35.113083 7712 raft_consensus.cc:686] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 1 LEADER]: Becoming Leader. State: Replica: 0b2af3406f404ecbbefaa61ac1e7ed28, State: Running, Role: LEADER
I20260809 05:28:35.113665 7712 consensus_queue.cc:237] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:35.119982 6965 catalog_manager.cc:5495] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b2af3406f404ecbbefaa61ac1e7ed28 (127.26.185.1). New cstate: current_term: 1 leader_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } health_report { overall_health: UNKNOWN } } }
I20260809 05:28:35.146867 7698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:35.140482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33944 (local address 127.26.185.1:36911)
0809 05:28:35.140757 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:35.140765 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:35.140876 (+ 111us) server_negotiation.cc:407] Connection header received
0809 05:28:35.141213 (+ 337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:35.141218 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:35.141330 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:35.141523 (+ 193us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:28:35.141939 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.142738 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.144256 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.144737 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.144892 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:35.145400 (+ 508us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:28:35.146170 (+ 770us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:28:35.146363 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:35.146418 (+ 55us) server_negotiation.cc:299] Negotiation successful
0809 05:28:35.146530 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 05:28:35.157995 7594 raft_consensus.cc:1261] T 83abe9facabf4430837a5023e11b771f P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 1 FOLLOWER]: Refusing update from remote peer 0b2af3406f404ecbbefaa61ac1e7ed28: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:28:35.157995 7397 raft_consensus.cc:1261] T 83abe9facabf4430837a5023e11b771f P 572338af92db459a8f5280a611127d14 [term 1 FOLLOWER]: Refusing update from remote peer 0b2af3406f404ecbbefaa61ac1e7ed28: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:28:35.159291 7712 consensus_queue.cc:1035] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:28:35.159674 7711 consensus_queue.cc:1035] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:28:35.174396 7724 mvcc.cc:205] Tried to move back new op lower bound from 7316493578873450496 to 7316493578710126592. Current Snapshot: MvccSnapshot[applied={T|T < 7316493578873450496}]
I20260809 05:28:35.199146 6967 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46270:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:28:35.199540 6967 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46270:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:28:35.205066 6967 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6a1b142f671d41ebb0a89f828720f546: Sending DeleteTablet for 3 replicas of tablet 83abe9facabf4430837a5023e11b771f
I20260809 05:28:35.206712 7169 tablet_service.cc:1514] Processing DeleteTablet for tablet 83abe9facabf4430837a5023e11b771f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:28:35 UTC) from {username='oryx', principal='oryx/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:33940
I20260809 05:28:35.206727 7364 tablet_service.cc:1514] Processing DeleteTablet for tablet 83abe9facabf4430837a5023e11b771f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:28:35 UTC) from {username='oryx', principal='oryx/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:49002
I20260809 05:28:35.207335 7565 tablet_service.cc:1514] Processing DeleteTablet for tablet 83abe9facabf4430837a5023e11b771f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:28:35 UTC) from {username='oryx', principal='oryx/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:35100
I20260809 05:28:35.214537 6967 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46270:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 05:28:35.217378 6967 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 05:28:35.225749 7744 tablet_replica.cc:330] T 83abe9facabf4430837a5023e11b771f P 572338af92db459a8f5280a611127d14: stopping tablet replica
I20260809 05:28:35.226821 7745 tablet_replica.cc:330] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28: stopping tablet replica
I20260809 05:28:35.228220 7747 tablet_replica.cc:330] T 83abe9facabf4430837a5023e11b771f P 7a8b9f85fd17482d9ad4b5a6f513e2e5: stopping tablet replica
I20260809 05:28:35.228471 7745 raft_consensus.cc:2229] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 1 LEADER]: Raft consensus shutting down.
I20260809 05:28:35.229059 7747 raft_consensus.cc:2229] T 83abe9facabf4430837a5023e11b771f P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:28:35.229501 7745 raft_consensus.cc:2258] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:28:35.229939 7747 raft_consensus.cc:2258] T 83abe9facabf4430837a5023e11b771f P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:28:35.230430 7744 raft_consensus.cc:2229] T 83abe9facabf4430837a5023e11b771f P 572338af92db459a8f5280a611127d14 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:28:35.232671 7168 tablet_service.cc:1467] Processing CreateTablet for tablet 2e6a74734a3249c1bd6f246c48c841a6 (DEFAULT_TABLE table=test-table [id=8f82dbc24ec44a79b42ae262d227f280]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:28:35.232439 7565 tablet_service.cc:1467] Processing CreateTablet for tablet 2e6a74734a3249c1bd6f246c48c841a6 (DEFAULT_TABLE table=test-table [id=8f82dbc24ec44a79b42ae262d227f280]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:28:35.233050 7744 raft_consensus.cc:2258] T 83abe9facabf4430837a5023e11b771f P 572338af92db459a8f5280a611127d14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:28:35.233345 7168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e6a74734a3249c1bd6f246c48c841a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:35.233781 7565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e6a74734a3249c1bd6f246c48c841a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:35.235999 7745 ts_tablet_manager.cc:1905] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:28:35.238602 7364 tablet_service.cc:1467] Processing CreateTablet for tablet 2e6a74734a3249c1bd6f246c48c841a6 (DEFAULT_TABLE table=test-table [id=8f82dbc24ec44a79b42ae262d227f280]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:28:35.238855 7744 ts_tablet_manager.cc:1905] T 83abe9facabf4430837a5023e11b771f P 572338af92db459a8f5280a611127d14: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:28:35.239360 7364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e6a74734a3249c1bd6f246c48c841a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:35.244558 7704 tablet_bootstrap.cc:492] T 2e6a74734a3249c1bd6f246c48c841a6 P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Bootstrap starting.
I20260809 05:28:35.246851 7704 tablet_bootstrap.cc:654] T 2e6a74734a3249c1bd6f246c48c841a6 P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:35.251124 7745 ts_tablet_manager.cc:1918] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:28:35.251426 7745 log.cc:1196] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-0/wal/wals/83abe9facabf4430837a5023e11b771f
I20260809 05:28:35.252120 7745 ts_tablet_manager.cc:1939] T 83abe9facabf4430837a5023e11b771f P 0b2af3406f404ecbbefaa61ac1e7ed28: Deleting consensus metadata
I20260809 05:28:35.252497 7744 ts_tablet_manager.cc:1918] T 83abe9facabf4430837a5023e11b771f P 572338af92db459a8f5280a611127d14: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:28:35.252750 7744 log.cc:1196] T 83abe9facabf4430837a5023e11b771f P 572338af92db459a8f5280a611127d14: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-1/wal/wals/83abe9facabf4430837a5023e11b771f
I20260809 05:28:35.253412 7744 ts_tablet_manager.cc:1939] T 83abe9facabf4430837a5023e11b771f P 572338af92db459a8f5280a611127d14: Deleting consensus metadata
I20260809 05:28:35.254894 6947 catalog_manager.cc:4841] TS 0b2af3406f404ecbbefaa61ac1e7ed28 (127.26.185.1:36911): tablet 83abe9facabf4430837a5023e11b771f (table test-table [id=90c2923167e94169b097db81f8ee5916]) successfully deleted
I20260809 05:28:35.255622 6948 catalog_manager.cc:4841] TS 572338af92db459a8f5280a611127d14 (127.26.185.2:36731): tablet 83abe9facabf4430837a5023e11b771f (table test-table [id=90c2923167e94169b097db81f8ee5916]) successfully deleted
I20260809 05:28:35.258126 7705 tablet_bootstrap.cc:492] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28: Bootstrap starting.
I20260809 05:28:35.258068 7747 ts_tablet_manager.cc:1905] T 83abe9facabf4430837a5023e11b771f P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:28:35.260360 7705 tablet_bootstrap.cc:654] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:35.266726 7706 tablet_bootstrap.cc:492] T 2e6a74734a3249c1bd6f246c48c841a6 P 572338af92db459a8f5280a611127d14: Bootstrap starting.
I20260809 05:28:35.268859 7706 tablet_bootstrap.cc:654] T 2e6a74734a3249c1bd6f246c48c841a6 P 572338af92db459a8f5280a611127d14: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:35.272399 7747 ts_tablet_manager.cc:1918] T 83abe9facabf4430837a5023e11b771f P 7a8b9f85fd17482d9ad4b5a6f513e2e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:28:35.272701 7747 log.cc:1196] T 83abe9facabf4430837a5023e11b771f P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-2/wal/wals/83abe9facabf4430837a5023e11b771f
I20260809 05:28:35.273483 7747 ts_tablet_manager.cc:1939] T 83abe9facabf4430837a5023e11b771f P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Deleting consensus metadata
I20260809 05:28:35.274326 7704 tablet_bootstrap.cc:492] T 2e6a74734a3249c1bd6f246c48c841a6 P 7a8b9f85fd17482d9ad4b5a6f513e2e5: No bootstrap required, opened a new log
I20260809 05:28:35.274559 7704 ts_tablet_manager.cc:1397] T 2e6a74734a3249c1bd6f246c48c841a6 P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Time spent bootstrapping tablet: real 0.030s user 0.007s sys 0.010s
I20260809 05:28:35.275665 7705 tablet_bootstrap.cc:492] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28: No bootstrap required, opened a new log
I20260809 05:28:35.275712 7704 raft_consensus.cc:348] T 2e6a74734a3249c1bd6f246c48c841a6 P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:35.275997 7704 raft_consensus.cc:374] T 2e6a74734a3249c1bd6f246c48c841a6 P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:35.276098 7704 raft_consensus.cc:729] T 2e6a74734a3249c1bd6f246c48c841a6 P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a8b9f85fd17482d9ad4b5a6f513e2e5, State: Initialized, Role: FOLLOWER
I20260809 05:28:35.276086 6949 catalog_manager.cc:4841] TS 7a8b9f85fd17482d9ad4b5a6f513e2e5 (127.26.185.3:34453): tablet 83abe9facabf4430837a5023e11b771f (table test-table [id=90c2923167e94169b097db81f8ee5916]) successfully deleted
I20260809 05:28:35.276446 7704 consensus_queue.cc:260] T 2e6a74734a3249c1bd6f246c48c841a6 P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:35.277151 7704 ts_tablet_manager.cc:1428] T 2e6a74734a3249c1bd6f246c48c841a6 P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260809 05:28:35.277652 7705 ts_tablet_manager.cc:1397] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.011s
I20260809 05:28:35.278851 7705 raft_consensus.cc:348] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:35.279142 7706 tablet_bootstrap.cc:492] T 2e6a74734a3249c1bd6f246c48c841a6 P 572338af92db459a8f5280a611127d14: No bootstrap required, opened a new log
I20260809 05:28:35.279245 7705 raft_consensus.cc:374] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:35.279335 7706 ts_tablet_manager.cc:1397] T 2e6a74734a3249c1bd6f246c48c841a6 P 572338af92db459a8f5280a611127d14: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.002s
I20260809 05:28:35.279436 7705 raft_consensus.cc:729] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b2af3406f404ecbbefaa61ac1e7ed28, State: Initialized, Role: FOLLOWER
I20260809 05:28:35.279794 7705 consensus_queue.cc:260] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:35.280328 7706 raft_consensus.cc:348] T 2e6a74734a3249c1bd6f246c48c841a6 P 572338af92db459a8f5280a611127d14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:35.280552 7705 ts_tablet_manager.cc:1428] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260809 05:28:35.280612 7706 raft_consensus.cc:374] T 2e6a74734a3249c1bd6f246c48c841a6 P 572338af92db459a8f5280a611127d14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:35.280720 7706 raft_consensus.cc:729] T 2e6a74734a3249c1bd6f246c48c841a6 P 572338af92db459a8f5280a611127d14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572338af92db459a8f5280a611127d14, State: Initialized, Role: FOLLOWER
I20260809 05:28:35.281059 7706 consensus_queue.cc:260] T 2e6a74734a3249c1bd6f246c48c841a6 P 572338af92db459a8f5280a611127d14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:35.282408 7706 ts_tablet_manager.cc:1428] T 2e6a74734a3249c1bd6f246c48c841a6 P 572338af92db459a8f5280a611127d14: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20260809 05:28:35.296578 7472 tablet.cc:2369] T 2e6a74734a3249c1bd6f246c48c841a6 P 572338af92db459a8f5280a611127d14: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 05:28:35.481715 7669 tablet.cc:2369] T 2e6a74734a3249c1bd6f246c48c841a6 P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:28:35.569141 7712 raft_consensus.cc:482] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:28:35.569527 7712 raft_consensus.cc:504] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:35.570565 7712 leader_election.cc:288] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572338af92db459a8f5280a611127d14 (127.26.185.2:36731), 7a8b9f85fd17482d9ad4b5a6f513e2e5 (127.26.185.3:34453)
I20260809 05:28:35.571465 7397 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e6a74734a3249c1bd6f246c48c841a6" candidate_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572338af92db459a8f5280a611127d14" is_pre_election: true
I20260809 05:28:35.571547 7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e6a74734a3249c1bd6f246c48c841a6" candidate_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" is_pre_election: true
I20260809 05:28:35.571900 7594 raft_consensus.cc:2454] T 2e6a74734a3249c1bd6f246c48c841a6 P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b2af3406f404ecbbefaa61ac1e7ed28 in term 0.
I20260809 05:28:35.571923 7397 raft_consensus.cc:2454] T 2e6a74734a3249c1bd6f246c48c841a6 P 572338af92db459a8f5280a611127d14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b2af3406f404ecbbefaa61ac1e7ed28 in term 0.
I20260809 05:28:35.572531 7099 leader_election.cc:302] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b2af3406f404ecbbefaa61ac1e7ed28, 7a8b9f85fd17482d9ad4b5a6f513e2e5; no voters:
I20260809 05:28:35.572940 7712 raft_consensus.cc:2781] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:28:35.573103 7712 raft_consensus.cc:482] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:28:35.573235 7712 raft_consensus.cc:3037] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:35.577201 7712 raft_consensus.cc:504] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:35.578270 7712 leader_election.cc:288] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28 [CANDIDATE]: Term 1 election: Requested vote from peers 572338af92db459a8f5280a611127d14 (127.26.185.2:36731), 7a8b9f85fd17482d9ad4b5a6f513e2e5 (127.26.185.3:34453)
I20260809 05:28:35.579155 7397 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e6a74734a3249c1bd6f246c48c841a6" candidate_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572338af92db459a8f5280a611127d14"
I20260809 05:28:35.579475 7397 raft_consensus.cc:3037] T 2e6a74734a3249c1bd6f246c48c841a6 P 572338af92db459a8f5280a611127d14 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:35.579532 7594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e6a74734a3249c1bd6f246c48c841a6" candidate_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5"
I20260809 05:28:35.579824 7594 raft_consensus.cc:3037] T 2e6a74734a3249c1bd6f246c48c841a6 P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:35.583076 7397 raft_consensus.cc:2454] T 2e6a74734a3249c1bd6f246c48c841a6 P 572338af92db459a8f5280a611127d14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b2af3406f404ecbbefaa61ac1e7ed28 in term 1.
I20260809 05:28:35.583812 7098 leader_election.cc:302] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b2af3406f404ecbbefaa61ac1e7ed28, 572338af92db459a8f5280a611127d14; no voters:
I20260809 05:28:35.583866 7594 raft_consensus.cc:2454] T 2e6a74734a3249c1bd6f246c48c841a6 P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b2af3406f404ecbbefaa61ac1e7ed28 in term 1.
I20260809 05:28:35.584271 7712 raft_consensus.cc:2781] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:28:35.584606 7712 raft_consensus.cc:686] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 1 LEADER]: Becoming Leader. State: Replica: 0b2af3406f404ecbbefaa61ac1e7ed28, State: Running, Role: LEADER
I20260809 05:28:35.584985 7712 consensus_queue.cc:237] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:35.588759 6966 catalog_manager.cc:5495] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b2af3406f404ecbbefaa61ac1e7ed28 (127.26.185.1). New cstate: current_term: 1 leader_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } health_report { overall_health: UNKNOWN } } }
Aug 09 05:28:35 dist-test-slave-h3ft krb5kdc[6907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253311, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.62@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM
I20260809 05:28:35.698705 7760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:35.671184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46286 (local address 127.26.185.62:44603)
0809 05:28:35.672252 (+ 1068us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:35.672263 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:35.672873 (+ 610us) server_negotiation.cc:407] Connection header received
0809 05:28:35.673137 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:35.673142 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:35.673214 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:35.673314 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:35.675229 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.676308 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.678629 (+ 2321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.679267 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.679455 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:35.690831 (+ 11376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:35.690838 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:35.690842 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:35.690890 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:35.694316 (+ 3426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:35.695682 (+ 1366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:35.695687 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:35.695690 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:35.695933 (+ 243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:35.696410 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:35.696414 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:35.696416 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:35.697068 (+ 652us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:35.697227 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:35.697994 (+ 767us) server_negotiation.cc:299] Negotiation successful
0809 05:28:35.698375 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":97,"server-negotiator.queue_time_us":717,"thread_start_us":454,"threads_started":1}
I20260809 05:28:35.698736 7761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:35.671184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44603 (local address 127.0.0.1:46286)
0809 05:28:35.672698 (+ 1514us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:35.672729 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:35.672971 (+ 242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:35.673400 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:35.673406 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:35.674644 (+ 1238us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:35.674992 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:35.675058 (+ 66us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.676539 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.676546 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:35.678408 (+ 1862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:35.678430 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.679500 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.679508 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:35.679749 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:35.686435 (+ 6686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:35.686475 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:35.690460 (+ 3985us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:35.694558 (+ 4098us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:35.694587 (+ 29us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:35.694600 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:35.695496 (+ 896us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:35.696069 (+ 573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:35.696075 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:35.696079 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:35.696280 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:35.697253 (+ 973us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:35.697265 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:35.697526 (+ 261us) client_negotiation.cc:769] Sending connection context
0809 05:28:35.697752 (+ 226us) client_negotiation.cc:240] Negotiation successful
0809 05:28:35.698195 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1303,"thread_start_us":1137,"threads_started":1}
I20260809 05:28:35.706645 6966 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:46286:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 05:28:35.708220 6966 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 05:28:35.717386 7364 tablet_service.cc:1467] Processing CreateTablet for tablet b48e3669c9f34c8e9eea2cbebdf29711 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3cb0b152aab4459b9437b3f63491b65a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 05:28:35.717362 7168 tablet_service.cc:1467] Processing CreateTablet for tablet b48e3669c9f34c8e9eea2cbebdf29711 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3cb0b152aab4459b9437b3f63491b65a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 05:28:35.717694 7565 tablet_service.cc:1467] Processing CreateTablet for tablet b48e3669c9f34c8e9eea2cbebdf29711 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3cb0b152aab4459b9437b3f63491b65a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 05:28:35.718290 7168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b48e3669c9f34c8e9eea2cbebdf29711. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:35.718321 7364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b48e3669c9f34c8e9eea2cbebdf29711. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:35.718447 7565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b48e3669c9f34c8e9eea2cbebdf29711. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:35.727216 7704 tablet_bootstrap.cc:492] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Bootstrap starting.
I20260809 05:28:35.727272 7706 tablet_bootstrap.cc:492] T b48e3669c9f34c8e9eea2cbebdf29711 P 572338af92db459a8f5280a611127d14: Bootstrap starting.
I20260809 05:28:35.727231 7705 tablet_bootstrap.cc:492] T b48e3669c9f34c8e9eea2cbebdf29711 P 0b2af3406f404ecbbefaa61ac1e7ed28: Bootstrap starting.
I20260809 05:28:35.729488 7705 tablet_bootstrap.cc:654] T b48e3669c9f34c8e9eea2cbebdf29711 P 0b2af3406f404ecbbefaa61ac1e7ed28: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:35.729488 7706 tablet_bootstrap.cc:654] T b48e3669c9f34c8e9eea2cbebdf29711 P 572338af92db459a8f5280a611127d14: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:35.729480 7704 tablet_bootstrap.cc:654] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:35.740268 7706 tablet_bootstrap.cc:492] T b48e3669c9f34c8e9eea2cbebdf29711 P 572338af92db459a8f5280a611127d14: No bootstrap required, opened a new log
I20260809 05:28:35.740334 7705 tablet_bootstrap.cc:492] T b48e3669c9f34c8e9eea2cbebdf29711 P 0b2af3406f404ecbbefaa61ac1e7ed28: No bootstrap required, opened a new log
I20260809 05:28:35.740435 7704 tablet_bootstrap.cc:492] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5: No bootstrap required, opened a new log
I20260809 05:28:35.740576 7706 ts_tablet_manager.cc:1397] T b48e3669c9f34c8e9eea2cbebdf29711 P 572338af92db459a8f5280a611127d14: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.005s
I20260809 05:28:35.740564 7705 ts_tablet_manager.cc:1397] T b48e3669c9f34c8e9eea2cbebdf29711 P 0b2af3406f404ecbbefaa61ac1e7ed28: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.007s
I20260809 05:28:35.740667 7704 ts_tablet_manager.cc:1397] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.003s
I20260809 05:28:35.741566 7705 raft_consensus.cc:348] T b48e3669c9f34c8e9eea2cbebdf29711 P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:35.741569 7706 raft_consensus.cc:348] T b48e3669c9f34c8e9eea2cbebdf29711 P 572338af92db459a8f5280a611127d14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:35.741911 7705 raft_consensus.cc:374] T b48e3669c9f34c8e9eea2cbebdf29711 P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:35.741911 7706 raft_consensus.cc:374] T b48e3669c9f34c8e9eea2cbebdf29711 P 572338af92db459a8f5280a611127d14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:35.742008 7705 raft_consensus.cc:729] T b48e3669c9f34c8e9eea2cbebdf29711 P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b2af3406f404ecbbefaa61ac1e7ed28, State: Initialized, Role: FOLLOWER
I20260809 05:28:35.742009 7706 raft_consensus.cc:729] T b48e3669c9f34c8e9eea2cbebdf29711 P 572338af92db459a8f5280a611127d14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572338af92db459a8f5280a611127d14, State: Initialized, Role: FOLLOWER
I20260809 05:28:35.742359 7705 consensus_queue.cc:260] T b48e3669c9f34c8e9eea2cbebdf29711 P 0b2af3406f404ecbbefaa61ac1e7ed28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:35.742374 7706 consensus_queue.cc:260] T b48e3669c9f34c8e9eea2cbebdf29711 P 572338af92db459a8f5280a611127d14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:35.742910 7712 tablet_replica.cc:439] T b48e3669c9f34c8e9eea2cbebdf29711 P 0b2af3406f404ecbbefaa61ac1e7ed28: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } } }
I20260809 05:28:35.742956 7713 tablet_replica.cc:439] T b48e3669c9f34c8e9eea2cbebdf29711 P 572338af92db459a8f5280a611127d14: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } } }
I20260809 05:28:35.743360 7713 tablet_replica.cc:442] T b48e3669c9f34c8e9eea2cbebdf29711 P 572338af92db459a8f5280a611127d14: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 05:28:35.743366 7712 tablet_replica.cc:442] T b48e3669c9f34c8e9eea2cbebdf29711 P 0b2af3406f404ecbbefaa61ac1e7ed28: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 05:28:35.743320 7704 raft_consensus.cc:348] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:35.743655 7704 raft_consensus.cc:374] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:35.743744 7704 raft_consensus.cc:729] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a8b9f85fd17482d9ad4b5a6f513e2e5, State: Initialized, Role: FOLLOWER
I20260809 05:28:35.744099 7704 consensus_queue.cc:260] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:35.744694 7705 ts_tablet_manager.cc:1428] T b48e3669c9f34c8e9eea2cbebdf29711 P 0b2af3406f404ecbbefaa61ac1e7ed28: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260809 05:28:35.744861 7704 ts_tablet_manager.cc:1428] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260809 05:28:35.745559 7714 tablet_replica.cc:439] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } } }
I20260809 05:28:35.746006 7714 tablet_replica.cc:442] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 05:28:35.747943 7706 ts_tablet_manager.cc:1428] T b48e3669c9f34c8e9eea2cbebdf29711 P 572338af92db459a8f5280a611127d14: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260809 05:28:35.848094 7714 raft_consensus.cc:482] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:28:35.848452 7714 raft_consensus.cc:504] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:35.850755 7714 leader_election.cc:288] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b2af3406f404ecbbefaa61ac1e7ed28 (127.26.185.1:36911), 572338af92db459a8f5280a611127d14 (127.26.185.2:36731)
I20260809 05:28:35.858484 7769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:35.851354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:35141 (local address 127.26.185.1:36911)
0809 05:28:35.852878 (+ 1524us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:35.852898 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:35.852925 (+ 27us) server_negotiation.cc:407] Connection header received
0809 05:28:35.853033 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:35.853038 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:35.853143 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:35.853295 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:28:35.853882 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.854648 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.856561 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.857385 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.857618 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:35.857714 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:35.857958 (+ 244us) server_negotiation.cc:299] Negotiation successful
0809 05:28:35.858128 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1362,"thread_start_us":1202,"threads_started":1}
I20260809 05:28:35.858564 7767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:35.851105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:36911 (local address 127.26.185.3:35141)
0809 05:28:35.851713 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:35.851744 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:35.851981 (+ 237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:35.853328 (+ 1347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:35.853332 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:35.853359 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:28:35.853694 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:35.853703 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.854813 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.854819 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:35.856357 (+ 1538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:35.856374 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.857584 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.857591 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:35.857782 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:35.857809 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 05:28:35.857924 (+ 115us) client_negotiation.cc:240] Negotiation successful
0809 05:28:35.858095 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"mutex_wait_us":6,"thread_start_us":332,"threads_started":1}
I20260809 05:28:35.859465 7770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:35.851502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:43459 (local address 127.26.185.2:36731)
0809 05:28:35.852647 (+ 1145us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:35.852658 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:35.853510 (+ 852us) server_negotiation.cc:407] Connection header received
0809 05:28:35.853606 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:35.853610 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:35.853680 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:35.853809 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:28:35.854512 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.855435 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.857200 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.858214 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.858431 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:35.858517 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:35.858930 (+ 413us) server_negotiation.cc:299] Negotiation successful
0809 05:28:35.859132 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":939,"thread_start_us":775,"threads_started":1}
I20260809 05:28:35.859539 7768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:35.851163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:36731 (local address 127.26.185.3:43459)
0809 05:28:35.853150 (+ 1987us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:35.853177 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:35.853326 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:35.853827 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:35.853831 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:35.853899 (+ 68us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:28:35.854299 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:35.854308 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.855580 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.855592 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:35.857026 (+ 1434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:35.857039 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.858468 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.858474 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:35.858752 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:35.858796 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 05:28:35.858889 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 05:28:35.859076 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1838,"mutex_wait_us":2,"thread_start_us":1642,"threads_started":1}
I20260809 05:28:35.859663 7200 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b48e3669c9f34c8e9eea2cbebdf29711" candidate_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" is_pre_election: true
I20260809 05:28:35.860251 7200 raft_consensus.cc:2454] T b48e3669c9f34c8e9eea2cbebdf29711 P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a8b9f85fd17482d9ad4b5a6f513e2e5 in term 0.
I20260809 05:28:35.860411 7397 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b48e3669c9f34c8e9eea2cbebdf29711" candidate_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572338af92db459a8f5280a611127d14" is_pre_election: true
I20260809 05:28:35.860765 7397 raft_consensus.cc:2454] T b48e3669c9f34c8e9eea2cbebdf29711 P 572338af92db459a8f5280a611127d14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a8b9f85fd17482d9ad4b5a6f513e2e5 in term 0.
I20260809 05:28:35.861029 7496 leader_election.cc:302] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b2af3406f404ecbbefaa61ac1e7ed28, 7a8b9f85fd17482d9ad4b5a6f513e2e5; no voters:
I20260809 05:28:35.861625 7714 raft_consensus.cc:2781] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:28:35.861784 7714 raft_consensus.cc:482] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:28:35.861892 7714 raft_consensus.cc:3037] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:35.864857 7714 raft_consensus.cc:504] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:35.865679 7714 leader_election.cc:288] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [CANDIDATE]: Term 1 election: Requested vote from peers 0b2af3406f404ecbbefaa61ac1e7ed28 (127.26.185.1:36911), 572338af92db459a8f5280a611127d14 (127.26.185.2:36731)
I20260809 05:28:35.866559 7200 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b48e3669c9f34c8e9eea2cbebdf29711" candidate_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28"
I20260809 05:28:35.866556 7397 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b48e3669c9f34c8e9eea2cbebdf29711" candidate_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572338af92db459a8f5280a611127d14"
I20260809 05:28:35.866842 7200 raft_consensus.cc:3037] T b48e3669c9f34c8e9eea2cbebdf29711 P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:35.866858 7397 raft_consensus.cc:3037] T b48e3669c9f34c8e9eea2cbebdf29711 P 572338af92db459a8f5280a611127d14 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:35.870339 7397 raft_consensus.cc:2454] T b48e3669c9f34c8e9eea2cbebdf29711 P 572338af92db459a8f5280a611127d14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a8b9f85fd17482d9ad4b5a6f513e2e5 in term 1.
I20260809 05:28:35.870357 7200 raft_consensus.cc:2454] T b48e3669c9f34c8e9eea2cbebdf29711 P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a8b9f85fd17482d9ad4b5a6f513e2e5 in term 1.
I20260809 05:28:35.870983 7498 leader_election.cc:302] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 572338af92db459a8f5280a611127d14, 7a8b9f85fd17482d9ad4b5a6f513e2e5; no voters:
I20260809 05:28:35.871465 7714 raft_consensus.cc:2781] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:28:35.871965 7714 raft_consensus.cc:686] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 1 LEADER]: Becoming Leader. State: Replica: 7a8b9f85fd17482d9ad4b5a6f513e2e5, State: Running, Role: LEADER
I20260809 05:28:35.872476 7714 consensus_queue.cc:237] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:35.874855 7771 tablet_replica.cc:439] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5: TxnStatusTablet state changed. Reason: New leader 7a8b9f85fd17482d9ad4b5a6f513e2e5. Latest consensus state: current_term: 1 leader_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } } }
I20260809 05:28:35.875332 7771 tablet_replica.cc:442] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5: This TxnStatusTablet replica's current role is: LEADER
I20260809 05:28:35.876173 7773 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 05:28:35.876462 7773 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 05:28:35.877345 6966 catalog_manager.cc:5495] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a8b9f85fd17482d9ad4b5a6f513e2e5 (127.26.185.3). New cstate: current_term: 1 leader_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } health_report { overall_health: HEALTHY } } }
I20260809 05:28:35.914733 7761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:35.905153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:34453 (local address 127.0.0.1:35112)
0809 05:28:35.905787 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:35.905818 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:35.906030 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:35.907478 (+ 1448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:35.907486 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:35.907505 (+ 19us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 05:28:35.907780 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:35.907793 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.909624 (+ 1831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.909630 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:35.910818 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:35.910833 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.911966 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.911974 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:35.912247 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:35.912377 (+ 130us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 05:28:35.913972 (+ 1595us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 05:28:35.914020 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 05:28:35.914120 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 05:28:35.914343 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333}
I20260809 05:28:35.914794 7776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:35.905153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35112 (local address 127.26.185.3:34453)
0809 05:28:35.906868 (+ 1715us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:35.906877 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:35.906910 (+ 33us) server_negotiation.cc:407] Connection header received
0809 05:28:35.907081 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:35.907088 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:35.907232 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:35.907433 (+ 201us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:28:35.907981 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.909430 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.910990 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.911759 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.912633 (+ 874us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:35.912840 (+ 207us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:28:35.913811 (+ 971us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:28:35.914020 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:35.914183 (+ 163us) server_negotiation.cc:299] Negotiation successful
0809 05:28:35.914299 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1537,"thread_start_us":1323,"threads_started":1}
I20260809 05:28:35.922951 7397 raft_consensus.cc:1261] T b48e3669c9f34c8e9eea2cbebdf29711 P 572338af92db459a8f5280a611127d14 [term 1 FOLLOWER]: Refusing update from remote peer 7a8b9f85fd17482d9ad4b5a6f513e2e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:28:35.923368 7200 raft_consensus.cc:1261] T b48e3669c9f34c8e9eea2cbebdf29711 P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 1 FOLLOWER]: Refusing update from remote peer 7a8b9f85fd17482d9ad4b5a6f513e2e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:28:35.924278 7714 consensus_queue.cc:1035] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:28:35.925340 7771 consensus_queue.cc:1035] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:28:35.929481 7713 tablet_replica.cc:439] T b48e3669c9f34c8e9eea2cbebdf29711 P 572338af92db459a8f5280a611127d14: TxnStatusTablet state changed. Reason: New leader 7a8b9f85fd17482d9ad4b5a6f513e2e5. Latest consensus state: current_term: 1 leader_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } } }
I20260809 05:28:35.929911 7713 tablet_replica.cc:442] T b48e3669c9f34c8e9eea2cbebdf29711 P 572338af92db459a8f5280a611127d14: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 05:28:35.940128 7777 mvcc.cc:205] Tried to move back new op lower bound from 7316493582009237504 to 7316493581818585088. Current Snapshot: MvccSnapshot[applied={T|T < 7316493582009237504}]
I20260809 05:28:35.944545 7714 tablet_replica.cc:439] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } } }
I20260809 05:28:35.945046 7714 tablet_replica.cc:442] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5: This TxnStatusTablet replica's current role is: LEADER
I20260809 05:28:35.951543 7712 tablet_replica.cc:439] T b48e3669c9f34c8e9eea2cbebdf29711 P 0b2af3406f404ecbbefaa61ac1e7ed28: TxnStatusTablet state changed. Reason: New leader 7a8b9f85fd17482d9ad4b5a6f513e2e5. Latest consensus state: current_term: 1 leader_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } } }
I20260809 05:28:35.951960 7712 tablet_replica.cc:442] T b48e3669c9f34c8e9eea2cbebdf29711 P 0b2af3406f404ecbbefaa61ac1e7ed28: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 05:28:35.953460 7771 tablet_replica.cc:439] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } } }
I20260809 05:28:35.953805 7771 tablet_replica.cc:442] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5: This TxnStatusTablet replica's current role is: LEADER
I20260809 05:28:35.960052 7713 tablet_replica.cc:439] T b48e3669c9f34c8e9eea2cbebdf29711 P 572338af92db459a8f5280a611127d14: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } } }
I20260809 05:28:35.960402 7713 tablet_replica.cc:442] T b48e3669c9f34c8e9eea2cbebdf29711 P 572338af92db459a8f5280a611127d14: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 05:28:35.962453 7712 tablet_replica.cc:439] T b48e3669c9f34c8e9eea2cbebdf29711 P 0b2af3406f404ecbbefaa61ac1e7ed28: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } } }
I20260809 05:28:35.962797 7712 tablet_replica.cc:442] T b48e3669c9f34c8e9eea2cbebdf29711 P 0b2af3406f404ecbbefaa61ac1e7ed28: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 05:28:35.987766 7776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:35.977946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:37691 (local address 127.26.185.3:34453)
0809 05:28:35.978207 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:35.978216 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:35.979809 (+ 1593us) server_negotiation.cc:407] Connection header received
0809 05:28:35.980096 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:35.980103 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:35.980200 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:35.980315 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:28:35.980970 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.982354 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.985049 (+ 2695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.985836 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.985987 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:35.986751 (+ 764us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:28:35.986935 (+ 184us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:28:35.987064 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:35.987254 (+ 190us) server_negotiation.cc:299] Negotiation successful
0809 05:28:35.987361 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 05:28:35.988034 7793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:35.977319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:34453 (local address 127.26.185.1:37691)
0809 05:28:35.979642 (+ 2323us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:35.979666 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:35.979922 (+ 256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:35.980334 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:35.980339 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:35.980350 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 05:28:35.980760 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:35.980774 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.982568 (+ 1794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.982576 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:35.984805 (+ 2229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:35.984832 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:35.986138 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:35.986150 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:35.986390 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:35.986519 (+ 129us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 05:28:35.987088 (+ 569us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 05:28:35.987105 (+ 17us) client_negotiation.cc:769] Sending connection context
0809 05:28:35.987217 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 05:28:35.987449 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2069,"thread_start_us":1909,"threads_started":1}
I20260809 05:28:35.997972 7712 consensus_queue.cc:1035] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:28:36.003757 7397 raft_consensus.cc:1261] T 2e6a74734a3249c1bd6f246c48c841a6 P 572338af92db459a8f5280a611127d14 [term 1 FOLLOWER]: Refusing update from remote peer 0b2af3406f404ecbbefaa61ac1e7ed28: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:28:36.004594 7712 consensus_queue.cc:1035] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:28:36.067952 7769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:36.057896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:48759 (local address 127.26.185.1:36911)
0809 05:28:36.058159 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:36.058165 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:36.058844 (+ 679us) server_negotiation.cc:407] Connection header received
0809 05:28:36.059351 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:36.059358 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:36.059479 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:36.059572 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:28:36.061110 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:36.062371 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:36.065214 (+ 2843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:36.065960 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:36.066103 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:36.066921 (+ 818us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:28:36.067143 (+ 222us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:28:36.067211 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:36.067498 (+ 287us) server_negotiation.cc:299] Negotiation successful
0809 05:28:36.067613 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 05:28:36.068858 7801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:36.057246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:36911 (local address 127.26.185.3:48759)
0809 05:28:36.058706 (+ 1460us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:36.058731 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:36.058914 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:36.060319 (+ 1405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:36.060325 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:36.060346 (+ 21us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 05:28:36.060880 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:36.060895 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:36.062766 (+ 1871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:36.062774 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:36.065012 (+ 2238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:36.065035 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:36.066325 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:36.066331 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:36.066550 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:36.066667 (+ 117us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 05:28:36.067352 (+ 685us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 05:28:36.067367 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 05:28:36.068205 (+ 838us) client_negotiation.cc:240] Negotiation successful
0809 05:28:36.068402 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1162,"thread_start_us":955,"threads_started":1}
I20260809 05:28:36.127573 6965 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46270:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:28:36.127985 6965 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46270:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:28:36.132614 6965 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6a1b142f671d41ebb0a89f828720f546: Sending DeleteTablet for 3 replicas of tablet 2e6a74734a3249c1bd6f246c48c841a6
I20260809 05:28:36.133991 7168 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e6a74734a3249c1bd6f246c48c841a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:28:36 UTC) from {username='oryx', principal='oryx/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:33940
I20260809 05:28:36.133976 7364 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e6a74734a3249c1bd6f246c48c841a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:28:36 UTC) from {username='oryx', principal='oryx/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:49002
I20260809 05:28:36.134231 7565 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e6a74734a3249c1bd6f246c48c841a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:28:36 UTC) from {username='oryx', principal='oryx/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:35100
I20260809 05:28:36.143677 7805 tablet_replica.cc:330] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28: stopping tablet replica
I20260809 05:28:36.144073 7806 tablet_replica.cc:330] T 2e6a74734a3249c1bd6f246c48c841a6 P 7a8b9f85fd17482d9ad4b5a6f513e2e5: stopping tablet replica
I20260809 05:28:36.144023 7805 raft_consensus.cc:2229] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 1 LEADER]: Raft consensus shutting down.
I20260809 05:28:36.144444 7806 raft_consensus.cc:2229] T 2e6a74734a3249c1bd6f246c48c841a6 P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:28:36.144640 7805 raft_consensus.cc:2258] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:28:36.144991 7806 raft_consensus.cc:2258] T 2e6a74734a3249c1bd6f246c48c841a6 P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:28:36.146570 7806 ts_tablet_manager.cc:1905] T 2e6a74734a3249c1bd6f246c48c841a6 P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:28:36.146674 7805 ts_tablet_manager.cc:1905] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:28:36.156831 7806 ts_tablet_manager.cc:1918] T 2e6a74734a3249c1bd6f246c48c841a6 P 7a8b9f85fd17482d9ad4b5a6f513e2e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 05:28:36.157217 7806 log.cc:1196] T 2e6a74734a3249c1bd6f246c48c841a6 P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-2/wal/wals/2e6a74734a3249c1bd6f246c48c841a6
I20260809 05:28:36.157924 7806 ts_tablet_manager.cc:1939] T 2e6a74734a3249c1bd6f246c48c841a6 P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Deleting consensus metadata
I20260809 05:28:36.159677 6949 catalog_manager.cc:4841] TS 7a8b9f85fd17482d9ad4b5a6f513e2e5 (127.26.185.3:34453): tablet 2e6a74734a3249c1bd6f246c48c841a6 (table test-table [id=8f82dbc24ec44a79b42ae262d227f280]) successfully deleted
I20260809 05:28:36.163669 7804 tablet_replica.cc:330] T 2e6a74734a3249c1bd6f246c48c841a6 P 572338af92db459a8f5280a611127d14: stopping tablet replica
I20260809 05:28:36.163954 7804 raft_consensus.cc:2229] T 2e6a74734a3249c1bd6f246c48c841a6 P 572338af92db459a8f5280a611127d14 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:28:36.164309 7804 raft_consensus.cc:2258] T 2e6a74734a3249c1bd6f246c48c841a6 P 572338af92db459a8f5280a611127d14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:28:36.166047 7804 ts_tablet_manager.cc:1905] T 2e6a74734a3249c1bd6f246c48c841a6 P 572338af92db459a8f5280a611127d14: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:28:36.166777 7805 ts_tablet_manager.cc:1918] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 05:28:36.166963 7805 log.cc:1196] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-0/wal/wals/2e6a74734a3249c1bd6f246c48c841a6
I20260809 05:28:36.171228 7805 ts_tablet_manager.cc:1939] T 2e6a74734a3249c1bd6f246c48c841a6 P 0b2af3406f404ecbbefaa61ac1e7ed28: Deleting consensus metadata
I20260809 05:28:36.172977 6947 catalog_manager.cc:4841] TS 0b2af3406f404ecbbefaa61ac1e7ed28 (127.26.185.1:36911): tablet 2e6a74734a3249c1bd6f246c48c841a6 (table test-table [id=8f82dbc24ec44a79b42ae262d227f280]) successfully deleted
I20260809 05:28:36.177337 7804 ts_tablet_manager.cc:1918] T 2e6a74734a3249c1bd6f246c48c841a6 P 572338af92db459a8f5280a611127d14: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 05:28:36.177554 7804 log.cc:1196] T 2e6a74734a3249c1bd6f246c48c841a6 P 572338af92db459a8f5280a611127d14: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-1/wal/wals/2e6a74734a3249c1bd6f246c48c841a6
I20260809 05:28:36.178121 7804 ts_tablet_manager.cc:1939] T 2e6a74734a3249c1bd6f246c48c841a6 P 572338af92db459a8f5280a611127d14: Deleting consensus metadata
I20260809 05:28:36.179818 6948 catalog_manager.cc:4841] TS 572338af92db459a8f5280a611127d14 (127.26.185.2:36731): tablet 2e6a74734a3249c1bd6f246c48c841a6 (table test-table [id=8f82dbc24ec44a79b42ae262d227f280]) successfully deleted
Aug 09 05:28:36 dist-test-slave-h3ft krb5kdc[6907](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253316, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 05:28:36 dist-test-slave-h3ft krb5kdc[6907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:36 dist-test-slave-h3ft krb5kdc[6907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
W20260809 05:28:36.241039 7819 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:36.227235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46302 (local address 127.26.185.62:44603)
0809 05:28:36.228445 (+ 1210us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:36.228454 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:36.228483 (+ 29us) server_negotiation.cc:407] Connection header received
0809 05:28:36.228568 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:36.228575 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:36.228661 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:36.228812 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:36.230417 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:36.231469 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:36.232875 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:36.233342 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:36.233501 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:36.240599 (+ 7098us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46302: BlockingRecv error: recv got EOF from 127.0.0.1:46302 (error 108)
Metrics: {"server-negotiator.queue_time_us":1032,"thread_start_us":891,"threads_started":1}
Aug 09 05:28:36 dist-test-slave-h3ft krb5kdc[6907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253316, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM
I20260809 05:28:36.265654 7819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:36.245362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46316 (local address 127.26.185.62:44603)
0809 05:28:36.245632 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:36.245641 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:36.246101 (+ 460us) server_negotiation.cc:407] Connection header received
0809 05:28:36.246299 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:36.246306 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:36.246434 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:36.246580 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:36.248104 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:36.249574 (+ 1470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:36.251424 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:36.252181 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:36.252363 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:36.257399 (+ 5036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:36.257408 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:36.257416 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:36.257485 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:36.261948 (+ 4463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:36.262853 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:36.262861 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:36.262866 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:36.263137 (+ 271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:36.263616 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:36.263623 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:36.263627 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:36.264114 (+ 487us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:36.264477 (+ 363us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:36.264845 (+ 368us) server_negotiation.cc:299] Negotiation successful
0809 05:28:36.265153 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260809 05:28:36.271153 6965 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46316:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 05:28:36.272061 6965 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 05:28:36.281708 7364 tablet_service.cc:1467] Processing CreateTablet for tablet 56da3c54f32b4303b5b7d34f2e34e08e (DEFAULT_TABLE table=test-table [id=2eae1f53e8524dab904b1b7de0d1e9f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:28:36.282104 7168 tablet_service.cc:1467] Processing CreateTablet for tablet 56da3c54f32b4303b5b7d34f2e34e08e (DEFAULT_TABLE table=test-table [id=2eae1f53e8524dab904b1b7de0d1e9f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:28:36.282339 7364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56da3c54f32b4303b5b7d34f2e34e08e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:36.282680 7168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56da3c54f32b4303b5b7d34f2e34e08e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:36.282541 7565 tablet_service.cc:1467] Processing CreateTablet for tablet 56da3c54f32b4303b5b7d34f2e34e08e (DEFAULT_TABLE table=test-table [id=2eae1f53e8524dab904b1b7de0d1e9f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:28:36.283154 7565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56da3c54f32b4303b5b7d34f2e34e08e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:36.294031 7828 tablet_bootstrap.cc:492] T 56da3c54f32b4303b5b7d34f2e34e08e P 572338af92db459a8f5280a611127d14: Bootstrap starting.
I20260809 05:28:36.295497 7826 tablet_bootstrap.cc:492] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28: Bootstrap starting.
I20260809 05:28:36.297791 7826 tablet_bootstrap.cc:654] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:36.298614 7831 tablet_bootstrap.cc:492] T 56da3c54f32b4303b5b7d34f2e34e08e P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Bootstrap starting.
I20260809 05:28:36.301363 7828 tablet_bootstrap.cc:654] T 56da3c54f32b4303b5b7d34f2e34e08e P 572338af92db459a8f5280a611127d14: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:36.301396 7831 tablet_bootstrap.cc:654] T 56da3c54f32b4303b5b7d34f2e34e08e P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:36.303821 7826 tablet_bootstrap.cc:492] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28: No bootstrap required, opened a new log
I20260809 05:28:36.304100 7826 ts_tablet_manager.cc:1397] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260809 05:28:36.305058 7831 tablet_bootstrap.cc:492] T 56da3c54f32b4303b5b7d34f2e34e08e P 7a8b9f85fd17482d9ad4b5a6f513e2e5: No bootstrap required, opened a new log
I20260809 05:28:36.305261 7831 ts_tablet_manager.cc:1397] T 56da3c54f32b4303b5b7d34f2e34e08e P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260809 05:28:36.305184 7826 raft_consensus.cc:348] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:36.305508 7826 raft_consensus.cc:374] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:36.305617 7826 raft_consensus.cc:729] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b2af3406f404ecbbefaa61ac1e7ed28, State: Initialized, Role: FOLLOWER
I20260809 05:28:36.305966 7826 consensus_queue.cc:260] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:36.306466 7831 raft_consensus.cc:348] T 56da3c54f32b4303b5b7d34f2e34e08e P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:36.306682 7826 ts_tablet_manager.cc:1428] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260809 05:28:36.306798 7831 raft_consensus.cc:374] T 56da3c54f32b4303b5b7d34f2e34e08e P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:36.306938 7831 raft_consensus.cc:729] T 56da3c54f32b4303b5b7d34f2e34e08e P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a8b9f85fd17482d9ad4b5a6f513e2e5, State: Initialized, Role: FOLLOWER
I20260809 05:28:36.307312 7831 consensus_queue.cc:260] T 56da3c54f32b4303b5b7d34f2e34e08e P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:36.308275 7831 ts_tablet_manager.cc:1428] T 56da3c54f32b4303b5b7d34f2e34e08e P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260809 05:28:36.309319 7828 tablet_bootstrap.cc:492] T 56da3c54f32b4303b5b7d34f2e34e08e P 572338af92db459a8f5280a611127d14: No bootstrap required, opened a new log
I20260809 05:28:36.309526 7828 ts_tablet_manager.cc:1397] T 56da3c54f32b4303b5b7d34f2e34e08e P 572338af92db459a8f5280a611127d14: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.004s
I20260809 05:28:36.310518 7828 raft_consensus.cc:348] T 56da3c54f32b4303b5b7d34f2e34e08e P 572338af92db459a8f5280a611127d14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:36.310794 7828 raft_consensus.cc:374] T 56da3c54f32b4303b5b7d34f2e34e08e P 572338af92db459a8f5280a611127d14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:36.310917 7828 raft_consensus.cc:729] T 56da3c54f32b4303b5b7d34f2e34e08e P 572338af92db459a8f5280a611127d14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572338af92db459a8f5280a611127d14, State: Initialized, Role: FOLLOWER
I20260809 05:28:36.313027 7828 consensus_queue.cc:260] T 56da3c54f32b4303b5b7d34f2e34e08e P 572338af92db459a8f5280a611127d14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:36.314545 7828 ts_tablet_manager.cc:1428] T 56da3c54f32b4303b5b7d34f2e34e08e P 572338af92db459a8f5280a611127d14: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260809 05:28:36.396775 7738 raft_consensus.cc:482] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:28:36.397138 7738 raft_consensus.cc:504] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:36.398476 7738 leader_election.cc:288] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 572338af92db459a8f5280a611127d14 (127.26.185.2:36731), 7a8b9f85fd17482d9ad4b5a6f513e2e5 (127.26.185.3:34453)
I20260809 05:28:36.399362 7397 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56da3c54f32b4303b5b7d34f2e34e08e" candidate_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572338af92db459a8f5280a611127d14" is_pre_election: true
I20260809 05:28:36.399379 7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56da3c54f32b4303b5b7d34f2e34e08e" candidate_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" is_pre_election: true
I20260809 05:28:36.399724 7397 raft_consensus.cc:2454] T 56da3c54f32b4303b5b7d34f2e34e08e P 572338af92db459a8f5280a611127d14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b2af3406f404ecbbefaa61ac1e7ed28 in term 0.
I20260809 05:28:36.399725 7593 raft_consensus.cc:2454] T 56da3c54f32b4303b5b7d34f2e34e08e P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b2af3406f404ecbbefaa61ac1e7ed28 in term 0.
I20260809 05:28:36.400373 7099 leader_election.cc:302] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b2af3406f404ecbbefaa61ac1e7ed28, 7a8b9f85fd17482d9ad4b5a6f513e2e5; no voters:
I20260809 05:28:36.400743 7738 raft_consensus.cc:2781] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:28:36.400879 7738 raft_consensus.cc:482] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:28:36.400969 7738 raft_consensus.cc:3037] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:36.404394 7738 raft_consensus.cc:504] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:36.405210 7738 leader_election.cc:288] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28 [CANDIDATE]: Term 1 election: Requested vote from peers 572338af92db459a8f5280a611127d14 (127.26.185.2:36731), 7a8b9f85fd17482d9ad4b5a6f513e2e5 (127.26.185.3:34453)
I20260809 05:28:36.405980 7397 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56da3c54f32b4303b5b7d34f2e34e08e" candidate_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "572338af92db459a8f5280a611127d14"
I20260809 05:28:36.406013 7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56da3c54f32b4303b5b7d34f2e34e08e" candidate_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5"
I20260809 05:28:36.406253 7397 raft_consensus.cc:3037] T 56da3c54f32b4303b5b7d34f2e34e08e P 572338af92db459a8f5280a611127d14 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:36.406318 7593 raft_consensus.cc:3037] T 56da3c54f32b4303b5b7d34f2e34e08e P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:36.409153 7593 raft_consensus.cc:2454] T 56da3c54f32b4303b5b7d34f2e34e08e P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b2af3406f404ecbbefaa61ac1e7ed28 in term 1.
I20260809 05:28:36.409601 7397 raft_consensus.cc:2454] T 56da3c54f32b4303b5b7d34f2e34e08e P 572338af92db459a8f5280a611127d14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b2af3406f404ecbbefaa61ac1e7ed28 in term 1.
I20260809 05:28:36.409791 7099 leader_election.cc:302] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b2af3406f404ecbbefaa61ac1e7ed28, 7a8b9f85fd17482d9ad4b5a6f513e2e5; no voters:
I20260809 05:28:36.410255 7738 raft_consensus.cc:2781] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:28:36.410526 7738 raft_consensus.cc:686] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 1 LEADER]: Becoming Leader. State: Replica: 0b2af3406f404ecbbefaa61ac1e7ed28, State: Running, Role: LEADER
I20260809 05:28:36.410876 7738 consensus_queue.cc:237] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:36.414597 6965 catalog_manager.cc:5495] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b2af3406f404ecbbefaa61ac1e7ed28 (127.26.185.1). New cstate: current_term: 1 leader_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } health_report { overall_health: UNKNOWN } } }
I20260809 05:28:36.439378 7769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:36.432318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33954 (local address 127.26.185.1:36911)
0809 05:28:36.432754 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:36.432762 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:36.432796 (+ 34us) server_negotiation.cc:407] Connection header received
0809 05:28:36.432991 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:36.432995 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:36.433085 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:36.433178 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:28:36.433673 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:36.434671 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:36.436801 (+ 2130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:36.437430 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:36.437559 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:36.438164 (+ 605us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:28:36.438363 (+ 199us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:28:36.438471 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:36.438765 (+ 294us) server_negotiation.cc:299] Negotiation successful
0809 05:28:36.438912 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227}
I20260809 05:28:36.442924 7397 raft_consensus.cc:1261] T 56da3c54f32b4303b5b7d34f2e34e08e P 572338af92db459a8f5280a611127d14 [term 1 FOLLOWER]: Refusing update from remote peer 0b2af3406f404ecbbefaa61ac1e7ed28: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:28:36.443128 7593 raft_consensus.cc:1261] T 56da3c54f32b4303b5b7d34f2e34e08e P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 1 FOLLOWER]: Refusing update from remote peer 0b2af3406f404ecbbefaa61ac1e7ed28: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:28:36.443985 7738 consensus_queue.cc:1035] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:28:36.444394 7802 consensus_queue.cc:1035] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:28:36.460148 7779 mvcc.cc:205] Tried to move back new op lower bound from 7316493584142458880 to 7316493584022183936. Current Snapshot: MvccSnapshot[applied={T|T < 7316493584142458880 or (T in {7316493584142458880})}]
I20260809 05:28:36.462862 6967 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46316:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:28:36.463250 6967 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46316:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:28:36.467785 6967 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6a1b142f671d41ebb0a89f828720f546: Sending DeleteTablet for 3 replicas of tablet 56da3c54f32b4303b5b7d34f2e34e08e
I20260809 05:28:36.469067 7169 tablet_service.cc:1514] Processing DeleteTablet for tablet 56da3c54f32b4303b5b7d34f2e34e08e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:28:36 UTC) from {username='oryx', principal='oryx/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:33940
I20260809 05:28:36.469094 7364 tablet_service.cc:1514] Processing DeleteTablet for tablet 56da3c54f32b4303b5b7d34f2e34e08e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:28:36 UTC) from {username='oryx', principal='oryx/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:49002
I20260809 05:28:36.469431 7805 tablet_replica.cc:330] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28: stopping tablet replica
I20260809 05:28:36.469472 7168 tablet_service.cc:1514] Processing DeleteTablet for tablet 56da3c54f32b4303b5b7d34f2e34e08e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:28:36 UTC) from {username='oryx', principal='oryx/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:33940
I20260809 05:28:36.469682 7805 raft_consensus.cc:2229] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 1 LEADER]: Raft consensus shutting down.
I20260809 05:28:36.469893 7804 tablet_replica.cc:330] T 56da3c54f32b4303b5b7d34f2e34e08e P 572338af92db459a8f5280a611127d14: stopping tablet replica
I20260809 05:28:36.470096 7805 raft_consensus.cc:2258] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:28:36.470125 7804 raft_consensus.cc:2229] T 56da3c54f32b4303b5b7d34f2e34e08e P 572338af92db459a8f5280a611127d14 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:28:36.470384 7804 raft_consensus.cc:2258] T 56da3c54f32b4303b5b7d34f2e34e08e P 572338af92db459a8f5280a611127d14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:28:36.470499 7565 tablet_service.cc:1514] Processing DeleteTablet for tablet 56da3c54f32b4303b5b7d34f2e34e08e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:28:36 UTC) from {username='oryx', principal='oryx/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:35100
I20260809 05:28:36.470705 7564 tablet_service.cc:1514] Processing DeleteTablet for tablet 56da3c54f32b4303b5b7d34f2e34e08e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:28:36 UTC) from {username='oryx', principal='oryx/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:35100
I20260809 05:28:36.471071 7806 tablet_replica.cc:330] T 56da3c54f32b4303b5b7d34f2e34e08e P 7a8b9f85fd17482d9ad4b5a6f513e2e5: stopping tablet replica
I20260809 05:28:36.471312 7806 raft_consensus.cc:2229] T 56da3c54f32b4303b5b7d34f2e34e08e P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:28:36.471592 7806 raft_consensus.cc:2258] T 56da3c54f32b4303b5b7d34f2e34e08e P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:28:36.470505 6965 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46316:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 05:28:36.471860 7804 ts_tablet_manager.cc:1905] T 56da3c54f32b4303b5b7d34f2e34e08e P 572338af92db459a8f5280a611127d14: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:28:36.472075 7805 ts_tablet_manager.cc:1905] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260809 05:28:36.472210 6965 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 05:28:36.473201 7806 ts_tablet_manager.cc:1905] T 56da3c54f32b4303b5b7d34f2e34e08e P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:28:36.477730 7804 ts_tablet_manager.cc:1918] T 56da3c54f32b4303b5b7d34f2e34e08e P 572338af92db459a8f5280a611127d14: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:28:36.477864 7804 log.cc:1196] T 56da3c54f32b4303b5b7d34f2e34e08e P 572338af92db459a8f5280a611127d14: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-1/wal/wals/56da3c54f32b4303b5b7d34f2e34e08e
I20260809 05:28:36.478197 7804 ts_tablet_manager.cc:1939] T 56da3c54f32b4303b5b7d34f2e34e08e P 572338af92db459a8f5280a611127d14: Deleting consensus metadata
I20260809 05:28:36.479512 6948 catalog_manager.cc:4841] TS 572338af92db459a8f5280a611127d14 (127.26.185.2:36731): tablet 56da3c54f32b4303b5b7d34f2e34e08e (table test-table [id=2eae1f53e8524dab904b1b7de0d1e9f8]) successfully deleted
I20260809 05:28:36.480476 7805 ts_tablet_manager.cc:1918] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:28:36.480557 7806 ts_tablet_manager.cc:1918] T 56da3c54f32b4303b5b7d34f2e34e08e P 7a8b9f85fd17482d9ad4b5a6f513e2e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:28:36.480675 7805 log.cc:1196] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-0/wal/wals/56da3c54f32b4303b5b7d34f2e34e08e
I20260809 05:28:36.480854 7806 log.cc:1196] T 56da3c54f32b4303b5b7d34f2e34e08e P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-2/wal/wals/56da3c54f32b4303b5b7d34f2e34e08e
I20260809 05:28:36.481171 7805 ts_tablet_manager.cc:1939] T 56da3c54f32b4303b5b7d34f2e34e08e P 0b2af3406f404ecbbefaa61ac1e7ed28: Deleting consensus metadata
I20260809 05:28:36.481359 7806 ts_tablet_manager.cc:1939] T 56da3c54f32b4303b5b7d34f2e34e08e P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Deleting consensus metadata
I20260809 05:28:36.482693 6947 catalog_manager.cc:4841] TS 0b2af3406f404ecbbefaa61ac1e7ed28 (127.26.185.1:36911): tablet 56da3c54f32b4303b5b7d34f2e34e08e (table test-table [id=2eae1f53e8524dab904b1b7de0d1e9f8]) successfully deleted
W20260809 05:28:36.483340 6947 catalog_manager.cc:4808] TS 0b2af3406f404ecbbefaa61ac1e7ed28 (127.26.185.1:36911): delete failed for tablet 56da3c54f32b4303b5b7d34f2e34e08e because the tablet was not found. No further retry: Not found: Tablet not found: 56da3c54f32b4303b5b7d34f2e34e08e
I20260809 05:28:36.483489 6949 catalog_manager.cc:4841] TS 7a8b9f85fd17482d9ad4b5a6f513e2e5 (127.26.185.3:34453): tablet 56da3c54f32b4303b5b7d34f2e34e08e (table test-table [id=2eae1f53e8524dab904b1b7de0d1e9f8]) successfully deleted
W20260809 05:28:36.483814 6949 catalog_manager.cc:4808] TS 7a8b9f85fd17482d9ad4b5a6f513e2e5 (127.26.185.3:34453): delete failed for tablet 56da3c54f32b4303b5b7d34f2e34e08e because the tablet was not found. No further retry: Not found: Tablet not found: 56da3c54f32b4303b5b7d34f2e34e08e
I20260809 05:28:36.487361 7364 tablet_service.cc:1467] Processing CreateTablet for tablet 419b8a59a4e44652a641277bb2f16fff (DEFAULT_TABLE table=test-table [id=99ad96b6789b4346a0abe56d6d4cfcc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:28:36.487390 7168 tablet_service.cc:1467] Processing CreateTablet for tablet 419b8a59a4e44652a641277bb2f16fff (DEFAULT_TABLE table=test-table [id=99ad96b6789b4346a0abe56d6d4cfcc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:28:36.487540 7564 tablet_service.cc:1467] Processing CreateTablet for tablet 419b8a59a4e44652a641277bb2f16fff (DEFAULT_TABLE table=test-table [id=99ad96b6789b4346a0abe56d6d4cfcc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:28:36.487846 7364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 419b8a59a4e44652a641277bb2f16fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:36.487898 7168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 419b8a59a4e44652a641277bb2f16fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:36.488054 7564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 419b8a59a4e44652a641277bb2f16fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:36.494160 7828 tablet_bootstrap.cc:492] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14: Bootstrap starting.
I20260809 05:28:36.495075 7831 tablet_bootstrap.cc:492] T 419b8a59a4e44652a641277bb2f16fff P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Bootstrap starting.
I20260809 05:28:36.496044 7826 tablet_bootstrap.cc:492] T 419b8a59a4e44652a641277bb2f16fff P 0b2af3406f404ecbbefaa61ac1e7ed28: Bootstrap starting.
I20260809 05:28:36.496390 7828 tablet_bootstrap.cc:654] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:36.497215 7831 tablet_bootstrap.cc:654] T 419b8a59a4e44652a641277bb2f16fff P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:36.497998 7826 tablet_bootstrap.cc:654] T 419b8a59a4e44652a641277bb2f16fff P 0b2af3406f404ecbbefaa61ac1e7ed28: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:36.498980 7828 tablet_bootstrap.cc:492] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14: No bootstrap required, opened a new log
I20260809 05:28:36.499332 7828 ts_tablet_manager.cc:1397] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.005s
I20260809 05:28:36.499553 7831 tablet_bootstrap.cc:492] T 419b8a59a4e44652a641277bb2f16fff P 7a8b9f85fd17482d9ad4b5a6f513e2e5: No bootstrap required, opened a new log
I20260809 05:28:36.499752 7831 ts_tablet_manager.cc:1397] T 419b8a59a4e44652a641277bb2f16fff P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260809 05:28:36.500315 7828 raft_consensus.cc:348] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:36.500654 7828 raft_consensus.cc:374] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:36.500756 7828 raft_consensus.cc:729] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 572338af92db459a8f5280a611127d14, State: Initialized, Role: FOLLOWER
I20260809 05:28:36.500660 7831 raft_consensus.cc:348] T 419b8a59a4e44652a641277bb2f16fff P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:36.500856 7826 tablet_bootstrap.cc:492] T 419b8a59a4e44652a641277bb2f16fff P 0b2af3406f404ecbbefaa61ac1e7ed28: No bootstrap required, opened a new log
I20260809 05:28:36.500941 7831 raft_consensus.cc:374] T 419b8a59a4e44652a641277bb2f16fff P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:36.501034 7826 ts_tablet_manager.cc:1397] T 419b8a59a4e44652a641277bb2f16fff P 0b2af3406f404ecbbefaa61ac1e7ed28: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 05:28:36.501024 7831 raft_consensus.cc:729] T 419b8a59a4e44652a641277bb2f16fff P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a8b9f85fd17482d9ad4b5a6f513e2e5, State: Initialized, Role: FOLLOWER
I20260809 05:28:36.501087 7828 consensus_queue.cc:260] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:36.501353 7831 consensus_queue.cc:260] T 419b8a59a4e44652a641277bb2f16fff P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:36.502094 7831 ts_tablet_manager.cc:1428] T 419b8a59a4e44652a641277bb2f16fff P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260809 05:28:36.501935 7826 raft_consensus.cc:348] T 419b8a59a4e44652a641277bb2f16fff P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:36.502228 7826 raft_consensus.cc:374] T 419b8a59a4e44652a641277bb2f16fff P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:36.502314 7826 raft_consensus.cc:729] T 419b8a59a4e44652a641277bb2f16fff P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b2af3406f404ecbbefaa61ac1e7ed28, State: Initialized, Role: FOLLOWER
I20260809 05:28:36.502571 7826 consensus_queue.cc:260] T 419b8a59a4e44652a641277bb2f16fff P 0b2af3406f404ecbbefaa61ac1e7ed28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:36.503259 7826 ts_tablet_manager.cc:1428] T 419b8a59a4e44652a641277bb2f16fff P 0b2af3406f404ecbbefaa61ac1e7ed28: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 05:28:36.503865 7828 ts_tablet_manager.cc:1428] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260809 05:28:36.780525 7713 raft_consensus.cc:482] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:28:36.780905 7713 raft_consensus.cc:504] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:36.783108 7713 leader_election.cc:288] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b2af3406f404ecbbefaa61ac1e7ed28 (127.26.185.1:36911), 7a8b9f85fd17482d9ad4b5a6f513e2e5 (127.26.185.3:34453)
I20260809 05:28:36.790840 7769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:36.783521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:43943 (local address 127.26.185.1:36911)
0809 05:28:36.783811 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:36.783822 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:36.784660 (+ 838us) server_negotiation.cc:407] Connection header received
0809 05:28:36.785074 (+ 414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:36.785080 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:36.785179 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:36.785257 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:28:36.786178 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:36.787114 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:36.788947 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:36.789786 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:36.789975 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:36.790070 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:36.790363 (+ 293us) server_negotiation.cc:299] Negotiation successful
0809 05:28:36.790518 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260809 05:28:36.791085 7844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:36.783373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:36911 (local address 127.26.185.2:43943)
0809 05:28:36.784491 (+ 1118us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:36.784527 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:36.784825 (+ 298us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:36.785526 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:36.785531 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:36.785559 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:28:36.785979 (+ 420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:36.785990 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:36.787262 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:36.787269 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:36.788753 (+ 1484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:36.788766 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:36.789970 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:36.789977 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:36.790182 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:36.790209 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 05:28:36.790329 (+ 120us) client_negotiation.cc:240] Negotiation successful
0809 05:28:36.790489 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":880,"mutex_wait_us":1,"spinlock_wait_cycles":41344,"thread_start_us":651,"threads_started":1}
I20260809 05:28:36.791675 7845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:36.783483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:34453 (local address 127.26.185.2:47737)
0809 05:28:36.784941 (+ 1458us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:36.784963 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:36.785104 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:36.785643 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:36.785648 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:36.785749 (+ 101us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:28:36.786230 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:36.786240 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:36.787608 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:36.787619 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:36.789263 (+ 1644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:36.789277 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:36.790640 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:36.790648 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:36.790854 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:36.790881 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 05:28:36.791015 (+ 134us) client_negotiation.cc:240] Negotiation successful
0809 05:28:36.791199 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1289,"spinlock_wait_cycles":3200,"thread_start_us":1068,"threads_started":1}
I20260809 05:28:36.791755 7846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:36.783770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:47737 (local address 127.26.185.3:34453)
0809 05:28:36.785202 (+ 1432us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:36.785212 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:36.785234 (+ 22us) server_negotiation.cc:407] Connection header received
0809 05:28:36.785323 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:36.785330 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:36.785413 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:36.785551 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:28:36.786444 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:36.787435 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:36.789449 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:36.790387 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:36.790611 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:36.790701 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:36.791283 (+ 582us) server_negotiation.cc:299] Negotiation successful
0809 05:28:36.791454 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1290,"thread_start_us":1143,"threads_started":1}
I20260809 05:28:36.791975 7200 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "419b8a59a4e44652a641277bb2f16fff" candidate_uuid: "572338af92db459a8f5280a611127d14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" is_pre_election: true
I20260809 05:28:36.792380 7200 raft_consensus.cc:2454] T 419b8a59a4e44652a641277bb2f16fff P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572338af92db459a8f5280a611127d14 in term 0.
I20260809 05:28:36.792544 7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "419b8a59a4e44652a641277bb2f16fff" candidate_uuid: "572338af92db459a8f5280a611127d14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" is_pre_election: true
I20260809 05:28:36.792886 7593 raft_consensus.cc:2454] T 419b8a59a4e44652a641277bb2f16fff P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 572338af92db459a8f5280a611127d14 in term 0.
I20260809 05:28:36.793109 7301 leader_election.cc:302] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b2af3406f404ecbbefaa61ac1e7ed28, 572338af92db459a8f5280a611127d14; no voters:
I20260809 05:28:36.793717 7713 raft_consensus.cc:2781] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:28:36.793889 7713 raft_consensus.cc:482] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:28:36.794005 7713 raft_consensus.cc:3037] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:36.797003 7713 raft_consensus.cc:504] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:36.797693 7713 leader_election.cc:288] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14 [CANDIDATE]: Term 1 election: Requested vote from peers 0b2af3406f404ecbbefaa61ac1e7ed28 (127.26.185.1:36911), 7a8b9f85fd17482d9ad4b5a6f513e2e5 (127.26.185.3:34453)
I20260809 05:28:36.798357 7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "419b8a59a4e44652a641277bb2f16fff" candidate_uuid: "572338af92db459a8f5280a611127d14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5"
I20260809 05:28:36.798362 7200 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "419b8a59a4e44652a641277bb2f16fff" candidate_uuid: "572338af92db459a8f5280a611127d14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28"
I20260809 05:28:36.798612 7593 raft_consensus.cc:3037] T 419b8a59a4e44652a641277bb2f16fff P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:36.798621 7200 raft_consensus.cc:3037] T 419b8a59a4e44652a641277bb2f16fff P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:36.801059 7200 raft_consensus.cc:2454] T 419b8a59a4e44652a641277bb2f16fff P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572338af92db459a8f5280a611127d14 in term 1.
I20260809 05:28:36.801219 7593 raft_consensus.cc:2454] T 419b8a59a4e44652a641277bb2f16fff P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 572338af92db459a8f5280a611127d14 in term 1.
I20260809 05:28:36.801644 7301 leader_election.cc:302] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b2af3406f404ecbbefaa61ac1e7ed28, 572338af92db459a8f5280a611127d14; no voters:
I20260809 05:28:36.802049 7713 raft_consensus.cc:2781] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:28:36.802517 7713 raft_consensus.cc:686] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14 [term 1 LEADER]: Becoming Leader. State: Replica: 572338af92db459a8f5280a611127d14, State: Running, Role: LEADER
I20260809 05:28:36.803066 7713 consensus_queue.cc:237] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } }
I20260809 05:28:36.807643 6967 catalog_manager.cc:5495] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14 reported cstate change: term changed from 0 to 1, leader changed from <none> to 572338af92db459a8f5280a611127d14 (127.26.185.2). New cstate: current_term: 1 leader_uuid: "572338af92db459a8f5280a611127d14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "572338af92db459a8f5280a611127d14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 } health_report { overall_health: UNKNOWN } } }
I20260809 05:28:36.892750 7852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:36.885766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49004 (local address 127.26.185.2:36731)
0809 05:28:36.886551 (+ 785us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:36.886556 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:36.886584 (+ 28us) server_negotiation.cc:407] Connection header received
0809 05:28:36.886707 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:36.886711 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:36.886823 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:36.887130 (+ 307us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:28:36.887509 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:36.888458 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:36.889927 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:36.890437 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:36.890559 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:36.891072 (+ 513us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:28:36.891925 (+ 853us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:28:36.892076 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:36.892156 (+ 80us) server_negotiation.cc:299] Negotiation successful
0809 05:28:36.892254 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":647,"thread_start_us":439,"threads_started":1}
I20260809 05:28:36.913599 7846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:36.906892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:48557 (local address 127.26.185.3:34453)
0809 05:28:36.907346 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:36.907357 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:36.907898 (+ 541us) server_negotiation.cc:407] Connection header received
0809 05:28:36.908244 (+ 346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:36.908249 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:36.908336 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:36.908457 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:28:36.909044 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:36.909877 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:36.911516 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:36.911980 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:36.912147 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:36.912680 (+ 533us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:28:36.912817 (+ 137us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:28:36.912926 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:36.913101 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 05:28:36.913205 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260809 05:28:36.913686 7855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:36.906786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:34453 (local address 127.26.185.2:48557)
0809 05:28:36.907763 (+ 977us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:36.907781 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:36.908045 (+ 264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:36.908477 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:36.908482 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:36.908495 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 05:28:36.908856 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:36.908866 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:36.910040 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:36.910046 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:36.911362 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:36.911377 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:36.912202 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:36.912211 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:36.912363 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:36.912440 (+ 77us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 05:28:36.912932 (+ 492us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 05:28:36.912963 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 05:28:36.913058 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 05:28:36.913232 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":787,"thread_start_us":540,"threads_started":1}
I20260809 05:28:36.925730 7200 raft_consensus.cc:1261] T 419b8a59a4e44652a641277bb2f16fff P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 1 FOLLOWER]: Refusing update from remote peer 572338af92db459a8f5280a611127d14: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:28:36.926544 7593 raft_consensus.cc:1261] T 419b8a59a4e44652a641277bb2f16fff P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 1 FOLLOWER]: Refusing update from remote peer 572338af92db459a8f5280a611127d14: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:28:36.926638 7847 consensus_queue.cc:1035] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b2af3406f404ecbbefaa61ac1e7ed28" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 36911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:28:36.927369 7713 consensus_queue.cc:1035] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a8b9f85fd17482d9ad4b5a6f513e2e5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 34453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:28:36.961040 7862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:36.954270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:36731 (local address 127.26.185.3:59343)
0809 05:28:36.955169 (+ 899us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:36.955191 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:36.955397 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:36.955802 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:36.955807 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:36.955823 (+ 16us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 05:28:36.956168 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:36.956183 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:36.957343 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:36.957349 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:36.958826 (+ 1477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:36.958842 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:36.959691 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:36.959696 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:36.959866 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:36.959915 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 05:28:36.960339 (+ 424us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 05:28:36.960355 (+ 16us) client_negotiation.cc:769] Sending connection context
0809 05:28:36.960470 (+ 115us) client_negotiation.cc:240] Negotiation successful
0809 05:28:36.960650 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":690,"thread_start_us":507,"threads_started":1}
I20260809 05:28:36.961024 7852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:36.954807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:59343 (local address 127.26.185.2:36731)
0809 05:28:36.955115 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:36.955123 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:36.955300 (+ 177us) server_negotiation.cc:407] Connection header received
0809 05:28:36.955571 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:36.955577 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:36.955672 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:36.955782 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:28:36.956336 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:36.957171 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:36.958986 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:36.959505 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:36.959654 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:36.960098 (+ 444us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:28:36.960229 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:28:36.960337 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:36.960498 (+ 161us) server_negotiation.cc:299] Negotiation successful
0809 05:28:36.960603 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 05:28:37.001983 6966 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46316:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:28:37.002358 6966 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46316:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:28:37.006438 6966 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6a1b142f671d41ebb0a89f828720f546: Sending DeleteTablet for 3 replicas of tablet 419b8a59a4e44652a641277bb2f16fff
I20260809 05:28:37.007737 7168 tablet_service.cc:1514] Processing DeleteTablet for tablet 419b8a59a4e44652a641277bb2f16fff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:28:36 UTC) from {username='oryx', principal='oryx/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:33940
I20260809 05:28:37.007743 7364 tablet_service.cc:1514] Processing DeleteTablet for tablet 419b8a59a4e44652a641277bb2f16fff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:28:36 UTC) from {username='oryx', principal='oryx/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:49002
I20260809 05:28:37.009747 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 7077
I20260809 05:28:37.014082 7564 tablet_service.cc:1514] Processing DeleteTablet for tablet 419b8a59a4e44652a641277bb2f16fff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:28:36 UTC) from {username='oryx', principal='oryx/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:35100
I20260809 05:28:37.023738 7866 tablet_replica.cc:330] T 419b8a59a4e44652a641277bb2f16fff P 0b2af3406f404ecbbefaa61ac1e7ed28: stopping tablet replica
I20260809 05:28:37.024152 7866 raft_consensus.cc:2229] T 419b8a59a4e44652a641277bb2f16fff P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:28:37.024554 7866 raft_consensus.cc:2258] T 419b8a59a4e44652a641277bb2f16fff P 0b2af3406f404ecbbefaa61ac1e7ed28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:28:37.026609 7866 ts_tablet_manager.cc:1905] T 419b8a59a4e44652a641277bb2f16fff P 0b2af3406f404ecbbefaa61ac1e7ed28: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:28:37.030229 7869 tablet_replica.cc:330] T 419b8a59a4e44652a641277bb2f16fff P 7a8b9f85fd17482d9ad4b5a6f513e2e5: stopping tablet replica
I20260809 05:28:37.030663 7869 raft_consensus.cc:2229] T 419b8a59a4e44652a641277bb2f16fff P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:28:37.031224 7869 raft_consensus.cc:2258] T 419b8a59a4e44652a641277bb2f16fff P 7a8b9f85fd17482d9ad4b5a6f513e2e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:28:37.033221 7869 ts_tablet_manager.cc:1905] T 419b8a59a4e44652a641277bb2f16fff P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:28:37.033946 7867 tablet_replica.cc:330] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14: stopping tablet replica
I20260809 05:28:37.036684 7867 raft_consensus.cc:2229] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14 [term 1 LEADER]: Raft consensus shutting down.
I20260809 05:28:37.037763 7867 raft_consensus.cc:2258] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:28:37.040227 7867 ts_tablet_manager.cc:1905] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 09 05:28:37 dist-test-slave-h3ft krb5kdc[6907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253316, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.185.1@KRBTEST.COM
I20260809 05:28:37.048619 7869 ts_tablet_manager.cc:1918] T 419b8a59a4e44652a641277bb2f16fff P 7a8b9f85fd17482d9ad4b5a6f513e2e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 05:28:37.048822 7869 log.cc:1196] T 419b8a59a4e44652a641277bb2f16fff P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-2/wal/wals/419b8a59a4e44652a641277bb2f16fff
I20260809 05:28:37.049176 7866 ts_tablet_manager.cc:1918] T 419b8a59a4e44652a641277bb2f16fff P 0b2af3406f404ecbbefaa61ac1e7ed28: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 05:28:37.049365 7866 log.cc:1196] T 419b8a59a4e44652a641277bb2f16fff P 0b2af3406f404ecbbefaa61ac1e7ed28: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-0/wal/wals/419b8a59a4e44652a641277bb2f16fff
I20260809 05:28:37.050045 7866 ts_tablet_manager.cc:1939] T 419b8a59a4e44652a641277bb2f16fff P 0b2af3406f404ecbbefaa61ac1e7ed28: Deleting consensus metadata
I20260809 05:28:37.052204 6947 catalog_manager.cc:4841] TS 0b2af3406f404ecbbefaa61ac1e7ed28 (127.26.185.1:36911): tablet 419b8a59a4e44652a641277bb2f16fff (table test-table [id=99ad96b6789b4346a0abe56d6d4cfcc2]) successfully deleted
I20260809 05:28:37.053133 7769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:37.011555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33958 (local address 127.26.185.1:36911)
0809 05:28:37.011867 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:37.011878 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:37.029169 (+ 17291us) server_negotiation.cc:407] Connection header received
0809 05:28:37.029535 (+ 366us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:37.029542 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:37.029658 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:37.029805 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:37.032275 (+ 2470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:37.033539 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:37.035765 (+ 2226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:37.036538 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:37.036652 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:37.043419 (+ 6767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:37.043453 (+ 34us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:37.043484 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:37.043555 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:37.048088 (+ 4533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:37.049830 (+ 1742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:37.049842 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:37.049846 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:37.050083 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:37.050680 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:37.050685 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:37.050688 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:37.051379 (+ 691us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:37.051740 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:37.052432 (+ 692us) server_negotiation.cc:299] Negotiation successful
0809 05:28:37.052736 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260809 05:28:37.054808 7270 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:37.055430 7869 ts_tablet_manager.cc:1939] T 419b8a59a4e44652a641277bb2f16fff P 7a8b9f85fd17482d9ad4b5a6f513e2e5: Deleting consensus metadata
I20260809 05:28:37.055754 7867 ts_tablet_manager.cc:1918] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 05:28:37.055950 7867 log.cc:1196] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786253234117492-27364-0/minicluster-data/ts-1/wal/wals/419b8a59a4e44652a641277bb2f16fff
I20260809 05:28:37.057009 7867 ts_tablet_manager.cc:1939] T 419b8a59a4e44652a641277bb2f16fff P 572338af92db459a8f5280a611127d14: Deleting consensus metadata
I20260809 05:28:37.057618 6949 catalog_manager.cc:4841] TS 7a8b9f85fd17482d9ad4b5a6f513e2e5 (127.26.185.3:34453): tablet 419b8a59a4e44652a641277bb2f16fff (table test-table [id=99ad96b6789b4346a0abe56d6d4cfcc2]) successfully deleted
I20260809 05:28:37.058696 6948 catalog_manager.cc:4841] TS 572338af92db459a8f5280a611127d14 (127.26.185.2:36731): tablet 419b8a59a4e44652a641277bb2f16fff (table test-table [id=99ad96b6789b4346a0abe56d6d4cfcc2]) successfully deleted
I20260809 05:28:37.208324 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 7077
I20260809 05:28:37.251600 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 7279
Aug 09 05:28:37 dist-test-slave-h3ft krb5kdc[6907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253316, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.185.2@KRBTEST.COM
I20260809 05:28:37.273772 7852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:37.252707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49010 (local address 127.26.185.2:36731)
0809 05:28:37.252954 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:37.252963 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:37.253054 (+ 91us) server_negotiation.cc:407] Connection header received
0809 05:28:37.253335 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:37.253340 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:37.253444 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:37.253609 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:37.255644 (+ 2035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:37.256610 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:37.258627 (+ 2017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:37.259292 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:37.259411 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:37.265678 (+ 6267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:37.265694 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:37.265716 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:37.265777 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:37.270047 (+ 4270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:37.270918 (+ 871us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:37.270932 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:37.270936 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:37.271192 (+ 256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:37.271646 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:37.271652 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:37.271656 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:37.272199 (+ 543us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:37.272667 (+ 468us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:37.273006 (+ 339us) server_negotiation.cc:299] Negotiation successful
0809 05:28:37.273305 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 05:28:37.274718 7462 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:37.424640 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 7279
I20260809 05:28:37.462843 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 7475
I20260809 05:28:37.464654 7875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:37.463486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:36731 (local address 127.26.185.3:32851)
0809 05:28:37.464187 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:37.464375 (+ 188us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.2:36731: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":584,"threads_started":1}
W20260809 05:28:37.465143 7498 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.185.2:36731: connect: Connection refused (error 111)
I20260809 05:28:37.467803 7875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:37.467316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:36731 (local address 127.26.185.3:42347)
0809 05:28:37.467491 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:37.467608 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.2:36731: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260809 05:28:37.468096 7498 consensus_peers.cc:487] T b48e3669c9f34c8e9eea2cbebdf29711 P 7a8b9f85fd17482d9ad4b5a6f513e2e5 -> Peer 572338af92db459a8f5280a611127d14 (127.26.185.2:36731): Couldn't send request to peer 572338af92db459a8f5280a611127d14. Status: Network error: Client connection negotiation failed: client connection to 127.26.185.2:36731: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
Aug 09 05:28:37 dist-test-slave-h3ft krb5kdc[6907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253316, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.185.3@KRBTEST.COM
I20260809 05:28:37.481798 7877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:37.463916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35126 (local address 127.26.185.3:34453)
0809 05:28:37.464441 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:37.464447 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:37.464465 (+ 18us) server_negotiation.cc:407] Connection header received
0809 05:28:37.464529 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:37.464533 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:37.464625 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:37.464734 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:37.466428 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:37.467628 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:37.469126 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:37.469574 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:37.469679 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:37.474670 (+ 4991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:37.474686 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:37.474708 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:37.474768 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:37.478314 (+ 3546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:37.479199 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:37.479208 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:37.479211 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:37.479427 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:37.479846 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:37.479850 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:37.479852 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:37.480424 (+ 572us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:37.480737 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:37.481071 (+ 334us) server_negotiation.cc:299] Negotiation successful
0809 05:28:37.481363 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":345,"threads_started":1}
I20260809 05:28:37.482620 7660 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:37.634436 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 7475
I20260809 05:28:37.671453 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 6926
I20260809 05:28:37.673116 7029 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:37.813222 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 6926
2026-08-09T05:28:37Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (8506 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:28:37 dist-test-slave-h3ft krb5kdc[7884](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:28:37 dist-test-slave-h3ft krb5kdc[7884](info): set up 2 sockets
Aug 09 05:28:37 dist-test-slave-h3ft krb5kdc[7884](info): commencing operation
krb5kdc: starting...
W20260809 05:28:39.243955 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.364s user 0.000s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:28:39 dist-test-slave-h3ft krb5kdc[7884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253319, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:28:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:28:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
I20260809 05:28:39.612252 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:40853
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:37495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:40853
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:28:40.051136 7902 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:40.051573 7902 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:40.051757 7902 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:40.061357 7902 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:28:40.061550 7902 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:40.061652 7902 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:40.061772 7902 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:28:40.061875 7902 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:28:40.073944 7902 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:37495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:40853
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:40853
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:40.075985 7902 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:40.077863 7902 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:40.093904 7909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:40.093878 7910 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:40.093842 7914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:40.094974 7902 server_base.cc:1034] running on GCE node
I20260809 05:28:40.096168 7902 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:40.098179 7902 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:40.099478 7902 hybrid_clock.cc:648] HybridClock initialized: now 1786253320099423 us; error 56 us; skew 500 ppm
I20260809 05:28:40.100023 7902 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-09T05:28:40Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (2356 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:28:40 dist-test-slave-h3ft krb5kdc[7923](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:28:40 dist-test-slave-h3ft krb5kdc[7923](info): set up 2 sockets
Aug 09 05:28:40 dist-test-slave-h3ft krb5kdc[7923](info): commencing operation
krb5kdc: starting...
W20260809 05:28:41.599483 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.363s user 0.005s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:28:41 dist-test-slave-h3ft krb5kdc[7923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:28:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:28:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
I20260809 05:28:41.960722 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:33873
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:42839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:33873
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:28:42.387953 7939 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:42.388350 7939 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:42.388550 7939 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:42.396873 7939 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:28:42.397025 7939 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:42.397078 7939 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:42.397176 7939 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:28:42.397266 7939 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:28:42.408746 7939 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:42839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:33873
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:33873
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:42.410609 7939 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:42.412410 7939 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:42.427651 7944 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:42.427610 7947 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:42.427551 7945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:42.428665 7939 server_base.cc:1034] running on GCE node
I20260809 05:28:42.429751 7939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:42.431736 7939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:42.432993 7939 hybrid_clock.cc:648] HybridClock initialized: now 1786253322432915 us; error 67 us; skew 500 ppm
I20260809 05:28:42.433444 7939 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:28:42 dist-test-slave-h3ft krb5kdc[7923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253322, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:42.437674 7939 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:28:42.439709 7939 webserver.cc:460] Webserver started at http://127.26.185.62:46257/ using document root <none> and password file <none>
I20260809 05:28:42.440670 7939 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:42.440822 7939 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:42.441239 7939 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:28:42.445133 7939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "07974313bb6d4967b9a4acb8ff7e8bd6"
format_stamp: "Formatted at 2026-08-09 05:28:42 on dist-test-slave-h3ft"
server_key: "0d55a2ce5862bc33f2ae855c6d8428ff"
server_key_iv: "3ba196c16e19457a975695d31b4fb53b"
server_key_version: "encryptionkey@0"
I20260809 05:28:42.446081 7939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "07974313bb6d4967b9a4acb8ff7e8bd6"
format_stamp: "Formatted at 2026-08-09 05:28:42 on dist-test-slave-h3ft"
server_key: "0d55a2ce5862bc33f2ae855c6d8428ff"
server_key_iv: "3ba196c16e19457a975695d31b4fb53b"
server_key_version: "encryptionkey@0"
I20260809 05:28:42.452685 7939 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260809 05:28:42.456905 7956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:42.458648 7939 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 05:28:42.458915 7939 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "07974313bb6d4967b9a4acb8ff7e8bd6"
format_stamp: "Formatted at 2026-08-09 05:28:42 on dist-test-slave-h3ft"
server_key: "0d55a2ce5862bc33f2ae855c6d8428ff"
server_key_iv: "3ba196c16e19457a975695d31b4fb53b"
server_key_version: "encryptionkey@0"
I20260809 05:28:42.459278 7939 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:42.480367 7939 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:42.485613 7939 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:42.485922 7939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:42.508546 7939 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:33873
I20260809 05:28:42.508548 8038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:33873 every 8 connection(s)
I20260809 05:28:42.510471 7939 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:28:42.515731 8039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:28:42.520661 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 7939
I20260809 05:28:42.521013 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:28:42.521788 27364 external_mini_cluster.cc:1428] Setting key 277f88e472489619d884af7647ae02d5
I20260809 05:28:42.529743 8039 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6: Bootstrap starting.
I20260809 05:28:42.534941 8039 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6: Neither blocks nor log segments found. Creating new log.
I20260809 05:28:42.536727 8039 log.cc:824] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6: Log is configured to *not* fsync() on all Append() calls
Aug 09 05:28:42 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:28:42.541416 8039 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6: No bootstrap required, opened a new log
I20260809 05:28:42.552038 8043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:42.524419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49796 (local address 127.26.185.62:33873)
0809 05:28:42.525460 (+ 1041us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:42.525478 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:42.525537 (+ 59us) server_negotiation.cc:407] Connection header received
0809 05:28:42.527876 (+ 2339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:42.527908 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:42.528457 (+ 549us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:42.528866 (+ 409us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:42.531339 (+ 2473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:42.532936 (+ 1597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:42.535095 (+ 2159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:42.536035 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:42.536203 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:42.541885 (+ 5682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:42.541899 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:42.541927 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:42.541983 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:42.546064 (+ 4081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:42.547238 (+ 1174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:42.547247 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:42.547256 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:42.547476 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:42.548011 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:42.548017 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:42.548019 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:42.548954 (+ 935us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:42.549310 (+ 356us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:42.549895 (+ 585us) server_negotiation.cc:299] Negotiation successful
0809 05:28:42.550534 (+ 639us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":749,"thread_start_us":481,"threads_started":1}
I20260809 05:28:42.552201 8039 raft_consensus.cc:348] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07974313bb6d4967b9a4acb8ff7e8bd6" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33873 } }
I20260809 05:28:42.552788 8039 raft_consensus.cc:374] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:28:42.552927 8039 raft_consensus.cc:729] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07974313bb6d4967b9a4acb8ff7e8bd6, State: Initialized, Role: FOLLOWER
I20260809 05:28:42.553730 8039 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07974313bb6d4967b9a4acb8ff7e8bd6" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33873 } }
I20260809 05:28:42.554097 8039 raft_consensus.cc:388] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:28:42.554270 8039 raft_consensus.cc:482] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:28:42.554507 8039 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:28:42.557515 8039 raft_consensus.cc:504] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07974313bb6d4967b9a4acb8ff7e8bd6" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33873 } }
I20260809 05:28:42.558090 8039 leader_election.cc:302] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07974313bb6d4967b9a4acb8ff7e8bd6; no voters:
I20260809 05:28:42.558807 8039 leader_election.cc:288] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:28:42.559108 8046 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:28:42.560540 8046 raft_consensus.cc:686] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [term 1 LEADER]: Becoming Leader. State: Replica: 07974313bb6d4967b9a4acb8ff7e8bd6, State: Running, Role: LEADER
I20260809 05:28:42.561153 8046 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07974313bb6d4967b9a4acb8ff7e8bd6" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33873 } }
I20260809 05:28:42.561656 8039 sys_catalog.cc:564] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:28:42.565348 8048 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "07974313bb6d4967b9a4acb8ff7e8bd6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07974313bb6d4967b9a4acb8ff7e8bd6" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33873 } } }
I20260809 05:28:42.567504 8048 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [sys.catalog]: This master's current role is: LEADER
I20260809 05:28:42.565253 8049 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07974313bb6d4967b9a4acb8ff7e8bd6. Latest consensus state: current_term: 1 leader_uuid: "07974313bb6d4967b9a4acb8ff7e8bd6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07974313bb6d4967b9a4acb8ff7e8bd6" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33873 } } }
I20260809 05:28:42.568277 8049 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [sys.catalog]: This master's current role is: LEADER
I20260809 05:28:42.568873 8066 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:28:42.575901 8066 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:28:42.587702 8066 catalog_manager.cc:1347] Generated new cluster ID: 8a82a058cefc4186bc4575e6430feafe
I20260809 05:28:42.587870 8066 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:28:42.601692 8066 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:28:42.603753 8066 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:28:42.613575 8066 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6: Generated new TSK 0
I20260809 05:28:42.614841 8066 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.185.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
I20260809 05:28:42.712196 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:0
--local_ip_for_outbound_sockets=127.26.185.1
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:33873
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:42839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:28:43.161936 8079 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:43.162472 8079 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:43.162659 8079 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:43.171145 8079 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:43.171288 8079 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:43.171511 8079 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:28:43.183162 8079 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:42839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:33873
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:43.184998 8079 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:43.186750 8079 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:43.203329 8084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:43.203245 8090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:43.203299 8087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:43.204322 8079 server_base.cc:1034] running on GCE node
I20260809 05:28:43.205114 8079 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:43.206321 8079 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:43.207576 8079 hybrid_clock.cc:648] HybridClock initialized: now 1786253323207524 us; error 54 us; skew 500 ppm
I20260809 05:28:43.207976 8079 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:28:43 dist-test-slave-h3ft krb5kdc[7923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253323, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:43.211871 8079 init.cc:377] Logged in from keytab as kudu/127.26.185.1@KRBTEST.COM (short username kudu)
I20260809 05:28:43.213860 8079 webserver.cc:460] Webserver started at http://127.26.185.1:40293/ using document root <none> and password file <none>
I20260809 05:28:43.214828 8079 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:43.215036 8079 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:43.215461 8079 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:28:43.219199 8079 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-0/data/instance:
uuid: "f82c355832c4431b8b155f275ac19b78"
format_stamp: "Formatted at 2026-08-09 05:28:43 on dist-test-slave-h3ft"
server_key: "66641e2cac3012379b486ac919dd5405"
server_key_iv: "3c59fe21d4305de599d25a5374f5aa7c"
server_key_version: "encryptionkey@0"
I20260809 05:28:43.220171 8079 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance:
uuid: "f82c355832c4431b8b155f275ac19b78"
format_stamp: "Formatted at 2026-08-09 05:28:43 on dist-test-slave-h3ft"
server_key: "66641e2cac3012379b486ac919dd5405"
server_key_iv: "3c59fe21d4305de599d25a5374f5aa7c"
server_key_version: "encryptionkey@0"
I20260809 05:28:43.226897 8079 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260809 05:28:43.231355 8098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:43.233209 8079 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260809 05:28:43.233429 8079 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "f82c355832c4431b8b155f275ac19b78"
format_stamp: "Formatted at 2026-08-09 05:28:43 on dist-test-slave-h3ft"
server_key: "66641e2cac3012379b486ac919dd5405"
server_key_iv: "3c59fe21d4305de599d25a5374f5aa7c"
server_key_version: "encryptionkey@0"
I20260809 05:28:43.233693 8079 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:43.249388 8079 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:43.254642 8079 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:43.255016 8079 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:43.256311 8079 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:28:43.258006 8079 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:28:43.258126 8079 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:43.258297 8079 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:28:43.258376 8079 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:43.297768 8079 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:38561
I20260809 05:28:43.297807 8261 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:38561 every 8 connection(s)
I20260809 05:28:43.299494 8079 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:28:43.304706 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 8079
I20260809 05:28:43.304992 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance
I20260809 05:28:43.305742 27364 external_mini_cluster.cc:1428] Setting key 4c4e3406861a381db16240e333f77e2f
Aug 09 05:28:43 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253323, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:28:43.324486 8265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:43.302848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:57937 (local address 127.26.185.62:33873)
0809 05:28:43.303478 (+ 630us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:43.303484 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:43.304651 (+ 1167us) server_negotiation.cc:407] Connection header received
0809 05:28:43.307135 (+ 2484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:43.307142 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:43.307267 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:43.307402 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:43.309563 (+ 2161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:43.310377 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:43.312285 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:43.312801 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:43.312972 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:43.317344 (+ 4372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:43.317351 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:43.317354 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:43.317397 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:43.320558 (+ 3161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:43.321521 (+ 963us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:43.321526 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:43.321529 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:43.321681 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:43.322213 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:43.322217 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:43.322220 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:43.322552 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:43.322744 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:43.323741 (+ 997us) server_negotiation.cc:299] Negotiation successful
0809 05:28:43.324033 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":493,"thread_start_us":363,"threads_started":1}
I20260809 05:28:43.325827 8266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:43.303537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.1:57937)
0809 05:28:43.304430 (+ 893us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:43.304493 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:43.306722 (+ 2229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:43.307664 (+ 942us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:43.307675 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:43.308562 (+ 887us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:43.309344 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:43.309367 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:43.310576 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:43.310580 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:43.312109 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:43.312125 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:43.313110 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:43.313119 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:43.313410 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:43.314297 (+ 887us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:43.314326 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:43.317027 (+ 2701us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:43.320766 (+ 3739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:43.320778 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:43.320807 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:43.321357 (+ 550us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:43.321813 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:43.321818 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:43.321822 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:43.322058 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:43.322712 (+ 654us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:43.322721 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:43.323271 (+ 550us) client_negotiation.cc:769] Sending connection context
0809 05:28:43.323600 (+ 329us) client_negotiation.cc:240] Negotiation successful
0809 05:28:43.324331 (+ 731us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":388,"threads_started":1}
I20260809 05:28:43.328058 8263 heartbeater.cc:347] Connected to a master server at 127.26.185.62:33873
I20260809 05:28:43.328567 8263 heartbeater.cc:464] Registering TS with master...
I20260809 05:28:43.329756 8263 heartbeater.cc:511] Master 127.26.185.62:33873 requested a full tablet report, sending...
I20260809 05:28:43.333065 7984 ts_manager.cc:194] Registered new tserver with Master: f82c355832c4431b8b155f275ac19b78 (127.26.185.1:38561)
I20260809 05:28:43.334966 7984 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.1@KRBTEST.COM'} at 127.26.185.1:57937
WARNING: no policy specified for kudu/127.26.185.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
I20260809 05:28:43.389135 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:0
--local_ip_for_outbound_sockets=127.26.185.2
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:33873
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:42839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:28:43.819993 8269 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:43.820405 8269 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:43.820581 8269 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:43.828960 8269 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:43.829118 8269 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:43.829319 8269 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:28:43.841245 8269 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:42839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:33873
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:43.843482 8269 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:43.845395 8269 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:43.862200 8278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:43.862339 8275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:43.862159 8282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:43.867664 8269 server_base.cc:1034] running on GCE node
I20260809 05:28:43.868608 8269 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:43.869954 8269 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:43.871258 8269 hybrid_clock.cc:648] HybridClock initialized: now 1786253323871190 us; error 67 us; skew 500 ppm
I20260809 05:28:43.871728 8269 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:28:43 dist-test-slave-h3ft krb5kdc[7923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253323, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:43.875938 8269 init.cc:377] Logged in from keytab as kudu/127.26.185.2@KRBTEST.COM (short username kudu)
I20260809 05:28:43.878016 8269 webserver.cc:460] Webserver started at http://127.26.185.2:43109/ using document root <none> and password file <none>
I20260809 05:28:43.879060 8269 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:43.879257 8269 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:43.879683 8269 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:28:43.883625 8269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-1/data/instance:
uuid: "f7c52b15017b4166a6e36a993130f684"
format_stamp: "Formatted at 2026-08-09 05:28:43 on dist-test-slave-h3ft"
server_key: "7163d5968475de0473814f9606ff12ff"
server_key_iv: "8a7bf149ca36abd596b6eab82aa434ab"
server_key_version: "encryptionkey@0"
I20260809 05:28:43.884599 8269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance:
uuid: "f7c52b15017b4166a6e36a993130f684"
format_stamp: "Formatted at 2026-08-09 05:28:43 on dist-test-slave-h3ft"
server_key: "7163d5968475de0473814f9606ff12ff"
server_key_iv: "8a7bf149ca36abd596b6eab82aa434ab"
server_key_version: "encryptionkey@0"
I20260809 05:28:43.891091 8269 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260809 05:28:43.895383 8290 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:43.897099 8269 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260809 05:28:43.897310 8269 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "f7c52b15017b4166a6e36a993130f684"
format_stamp: "Formatted at 2026-08-09 05:28:43 on dist-test-slave-h3ft"
server_key: "7163d5968475de0473814f9606ff12ff"
server_key_iv: "8a7bf149ca36abd596b6eab82aa434ab"
server_key_version: "encryptionkey@0"
I20260809 05:28:43.897579 8269 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:43.934101 8269 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:43.940179 8269 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:43.940558 8269 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:43.941876 8269 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:28:43.943764 8269 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:28:43.943881 8269 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:43.944051 8269 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:28:43.944128 8269 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:43.984077 8269 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:38269
I20260809 05:28:43.984144 8447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:38269 every 8 connection(s)
I20260809 05:28:43.985793 8269 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:28:43.988569 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 8269
I20260809 05:28:43.988837 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance
I20260809 05:28:43.989499 27364 external_mini_cluster.cc:1428] Setting key 5b49ffbcae5ff42e59ab65bc2cd538d5
Aug 09 05:28:44 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253323, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:28:44.018103 8453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:43.991547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:34925 (local address 127.26.185.62:33873)
0809 05:28:43.992140 (+ 593us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:43.992154 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:43.993885 (+ 1731us) server_negotiation.cc:407] Connection header received
0809 05:28:43.996332 (+ 2447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:43.996342 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:43.996459 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:43.996612 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:43.998773 (+ 2161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:44.000071 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:44.002211 (+ 2140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:44.002839 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:44.002995 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:44.008734 (+ 5739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:44.008742 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:44.008746 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:44.008798 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:44.013426 (+ 4628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:44.014482 (+ 1056us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:44.014492 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:44.014499 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:44.014711 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:44.015338 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:44.015347 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:44.015354 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:44.015966 (+ 612us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:44.016171 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:44.017100 (+ 929us) server_negotiation.cc:299] Negotiation successful
0809 05:28:44.017451 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":293,"threads_started":1}
I20260809 05:28:44.019078 8454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:43.992620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.2:34925)
0809 05:28:43.993653 (+ 1033us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:43.993712 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:43.995970 (+ 2258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:43.997057 (+ 1087us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:43.997068 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:43.997807 (+ 739us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:43.998560 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:43.998582 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:44.000282 (+ 1700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:44.000287 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:44.002020 (+ 1733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:44.002035 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:44.003142 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:44.003151 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:44.003436 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:44.004408 (+ 972us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:44.004455 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:44.008316 (+ 3861us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:44.013667 (+ 5351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:44.013678 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:44.013700 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:44.014313 (+ 613us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:44.014883 (+ 570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:44.014887 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:44.014889 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:44.015207 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:44.016118 (+ 911us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:44.016125 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:44.016608 (+ 483us) client_negotiation.cc:769] Sending connection context
0809 05:28:44.016904 (+ 296us) client_negotiation.cc:240] Negotiation successful
0809 05:28:44.017469 (+ 565us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":685,"thread_start_us":456,"threads_started":1}
I20260809 05:28:44.021138 8449 heartbeater.cc:347] Connected to a master server at 127.26.185.62:33873
I20260809 05:28:44.021598 8449 heartbeater.cc:464] Registering TS with master...
I20260809 05:28:44.022928 8449 heartbeater.cc:511] Master 127.26.185.62:33873 requested a full tablet report, sending...
I20260809 05:28:44.025161 7984 ts_manager.cc:194] Registered new tserver with Master: f7c52b15017b4166a6e36a993130f684 (127.26.185.2:38269)
I20260809 05:28:44.026319 7984 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.2@KRBTEST.COM'} at 127.26.185.2:34925
WARNING: no policy specified for kudu/127.26.185.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
I20260809 05:28:44.079402 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:0
--local_ip_for_outbound_sockets=127.26.185.3
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:33873
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:42839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:28:44.340322 8263 heartbeater.cc:503] Master 127.26.185.62:33873 was elected leader, sending a full tablet report...
W20260809 05:28:44.520473 8457 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:44.520865 8457 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:44.520977 8457 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:44.528980 8457 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:44.529129 8457 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:44.529259 8457 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:28:44.541671 8457 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:42839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:33873
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:44.543614 8457 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:44.545405 8457 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:44.561991 8462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:44.562095 8463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:44.562021 8465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:44.564965 8457 server_base.cc:1034] running on GCE node
I20260809 05:28:44.565845 8457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:44.567200 8457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:44.568491 8457 hybrid_clock.cc:648] HybridClock initialized: now 1786253324568425 us; error 51 us; skew 500 ppm
I20260809 05:28:44.568993 8457 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:28:44 dist-test-slave-h3ft krb5kdc[7923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253324, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:44.573212 8457 init.cc:377] Logged in from keytab as kudu/127.26.185.3@KRBTEST.COM (short username kudu)
I20260809 05:28:44.575414 8457 webserver.cc:460] Webserver started at http://127.26.185.3:44117/ using document root <none> and password file <none>
I20260809 05:28:44.576426 8457 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:44.576606 8457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:44.577014 8457 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:28:44.581271 8457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-2/data/instance:
uuid: "94599e8c902d41678fa849ce362fc0d4"
format_stamp: "Formatted at 2026-08-09 05:28:44 on dist-test-slave-h3ft"
server_key: "d003d161d3226ce791f3617e3a450c62"
server_key_iv: "cda0abea9402389fcd63f3deb9ed187b"
server_key_version: "encryptionkey@0"
I20260809 05:28:44.582460 8457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance:
uuid: "94599e8c902d41678fa849ce362fc0d4"
format_stamp: "Formatted at 2026-08-09 05:28:44 on dist-test-slave-h3ft"
server_key: "d003d161d3226ce791f3617e3a450c62"
server_key_iv: "cda0abea9402389fcd63f3deb9ed187b"
server_key_version: "encryptionkey@0"
I20260809 05:28:44.590327 8457 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.003s
I20260809 05:28:44.594825 8479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:44.596694 8457 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:28:44.596946 8457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "94599e8c902d41678fa849ce362fc0d4"
format_stamp: "Formatted at 2026-08-09 05:28:44 on dist-test-slave-h3ft"
server_key: "d003d161d3226ce791f3617e3a450c62"
server_key_iv: "cda0abea9402389fcd63f3deb9ed187b"
server_key_version: "encryptionkey@0"
I20260809 05:28:44.597235 8457 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:44.616914 8457 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:44.622779 8457 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:44.623284 8457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:44.624598 8457 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:28:44.626405 8457 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:28:44.626523 8457 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:44.626703 8457 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:28:44.626787 8457 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:44.668596 8457 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:37617
I20260809 05:28:44.668637 8640 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:37617 every 8 connection(s)
I20260809 05:28:44.670387 8457 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:28:44.679631 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 8457
I20260809 05:28:44.679908 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance
I20260809 05:28:44.680580 27364 external_mini_cluster.cc:1428] Setting key fa29fb4bf90846cdbbd94b54106f2648
Aug 09 05:28:44 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253324, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:28:44.696152 8643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:44.673620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:42351 (local address 127.26.185.62:33873)
0809 05:28:44.674236 (+ 616us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:44.674246 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:44.675452 (+ 1206us) server_negotiation.cc:407] Connection header received
0809 05:28:44.677518 (+ 2066us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:44.677523 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:44.677627 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:44.677744 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:44.679712 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:44.680978 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:44.683613 (+ 2635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:44.684338 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:44.684500 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:44.689074 (+ 4574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:44.689080 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:44.689084 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:44.689131 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:44.692110 (+ 2979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:44.693092 (+ 982us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:44.693097 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:44.693100 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:44.693241 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:44.693903 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:44.693906 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:44.693908 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:44.694239 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:44.694370 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:44.695437 (+ 1067us) server_negotiation.cc:299] Negotiation successful
0809 05:28:44.695739 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":444,"thread_start_us":264,"threads_started":1}
I20260809 05:28:44.697616 8644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:44.674297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.3:42351)
0809 05:28:44.675264 (+ 967us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:44.675310 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:44.677211 (+ 1901us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:44.678042 (+ 831us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:44.678053 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:44.678677 (+ 624us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:44.679497 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:44.679519 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:44.681209 (+ 1690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:44.681214 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:44.683432 (+ 2218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:44.683449 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:44.684717 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:44.684726 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:44.685020 (+ 294us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:44.685928 (+ 908us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:44.685960 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:44.688767 (+ 2807us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:28:44.692313 (+ 3546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:44.692323 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:44.692345 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:44.692941 (+ 596us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:44.693525 (+ 584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:28:44.693529 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:28:44.693532 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:28:44.693777 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:28:44.694367 (+ 590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:28:44.694377 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:28:44.694841 (+ 464us) client_negotiation.cc:769] Sending connection context
0809 05:28:44.695273 (+ 432us) client_negotiation.cc:240] Negotiation successful
0809 05:28:44.695892 (+ 619us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":616,"thread_start_us":350,"threads_started":1}
I20260809 05:28:44.699652 8641 heartbeater.cc:347] Connected to a master server at 127.26.185.62:33873
I20260809 05:28:44.700035 8641 heartbeater.cc:464] Registering TS with master...
I20260809 05:28:44.700995 8641 heartbeater.cc:511] Master 127.26.185.62:33873 requested a full tablet report, sending...
I20260809 05:28:44.703154 7984 ts_manager.cc:194] Registered new tserver with Master: 94599e8c902d41678fa849ce362fc0d4 (127.26.185.3:37617)
I20260809 05:28:44.704145 7984 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.3@KRBTEST.COM'} at 127.26.185.3:42351
I20260809 05:28:44.711275 27364 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.26.185.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.185.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.185.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.1.keytab.
Entry for principal oryx/127.26.185.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.1.keytab.
WARNING: no policy specified for oryx/127.26.185.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.185.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.185.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.2.keytab.
Entry for principal oryx/127.26.185.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.2.keytab.
WARNING: no policy specified for oryx/127.26.185.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.185.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.185.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.3.keytab.
Entry for principal oryx/127.26.185.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.3.keytab.
I20260809 05:28:44.943255 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 8079
Aug 09 05:28:44 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.1@KRBTEST.COM
I20260809 05:28:44.964780 8654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:44.944868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59810 (local address 127.26.185.1:38561)
0809 05:28:44.946062 (+ 1194us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:44.946072 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:44.946109 (+ 37us) server_negotiation.cc:407] Connection header received
0809 05:28:44.946195 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:44.946204 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:44.946500 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:44.946681 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:44.948566 (+ 1885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:44.949750 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:44.951243 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:44.951938 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:44.952070 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:44.957401 (+ 5331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:44.957421 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:44.957445 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:44.957502 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:44.960956 (+ 3454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:44.962016 (+ 1060us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:44.962026 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:44.962029 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:44.962211 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:44.962747 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:44.962752 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:44.962755 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:44.963353 (+ 598us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:44.963683 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:44.964012 (+ 329us) server_negotiation.cc:299] Negotiation successful
0809 05:28:44.964300 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":973,"thread_start_us":783,"threads_started":1}
I20260809 05:28:44.966729 8256 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:45.031126 8449 heartbeater.cc:503] Master 127.26.185.62:33873 was elected leader, sending a full tablet report...
I20260809 05:28:45.064190 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 8079
I20260809 05:28:45.088953 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 8269
Aug 09 05:28:45 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.2@KRBTEST.COM
I20260809 05:28:45.110114 8656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:45.090192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46818 (local address 127.26.185.2:38269)
0809 05:28:45.091053 (+ 861us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:45.091072 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:45.091107 (+ 35us) server_negotiation.cc:407] Connection header received
0809 05:28:45.091192 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:45.091200 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:45.091510 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:45.091676 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:45.093140 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:45.094349 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:45.096023 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:45.096702 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:45.096814 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:45.102329 (+ 5515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:45.102352 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:45.102377 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:45.102440 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:45.106260 (+ 3820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:45.107309 (+ 1049us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:45.107319 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:45.107322 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:45.107502 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:45.108005 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:45.108010 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:45.108014 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:45.108496 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:45.108924 (+ 428us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:45.109286 (+ 362us) server_negotiation.cc:299] Negotiation successful
0809 05:28:45.109654 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":611,"thread_start_us":402,"threads_started":1}
I20260809 05:28:45.112128 8441 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:45.206311 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 8269
I20260809 05:28:45.239921 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 8457
Aug 09 05:28:45 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.3@KRBTEST.COM
I20260809 05:28:45.267175 8658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:45.241240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48744 (local address 127.26.185.3:37617)
0809 05:28:45.241954 (+ 714us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:45.241964 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:45.242000 (+ 36us) server_negotiation.cc:407] Connection header received
0809 05:28:45.242090 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:45.242100 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:45.242411 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:45.242608 (+ 197us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:45.244522 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:45.245799 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:45.247695 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:45.248495 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:45.248653 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:45.258715 (+ 10062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:45.258749 (+ 34us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:45.258774 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:45.258844 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:45.262936 (+ 4092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:45.264220 (+ 1284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:45.264232 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:45.264235 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:45.264460 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:45.265084 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:45.265089 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:45.265091 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:45.265588 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:45.266007 (+ 419us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:45.266309 (+ 302us) server_negotiation.cc:299] Negotiation successful
0809 05:28:45.266599 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":543,"thread_start_us":363,"threads_started":1}
I20260809 05:28:45.268944 8635 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:45.361232 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 8457
I20260809 05:28:45.392428 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 7939
I20260809 05:28:45.394188 8033 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:28:45.517493 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 7939
I20260809 05:28:45.554906 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:33873
--webserver_interface=127.26.185.62
--webserver_port=46257
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:42839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:33873
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:28:45.992673 8663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:45.993219 8663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:45.993430 8663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:46.002604 8663 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:28:46.002808 8663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:46.002907 8663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:46.003046 8663 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:28:46.003149 8663 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:28:46.014897 8663 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:42839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:33873
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:33873
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=46257
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:46.016980 8663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:46.018786 8663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:46.034372 8672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:46.034986 8671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:46.035318 8674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:46.036777 8663 server_base.cc:1034] running on GCE node
I20260809 05:28:46.038184 8663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:46.041046 8663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:46.043077 8663 hybrid_clock.cc:648] HybridClock initialized: now 1786253326042983 us; error 80 us; skew 500 ppm
I20260809 05:28:46.043687 8663 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:28:46 dist-test-slave-h3ft krb5kdc[7923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253326, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:46.049490 8663 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:28:46.052237 8663 webserver.cc:460] Webserver started at http://127.26.185.62:46257/ using document root <none> and password file <none>
I20260809 05:28:46.053624 8663 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:46.053853 8663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:46.063814 8663 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.007s sys 0.000s
I20260809 05:28:46.069752 8685 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:46.072448 8663 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.006s sys 0.000s
I20260809 05:28:46.072808 8663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "07974313bb6d4967b9a4acb8ff7e8bd6"
format_stamp: "Formatted at 2026-08-09 05:28:42 on dist-test-slave-h3ft"
server_key: "0d55a2ce5862bc33f2ae855c6d8428ff"
server_key_iv: "3ba196c16e19457a975695d31b4fb53b"
server_key_version: "encryptionkey@0"
I20260809 05:28:46.075075 8663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:46.096849 8663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:46.104254 8663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:46.104677 8663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:46.128557 8663 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:33873
I20260809 05:28:46.128559 8755 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:33873 every 8 connection(s)
I20260809 05:28:46.130638 8663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:28:46.137490 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 8663
I20260809 05:28:46.138687 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:38561
--local_ip_for_outbound_sockets=127.26.185.1
--tserver_master_addrs=127.26.185.62:33873
--webserver_port=40293
--webserver_interface=127.26.185.1
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:42839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.185.1
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.1.keytab with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:28:46.140321 8756 sys_catalog.cc:263] Verifying existing consensus state
I20260809 05:28:46.146742 8756 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6: Bootstrap starting.
I20260809 05:28:46.173691 8756 log.cc:824] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6: Log is configured to *not* fsync() on all Append() calls
I20260809 05:28:46.186292 8756 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 05:28:46.187071 8756 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6: Bootstrap complete.
I20260809 05:28:46.198207 8756 raft_consensus.cc:348] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07974313bb6d4967b9a4acb8ff7e8bd6" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33873 } }
I20260809 05:28:46.199304 8756 raft_consensus.cc:729] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07974313bb6d4967b9a4acb8ff7e8bd6, State: Initialized, Role: FOLLOWER
I20260809 05:28:46.200183 8756 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07974313bb6d4967b9a4acb8ff7e8bd6" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33873 } }
I20260809 05:28:46.200474 8756 raft_consensus.cc:388] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:28:46.200614 8756 raft_consensus.cc:482] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:28:46.200842 8756 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [term 1 FOLLOWER]: Advancing to term 2
I20260809 05:28:46.205623 8756 raft_consensus.cc:504] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07974313bb6d4967b9a4acb8ff7e8bd6" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33873 } }
I20260809 05:28:46.206298 8756 leader_election.cc:302] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07974313bb6d4967b9a4acb8ff7e8bd6; no voters:
I20260809 05:28:46.207147 8756 leader_election.cc:288] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 05:28:46.207309 8763 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 05:28:46.208992 8763 raft_consensus.cc:686] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [term 2 LEADER]: Becoming Leader. State: Replica: 07974313bb6d4967b9a4acb8ff7e8bd6, State: Running, Role: LEADER
I20260809 05:28:46.209708 8763 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07974313bb6d4967b9a4acb8ff7e8bd6" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33873 } }
I20260809 05:28:46.210075 8756 sys_catalog.cc:564] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:28:46.213379 8764 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "07974313bb6d4967b9a4acb8ff7e8bd6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07974313bb6d4967b9a4acb8ff7e8bd6" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33873 } } }
I20260809 05:28:46.213933 8764 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [sys.catalog]: This master's current role is: LEADER
I20260809 05:28:46.214588 8770 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07974313bb6d4967b9a4acb8ff7e8bd6. Latest consensus state: current_term: 2 leader_uuid: "07974313bb6d4967b9a4acb8ff7e8bd6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07974313bb6d4967b9a4acb8ff7e8bd6" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33873 } } }
I20260809 05:28:46.214965 8770 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6 [sys.catalog]: This master's current role is: LEADER
I20260809 05:28:46.226120 8776 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:28:46.233364 8776 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:28:46.235164 8776 catalog_manager.cc:1259] Loaded cluster ID: 8a82a058cefc4186bc4575e6430feafe
I20260809 05:28:46.235392 8776 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:28:46.239794 8776 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:28:46.241710 8776 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 07974313bb6d4967b9a4acb8ff7e8bd6: Loaded TSK: 0
I20260809 05:28:46.243865 8776 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 05:28:46.585651 8759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:46.586102 8759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:46.586280 8759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:46.594506 8759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:46.594709 8759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:46.594901 8759 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:28:46.606267 8759 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:42839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.1.keytab
--principal=oryx/127.26.185.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:38561
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=40293
--tserver_master_addrs=127.26.185.62:33873
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:46.608223 8759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:46.609906 8759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:46.627058 8805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:46.627086 8801 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:46.627158 8802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:46.627880 8759 server_base.cc:1034] running on GCE node
I20260809 05:28:46.628798 8759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:46.630103 8759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:46.631389 8759 hybrid_clock.cc:648] HybridClock initialized: now 1786253326631320 us; error 53 us; skew 500 ppm
I20260809 05:28:46.631825 8759 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:28:46 dist-test-slave-h3ft krb5kdc[7923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253326, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:46.636029 8759 init.cc:377] Logged in from keytab as oryx/127.26.185.1@KRBTEST.COM (short username oryx)
I20260809 05:28:46.637854 8759 webserver.cc:460] Webserver started at http://127.26.185.1:40293/ using document root <none> and password file <none>
I20260809 05:28:46.638782 8759 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:46.638964 8759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:46.645632 8759 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.002s
I20260809 05:28:46.649120 8814 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:46.651115 8759 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:28:46.651330 8759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "f82c355832c4431b8b155f275ac19b78"
format_stamp: "Formatted at 2026-08-09 05:28:43 on dist-test-slave-h3ft"
server_key: "66641e2cac3012379b486ac919dd5405"
server_key_iv: "3c59fe21d4305de599d25a5374f5aa7c"
server_key_version: "encryptionkey@0"
I20260809 05:28:46.652526 8759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:46.692258 8759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:46.697933 8759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:46.698302 8759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:46.699672 8759 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:28:46.701442 8759 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:28:46.701582 8759 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:46.701737 8759 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:28:46.701831 8759 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:46.743678 8759 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:38561
I20260809 05:28:46.743732 8982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:38561 every 8 connection(s)
I20260809 05:28:46.745878 8759 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:28:46.751711 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 8759
I20260809 05:28:46.752763 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:38269
--local_ip_for_outbound_sockets=127.26.185.2
--tserver_master_addrs=127.26.185.62:33873
--webserver_port=43109
--webserver_interface=127.26.185.2
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:42839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.185.2
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.2.keytab with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 05:28:46 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:46 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
W20260809 05:28:47.201874 8987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:47.202329 8987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:47.202503 8987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:47.210986 8987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:47.211225 8987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:47.211480 8987 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:28:47.223328 8987 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:42839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.2.keytab
--principal=oryx/127.26.185.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:38269
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=43109
--tserver_master_addrs=127.26.185.62:33873
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:47.225250 8987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:47.227150 8987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:47.246605 8995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:47.246604 8997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:47.248124 8994 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:47.249404 8987 server_base.cc:1034] running on GCE node
I20260809 05:28:47.250491 8987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:47.252097 8987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:47.255570 8987 hybrid_clock.cc:648] HybridClock initialized: now 1786253327255443 us; error 118 us; skew 500 ppm
I20260809 05:28:47.256141 8987 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:28:47 dist-test-slave-h3ft krb5kdc[7923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253327, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:47.261479 8987 init.cc:377] Logged in from keytab as oryx/127.26.185.2@KRBTEST.COM (short username oryx)
I20260809 05:28:47.264200 8987 webserver.cc:460] Webserver started at http://127.26.185.2:43109/ using document root <none> and password file <none>
I20260809 05:28:47.265277 8987 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:47.265497 8987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:47.273192 8987 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.002s sys 0.002s
I20260809 05:28:47.277088 9006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:47.279093 8987 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.004s
I20260809 05:28:47.279325 8987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "f7c52b15017b4166a6e36a993130f684"
format_stamp: "Formatted at 2026-08-09 05:28:43 on dist-test-slave-h3ft"
server_key: "7163d5968475de0473814f9606ff12ff"
server_key_iv: "8a7bf149ca36abd596b6eab82aa434ab"
server_key_version: "encryptionkey@0"
I20260809 05:28:47.280623 8987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:47.303838 8987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:47.309899 8987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:47.310289 8987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:47.311865 8987 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:28:47.313898 8987 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:28:47.314046 8987 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:47.314214 8987 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:28:47.314332 8987 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:47.372983 8987 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:38269
I20260809 05:28:47.373027 9164 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:38269 every 8 connection(s)
I20260809 05:28:47.375067 8987 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:28:47.376739 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 8987
I20260809 05:28:47.378002 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:37617
--local_ip_for_outbound_sockets=127.26.185.3
--tserver_master_addrs=127.26.185.62:33873
--webserver_port=44117
--webserver_interface=127.26.185.3
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:42839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.185.3
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.3.keytab with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 05:28:47 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:47 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
W20260809 05:28:47.925619 8986 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.159s user 0.001s sys 0.016s
W20260809 05:28:47.928354 8985 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:46.750208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:59779 (local address 127.26.185.62:33873)
0809 05:28:46.752284 (+ 2076us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:46.752298 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:46.752356 (+ 58us) server_negotiation.cc:407] Connection header received
0809 05:28:46.755834 (+ 3478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:46.755851 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:46.756381 (+ 530us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:46.756934 (+ 553us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:46.759412 (+ 2478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:46.760829 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:46.763644 (+ 2815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:46.764485 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:46.764662 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:47.927376 (+1162714us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.1:59779: BlockingRecv error: recv got EOF from 127.26.185.1:59779 (error 108)
Metrics: {"server-negotiator.queue_time_us":1811,"thread_start_us":314,"threads_started":1}
I20260809 05:28:47.928514 8986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:46.750446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.1:59779)
0809 05:28:46.751670 (+ 1224us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:46.751737 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:46.754939 (+ 3202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:46.757148 (+ 2209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:46.757162 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:46.758152 (+ 990us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:46.759118 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:46.759153 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:46.761055 (+ 1902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:46.761063 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:46.763444 (+ 2381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:46.763468 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:46.764793 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:46.764803 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:46.765182 (+ 379us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:46.766204 (+ 1022us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:46.766253 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:47.926766 (+1160513us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":816,"thread_start_us":547,"threads_started":1}
W20260809 05:28:47.929984 8983 heartbeater.cc:644] Failed to heartbeat to 127.26.185.62:33873 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.185.62:33873: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Aug 09 05:28:47 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:47 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
W20260809 05:28:47.944509 8985 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:47.931212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:46937 (local address 127.26.185.62:33873)
0809 05:28:47.931405 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:47.931412 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:47.931463 (+ 51us) server_negotiation.cc:407] Connection header received
0809 05:28:47.931745 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:47.931749 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:47.931827 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:47.931958 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:47.932881 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:47.933745 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:47.935291 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:47.935810 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:47.935991 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:47.944079 (+ 8088us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.1:46937: BlockingRecv error: recv got EOF from 127.26.185.1:46937 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 05:28:47.945616 8986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:47.930967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.1:46937)
0809 05:28:47.931356 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:47.931379 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:47.931565 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:47.931995 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:47.931999 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:47.932475 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:47.932698 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:47.932709 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:47.933920 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:47.933926 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:47.935131 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:47.935147 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:47.936034 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:47.936040 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:47.936235 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:47.937028 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:47.937050 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:47.945078 (+ 8028us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":234}
Aug 09 05:28:47 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:47 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:47.964200 8986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:47.946989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.1:37085)
0809 05:28:47.947439 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:47.947470 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:47.947695 (+ 225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:47.948302 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:47.948310 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:47.949068 (+ 758us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:47.949442 (+ 374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:47.949462 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:47.951284 (+ 1822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:47.951294 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:47.953876 (+ 2582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:47.953908 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:47.955122 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:47.955132 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:47.955456 (+ 324us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:47.956596 (+ 1140us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:47.956635 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:47.963651 (+ 7016us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":244}
W20260809 05:28:47.964267 8985 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:47.947187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:37085 (local address 127.26.185.62:33873)
0809 05:28:47.947440 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:47.947450 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:47.947600 (+ 150us) server_negotiation.cc:407] Connection header received
0809 05:28:47.947923 (+ 323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:47.947933 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:47.948058 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:47.948201 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:47.949711 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:47.951038 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:47.954137 (+ 3099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:47.954848 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:47.955040 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:47.963990 (+ 8950us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.1:37085: BlockingRecv error: recv got EOF from 127.26.185.1:37085 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
W20260809 05:28:47.965257 8983 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 05:28:48.102900 9169 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:28:48.103356 9169 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:28:48.103544 9169 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:28:48.112135 9169 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:28:48.112347 9169 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:28:48.112563 9169 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:28:48.123621 9169 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:42839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/krb5kdc/oryx_127.26.185.3.keytab
--principal=oryx/127.26.185.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:37617
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=44117
--tserver_master_addrs=127.26.185.62:33873
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:28:48.125592 9169 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:28:48.127388 9169 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:28:48.149855 9176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:48.150220 9178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:28:48.150767 9175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:28:48.151883 9169 server_base.cc:1034] running on GCE node
I20260809 05:28:48.152817 9169 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:28:48.154285 9169 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:28:48.157735 9169 hybrid_clock.cc:648] HybridClock initialized: now 1786253328157620 us; error 93 us; skew 500 ppm
I20260809 05:28:48.158406 9169 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:28:48 dist-test-slave-h3ft krb5kdc[7923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253328, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.185.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:28:48.165222 9169 init.cc:377] Logged in from keytab as oryx/127.26.185.3@KRBTEST.COM (short username oryx)
I20260809 05:28:48.168262 9169 webserver.cc:460] Webserver started at http://127.26.185.3:44117/ using document root <none> and password file <none>
I20260809 05:28:48.169858 9169 fs_manager.cc:359] Metadata directory not provided
I20260809 05:28:48.170118 9169 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:28:48.182623 9169 fs_manager.cc:709] Time spent opening directory manager: real 0.008s user 0.009s sys 0.000s
I20260809 05:28:48.188524 9191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:48.191505 9169 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.007s sys 0.000s
I20260809 05:28:48.191879 9169 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "94599e8c902d41678fa849ce362fc0d4"
format_stamp: "Formatted at 2026-08-09 05:28:44 on dist-test-slave-h3ft"
server_key: "d003d161d3226ce791f3617e3a450c62"
server_key_iv: "cda0abea9402389fcd63f3deb9ed187b"
server_key_version: "encryptionkey@0"
I20260809 05:28:48.194319 9169 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:28:48.242579 9169 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:28:48.252795 9169 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:28:48.253364 9169 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:28:48.255615 9169 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:28:48.258890 9169 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:28:48.259085 9169 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260809 05:28:48.259280 9169 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:28:48.259413 9169 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:28:48.307132 9169 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:37617
I20260809 05:28:48.307180 9357 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:37617 every 8 connection(s)
I20260809 05:28:48.310417 9169 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:28:48.317842 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 9169
Aug 09 05:28:48 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:48 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:48.359891 9362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:48.319275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49798 (local address 127.26.185.62:33873)
0809 05:28:48.335155 (+ 15880us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:48.335161 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:48.335182 (+ 21us) server_negotiation.cc:407] Connection header received
0809 05:28:48.335259 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:48.335264 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:48.335355 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:48.335489 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:48.339059 (+ 3570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:48.340562 (+ 1503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:48.343511 (+ 2949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:48.344394 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:48.344556 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:48.350142 (+ 5586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:28:48.350162 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:28:48.350206 (+ 44us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:28:48.350294 (+ 88us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:28:48.355255 (+ 4961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:48.356241 (+ 986us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:48.356251 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:48.356261 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:48.356492 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:28:48.356985 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:28:48.356989 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:28:48.356992 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:28:48.357801 (+ 809us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:28:48.358319 (+ 518us) server_negotiation.cc:1035] Waiting for connection context
0809 05:28:48.358824 (+ 505us) server_negotiation.cc:299] Negotiation successful
0809 05:28:48.359543 (+ 719us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15683,"thread_start_us":14553,"threads_started":1}
W20260809 05:28:48.736528 9167 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.340s user 0.004s sys 0.019s
W20260809 05:28:48.739356 9168 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:47.382690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:46593 (local address 127.26.185.62:33873)
0809 05:28:47.387574 (+ 4884us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:47.387583 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:47.387617 (+ 34us) server_negotiation.cc:407] Connection header received
0809 05:28:47.387714 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:47.387722 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:47.387850 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:47.388012 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:47.390510 (+ 2498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:47.391637 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:47.393684 (+ 2047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:47.394205 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:47.394377 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:48.738788 (+1344411us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.2:46593: BlockingRecv error: recv got EOF from 127.26.185.2:46593 (error 108)
Metrics: {"server-negotiator.queue_time_us":4686,"thread_start_us":4513,"threads_started":1}
I20260809 05:28:48.740682 9167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:47.381595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.2:46593)
0809 05:28:47.383085 (+ 1490us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:47.383183 (+ 98us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:47.387051 (+ 3868us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:47.388640 (+ 1589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:47.388652 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:47.389421 (+ 769us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:47.390223 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:47.390248 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:47.391871 (+ 1623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:47.391876 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:47.393472 (+ 1596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:47.393489 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:47.394555 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:47.394565 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:47.394975 (+ 410us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:47.396184 (+ 1209us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:47.396221 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:48.738405 (+1342184us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":967,"thread_start_us":1461,"threads_started":1}
W20260809 05:28:48.742100 9165 heartbeater.cc:644] Failed to heartbeat to 127.26.185.62:33873 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.185.62:33873: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Aug 09 05:28:48 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:48 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
W20260809 05:28:48.756172 9168 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:48.743129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:40701 (local address 127.26.185.62:33873)
0809 05:28:48.743446 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:48.743451 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:48.743725 (+ 274us) server_negotiation.cc:407] Connection header received
0809 05:28:48.743984 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:48.743994 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:48.744086 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:48.744211 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:48.745233 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:48.746121 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:48.747774 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:48.748296 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:48.748467 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:48.755909 (+ 7442us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.2:40701: BlockingRecv error: recv got EOF from 127.26.185.2:40701 (error 108)
Metrics: {"server-negotiator.queue_time_us":184}
I20260809 05:28:48.756457 9167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:48.743109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.2:40701)
0809 05:28:48.743607 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:48.743625 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:48.743822 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:48.744262 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:48.744268 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:48.744805 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:48.745045 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:48.745057 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:48.746325 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:48.746342 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:48.747576 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:48.747601 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:48.748532 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:48.748539 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:48.748749 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:48.749652 (+ 903us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:48.749677 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:48.755697 (+ 6020us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":367}
Aug 09 05:28:48 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:48 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:48.771538 9167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:48.757707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.2:44975)
0809 05:28:48.758002 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:48.758036 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:48.758249 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:48.758713 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:48.758722 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:48.759574 (+ 852us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:48.759997 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:48.760021 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:48.761329 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:48.761338 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:48.763914 (+ 2576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:48.763957 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:48.764861 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:48.764871 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:48.765192 (+ 321us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:48.766244 (+ 1052us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:48.766268 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:48.771267 (+ 4999us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":66}
W20260809 05:28:48.771967 9165 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 05:28:48.772306 9168 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:48.757993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:44975 (local address 127.26.185.62:33873)
0809 05:28:48.758182 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:48.758187 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:48.758206 (+ 19us) server_negotiation.cc:407] Connection header received
0809 05:28:48.758415 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:48.758419 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:48.758497 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:48.758590 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:48.760227 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:48.761118 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:48.764157 (+ 3039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:48.764634 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:48.764746 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:48.771785 (+ 7039us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.2:44975: BlockingRecv error: recv got EOF from 127.26.185.2:44975 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 09 05:28:48 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:48 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:48.982090 9365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:48.966524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.1:52987)
0809 05:28:48.967377 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:48.967407 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:48.967652 (+ 245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:48.968180 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:48.968188 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:48.968796 (+ 608us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:48.968997 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:48.969008 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:48.970576 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:48.970587 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:48.973211 (+ 2624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:48.973246 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:48.974256 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:48.974268 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:48.974593 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:48.975649 (+ 1056us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:48.975691 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:48.981613 (+ 5922us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":727,"thread_start_us":532,"threads_started":1}
W20260809 05:28:48.982256 9168 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:48.966602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:52987 (local address 127.26.185.62:33873)
0809 05:28:48.966855 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:48.966864 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:48.967560 (+ 696us) server_negotiation.cc:407] Connection header received
0809 05:28:48.967850 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:48.967855 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:48.967967 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:48.968099 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:48.969239 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:48.970317 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:48.973456 (+ 3139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:48.973959 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:48.974103 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:48.981957 (+ 7854us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.1:52987: BlockingRecv error: recv got EOF from 127.26.185.1:52987 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260809 05:28:49.498855 9360 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.165s user 0.004s sys 0.016s
W20260809 05:28:49.500361 8985 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:48.314597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:34409 (local address 127.26.185.62:33873)
0809 05:28:48.314844 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:48.314849 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:48.317297 (+ 2448us) server_negotiation.cc:407] Connection header received
0809 05:28:48.320863 (+ 3566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:48.320875 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:48.321026 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:48.321146 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:48.324902 (+ 3756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:48.326514 (+ 1612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:48.330408 (+ 3894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:48.331486 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:48.331666 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:49.500122 (+1168456us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.3:34409: BlockingRecv error: recv got EOF from 127.26.185.3:34409 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 05:28:49.501256 9360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:48.315923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.3:34409)
0809 05:28:48.317026 (+ 1103us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:48.317090 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:48.320319 (+ 3229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:48.322004 (+ 1685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:48.322024 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:48.323266 (+ 1242us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:48.324556 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:48.324592 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:48.326827 (+ 2235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:48.326835 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:48.330133 (+ 3298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:48.330161 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:48.332293 (+ 2132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:48.332303 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:48.332821 (+ 518us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:48.334017 (+ 1196us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:48.334059 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:49.499907 (+1165848us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":762,"thread_start_us":465,"threads_started":1}
W20260809 05:28:49.502355 9358 heartbeater.cc:644] Failed to heartbeat to 127.26.185.62:33873 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.185.62:33873: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Aug 09 05:28:49 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:49 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:49.514325 9360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:49.503233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.3:48683)
0809 05:28:49.503492 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:49.503516 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:49.503665 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:49.504018 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:49.504021 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:49.504498 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:49.504783 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:49.504801 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:49.506162 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:49.506168 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:49.507578 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:49.507597 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:49.508382 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:49.508389 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:49.508546 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:49.509393 (+ 847us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:49.509419 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:49.514068 (+ 4649us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":74}
W20260809 05:28:49.514586 8985 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:49.503328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:48683 (local address 127.26.185.62:33873)
0809 05:28:49.503666 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:49.503671 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:49.503690 (+ 19us) server_negotiation.cc:407] Connection header received
0809 05:28:49.503798 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:49.503807 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:49.503883 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:49.503972 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:49.504973 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:49.505966 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:49.507721 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:49.508176 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:49.508278 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:49.514308 (+ 6030us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.3:48683: BlockingRecv error: recv got EOF from 127.26.185.3:48683 (error 108)
Metrics: {"server-negotiator.queue_time_us":165}
Aug 09 05:28:49 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:49 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:49.524338 9360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:49.515285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.3:49369)
0809 05:28:49.515475 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:49.515498 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:49.515628 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:49.516011 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:49.516017 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:49.516373 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:49.516556 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:49.516565 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:49.517665 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:49.517670 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:49.518780 (+ 1110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:49.518797 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:49.519605 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:49.519610 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:49.519749 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:49.520374 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:49.520393 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:49.524105 (+ 3712us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":59}
W20260809 05:28:49.524631 8985 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:49.515394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:49369 (local address 127.26.185.62:33873)
0809 05:28:49.515589 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:49.515594 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:49.515613 (+ 19us) server_negotiation.cc:407] Connection header received
0809 05:28:49.515784 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:49.515793 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:49.515860 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:49.515968 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:49.516703 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:49.517505 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:49.518912 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:49.519458 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:49.519562 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:49.524352 (+ 4790us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.3:49369: BlockingRecv error: recv got EOF from 127.26.185.3:49369 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260809 05:28:49.524665 9358 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 09 05:28:49 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:49 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:49.783965 9366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:49.772844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.2:38267)
0809 05:28:49.773495 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:49.773513 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:49.773652 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:49.774013 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:49.774016 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:49.774564 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:49.774741 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:49.774751 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:49.775895 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:49.775900 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:49.776953 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:49.776966 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:49.777728 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:49.777734 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:49.777892 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:49.778659 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:49.778683 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:49.783506 (+ 4823us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":393,"threads_started":1}
W20260809 05:28:49.784174 8985 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:49.772904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:38267 (local address 127.26.185.62:33873)
0809 05:28:49.773194 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:49.773205 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:49.773611 (+ 406us) server_negotiation.cc:407] Connection header received
0809 05:28:49.773759 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:49.773764 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:49.773859 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:49.773948 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:49.774879 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:49.775725 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:49.777096 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:49.777504 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:49.777615 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:49.783834 (+ 6219us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.2:38267: BlockingRecv error: recv got EOF from 127.26.185.2:38267 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 09 05:28:49 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:49 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:49.995330 9367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:49.983882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.1:58839)
0809 05:28:49.984837 (+ 955us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:49.984869 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:49.985057 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:49.985573 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:49.985578 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:49.986229 (+ 651us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:49.986553 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:49.986580 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:49.987731 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:49.987735 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:49.988761 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:49.988774 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:49.989579 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:49.989584 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:49.989732 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:49.990455 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:49.990475 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:49.994862 (+ 4387us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":792,"thread_start_us":614,"threads_started":1}
W20260809 05:28:49.995520 8985 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:49.983992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:58839 (local address 127.26.185.62:33873)
0809 05:28:49.984316 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:49.984326 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:49.984995 (+ 669us) server_negotiation.cc:407] Connection header received
0809 05:28:49.985265 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:49.985273 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:49.985383 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:49.985505 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:49.986738 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:49.987587 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:49.988900 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:49.989401 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:49.989506 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:49.995187 (+ 5681us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.1:58839: BlockingRecv error: recv got EOF from 127.26.185.1:58839 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 09 05:28:50 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:50 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:50.540453 9368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:50.525416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.3:46461)
0809 05:28:50.526137 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:50.526157 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:50.526308 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:50.526731 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:50.526736 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:50.527419 (+ 683us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:50.527621 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:50.527633 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:50.528849 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:50.528853 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:50.530204 (+ 1351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:50.530219 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:50.531167 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:50.531174 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:50.531383 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:50.535769 (+ 4386us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:50.535794 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:50.540026 (+ 4232us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":387,"threads_started":1}
W20260809 05:28:50.540727 9369 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:50.525552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:46461 (local address 127.26.185.62:33873)
0809 05:28:50.526165 (+ 613us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:50.526171 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:50.526247 (+ 76us) server_negotiation.cc:407] Connection header received
0809 05:28:50.526424 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:50.526428 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:50.526505 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:50.526631 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:50.527774 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:50.528698 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:50.530350 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:50.530925 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:50.531124 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:50.540364 (+ 9240us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.3:46461: BlockingRecv error: recv got EOF from 127.26.185.3:46461 (error 108)
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":317,"threads_started":1}
Aug 09 05:28:50 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:50 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:50.796252 9370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:50.785502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.2:43925)
0809 05:28:50.786318 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:50.786338 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:50.786616 (+ 278us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:50.787058 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:50.787064 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:50.787673 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:50.787898 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:50.787910 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:50.789056 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:50.789062 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:50.790052 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:50.790066 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:50.790888 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:50.790895 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:50.791139 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:50.791866 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:50.791887 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:50.795836 (+ 3949us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":679,"thread_start_us":531,"threads_started":1}
W20260809 05:28:50.796388 9369 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:50.785502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:43925 (local address 127.26.185.62:33873)
0809 05:28:50.785806 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:50.785816 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:50.786445 (+ 629us) server_negotiation.cc:407] Connection header received
0809 05:28:50.786770 (+ 325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:50.786777 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:50.786868 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:50.786983 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:50.788081 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:50.788894 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:50.790243 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:50.790707 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:50.790864 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:50.796112 (+ 5248us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.2:43925: BlockingRecv error: recv got EOF from 127.26.185.2:43925 (error 108)
Metrics: {"server-negotiator.queue_time_us":111}
Aug 09 05:28:50 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:50 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:51.008249 9371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:50.996742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.1:36459)
0809 05:28:50.997520 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:50.997542 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:50.997700 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:50.998090 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:50.998094 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:50.998566 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:50.998769 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:50.998778 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:51.000101 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:51.000106 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:51.001290 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:51.001306 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:51.002101 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:51.002108 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:51.002310 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:51.003137 (+ 827us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:51.003158 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:51.007772 (+ 4614us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":630,"thread_start_us":430,"threads_started":1}
W20260809 05:28:51.008409 9369 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:50.996923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:36459 (local address 127.26.185.62:33873)
0809 05:28:50.997168 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:50.997174 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:50.997643 (+ 469us) server_negotiation.cc:407] Connection header received
0809 05:28:50.997826 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:50.997831 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:50.997911 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:50.998011 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:50.998921 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:50.999903 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:51.001454 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:51.001920 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:51.002063 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:51.008090 (+ 6027us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.1:36459: BlockingRecv error: recv got EOF from 127.26.185.1:36459 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
Aug 09 05:28:51 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:51 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:51.553920 9374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:51.541804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.3:42497)
0809 05:28:51.542448 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:51.542470 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:51.542624 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:51.543310 (+ 686us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:51.543314 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:51.543869 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:51.544121 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:51.544132 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:51.545592 (+ 1460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:51.545598 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:51.546603 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:51.546616 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:51.547714 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:51.547719 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:51.547860 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:51.548753 (+ 893us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:51.548774 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:51.553573 (+ 4799us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":335,"threads_started":1}
W20260809 05:28:51.554314 9373 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:51.541862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:42497 (local address 127.26.185.62:33873)
0809 05:28:51.542912 (+ 1050us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:51.542917 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:51.542935 (+ 18us) server_negotiation.cc:407] Connection header received
0809 05:28:51.543018 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:51.543022 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:51.543099 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:51.543203 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:51.544349 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:51.545403 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:51.546819 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:51.547545 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:51.547693 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:51.553943 (+ 6250us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.3:42497: BlockingRecv error: recv got EOF from 127.26.185.3:42497 (error 108)
Metrics: {"server-negotiator.queue_time_us":914,"thread_start_us":777,"threads_started":1}
Aug 09 05:28:51 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:51 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:51.809330 9375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:51.797954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.2:49311)
0809 05:28:51.798694 (+ 740us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:51.798715 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:51.798994 (+ 279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:51.799514 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:51.799519 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:51.800248 (+ 729us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:51.800509 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:51.800521 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:51.801664 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:51.801668 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:51.802707 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:51.802721 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:51.803596 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:51.803601 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:51.803751 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:51.804581 (+ 830us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:51.804601 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:51.808891 (+ 4290us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":589,"thread_start_us":377,"threads_started":1}
W20260809 05:28:51.809485 9373 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:51.798389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:49311 (local address 127.26.185.62:33873)
0809 05:28:51.798602 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:51.798609 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:51.798847 (+ 238us) server_negotiation.cc:407] Connection header received
0809 05:28:51.799185 (+ 338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:51.799191 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:51.799293 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:51.799419 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:51.800665 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:51.801507 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:51.802849 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:51.803443 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:51.803546 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:51.809194 (+ 5648us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.2:49311: BlockingRecv error: recv got EOF from 127.26.185.2:49311 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 09 05:28:52 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:52 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:52.023252 9376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:52.009905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.1:33833)
0809 05:28:52.012566 (+ 2661us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:52.012603 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:52.012777 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:52.013198 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:52.013202 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:52.013710 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:52.013910 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:52.013920 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:52.015137 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:52.015142 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:52.016271 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:52.016286 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:52.017055 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:52.017060 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:52.017224 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:52.017983 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:52.018003 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:52.022869 (+ 4866us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":2513,"thread_start_us":2342,"threads_started":1}
W20260809 05:28:52.023461 9373 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:52.009955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:33833 (local address 127.26.185.62:33873)
0809 05:28:52.010200 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:52.010208 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:52.012718 (+ 2510us) server_negotiation.cc:407] Connection header received
0809 05:28:52.012910 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:52.012915 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:52.013016 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:52.013115 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:52.014057 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:52.014922 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:52.016421 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:52.016894 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:52.017001 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:52.023194 (+ 6193us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.1:33833: BlockingRecv error: recv got EOF from 127.26.185.1:33833 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 09 05:28:52 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:52 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:52.566879 9378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:52.555290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.3:49481)
0809 05:28:52.555993 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:52.556014 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:52.556163 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:52.556635 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:52.556639 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:52.557115 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:52.557330 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:52.557341 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:52.558781 (+ 1440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:52.558786 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:52.559901 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:52.559916 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:52.560731 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:52.560736 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:52.560899 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:52.561661 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:52.561682 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:52.566447 (+ 4765us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":385,"threads_started":1}
W20260809 05:28:52.567225 9379 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:52.555338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:49481 (local address 127.26.185.62:33873)
0809 05:28:52.556016 (+ 678us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:52.556021 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:52.556082 (+ 61us) server_negotiation.cc:407] Connection header received
0809 05:28:52.556288 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:52.556293 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:52.556443 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:52.556571 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:52.557647 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:52.558592 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:52.560059 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:52.560560 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:52.560667 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:52.566761 (+ 6094us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.3:49481: BlockingRecv error: recv got EOF from 127.26.185.3:49481 (error 108)
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":356,"threads_started":1}
Aug 09 05:28:52 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:52 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:52.823499 9381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:52.811050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.2:53637)
0809 05:28:52.811756 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:52.811776 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:52.811990 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:52.812451 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:52.812459 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:52.813163 (+ 704us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:52.813427 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:52.813444 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:52.815147 (+ 1703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:52.815155 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:52.816353 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:52.816377 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:52.817208 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:52.817214 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:52.817410 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:52.818292 (+ 882us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:52.818315 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:52.822996 (+ 4681us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":379,"threads_started":1}
W20260809 05:28:52.823853 9379 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:52.811153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:53637 (local address 127.26.185.62:33873)
0809 05:28:52.811448 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:52.811459 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:52.811895 (+ 436us) server_negotiation.cc:407] Connection header received
0809 05:28:52.812172 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:52.812176 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:52.812258 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:52.812386 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:52.813664 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:52.814939 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:52.816527 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:52.817011 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:52.817126 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:52.823340 (+ 6214us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.2:53637: BlockingRecv error: recv got EOF from 127.26.185.2:53637 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 09 05:28:53 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:53 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:53.037030 9383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:53.024665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.1:60095)
0809 05:28:53.025460 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:53.025481 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:53.025656 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:53.026113 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:53.026118 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:53.026864 (+ 746us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:53.027170 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:53.027183 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:53.028629 (+ 1446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:53.028636 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:53.029827 (+ 1191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:53.029843 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:53.030759 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:53.030765 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:53.030987 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:53.031851 (+ 864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:53.031875 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:53.036680 (+ 4805us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":634,"thread_start_us":466,"threads_started":1}
W20260809 05:28:53.037349 9379 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:53.024871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:60095 (local address 127.26.185.62:33873)
0809 05:28:53.025118 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:53.025124 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:53.025630 (+ 506us) server_negotiation.cc:407] Connection header received
0809 05:28:53.025843 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:53.025849 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:53.025932 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:53.026037 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:53.027357 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:53.028468 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:53.030049 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:53.030565 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:53.030724 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:53.037006 (+ 6282us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.1:60095: BlockingRecv error: recv got EOF from 127.26.185.1:60095 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 09 05:28:53 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:53 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:53.580319 9386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:53.568321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.3:59989)
0809 05:28:53.569020 (+ 699us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:53.569042 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:53.569233 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:53.569741 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:53.569745 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:53.570284 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:53.570496 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:53.570507 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:53.571791 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:53.571796 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:53.572890 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:53.572904 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:53.573750 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:53.573755 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:53.573900 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:53.574774 (+ 874us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:53.574796 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:53.579853 (+ 5057us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":365,"threads_started":1}
W20260809 05:28:53.580492 9387 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:53.568462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:59989 (local address 127.26.185.62:33873)
0809 05:28:53.569403 (+ 941us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:53.569408 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:53.569426 (+ 18us) server_negotiation.cc:407] Connection header received
0809 05:28:53.569486 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:53.569490 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:53.569572 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:53.569677 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:53.570668 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:53.571647 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:53.573091 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:53.573598 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:53.573712 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:53.580176 (+ 6464us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.3:59989: BlockingRecv error: recv got EOF from 127.26.185.3:59989 (error 108)
Metrics: {"server-negotiator.queue_time_us":775,"thread_start_us":660,"threads_started":1}
Aug 09 05:28:53 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:53 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:53.837385 9388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:53.825059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.2:45687)
0809 05:28:53.826019 (+ 960us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:53.826046 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:53.826231 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:53.826738 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:53.826744 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:53.827564 (+ 820us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:53.827782 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:53.827796 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:53.829207 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:53.829280 (+ 73us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:53.830382 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:53.830399 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:53.831282 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:53.831289 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:53.831500 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:53.832293 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:53.832314 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:53.836898 (+ 4584us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":711,"thread_start_us":535,"threads_started":1}
W20260809 05:28:53.837625 9387 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:53.825373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:45687 (local address 127.26.185.62:33873)
0809 05:28:53.825666 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:53.825676 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:53.826169 (+ 493us) server_negotiation.cc:407] Connection header received
0809 05:28:53.826404 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:53.826414 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:53.826533 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:53.826689 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:53.827976 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:53.828951 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:53.830588 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:53.831108 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:53.831262 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:53.837285 (+ 6023us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.2:45687: BlockingRecv error: recv got EOF from 127.26.185.2:45687 (error 108)
Metrics: {"server-negotiator.queue_time_us":108}
Aug 09 05:28:54 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:54 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:54.049226 9389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:54.038519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.1:32861)
0809 05:28:54.039202 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:54.039224 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:54.039374 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:54.039891 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:54.039898 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:54.040441 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:54.040703 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:54.040716 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:54.041918 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:54.041928 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:54.042920 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:54.042933 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:54.043801 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:54.043807 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:54.044006 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:54.044713 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:54.044733 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:54.048827 (+ 4094us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":355,"threads_started":1}
W20260809 05:28:54.049644 9387 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:54.038610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:32861 (local address 127.26.185.62:33873)
0809 05:28:54.038823 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:54.038830 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:54.039327 (+ 497us) server_negotiation.cc:407] Connection header received
0809 05:28:54.039533 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:54.039537 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:54.039644 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:54.039777 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:54.040886 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:54.041740 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:54.043134 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:54.043616 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:54.043761 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:54.049102 (+ 5341us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.1:32861: BlockingRecv error: recv got EOF from 127.26.185.1:32861 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 09 05:28:54 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:54 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:54.593112 9390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:54.581812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.3:60963)
0809 05:28:54.582520 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:54.582540 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:54.582702 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:54.583311 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:54.583315 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:54.583855 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:54.584048 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:54.584057 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:54.585328 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:54.585332 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:54.586450 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:54.586465 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:54.587237 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:54.587242 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:54.587374 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:54.588218 (+ 844us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:54.588247 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:54.592820 (+ 4573us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":383,"threads_started":1}
W20260809 05:28:54.593508 9391 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:54.581869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:60963 (local address 127.26.185.62:33873)
0809 05:28:54.582540 (+ 671us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:54.582547 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:54.582639 (+ 92us) server_negotiation.cc:407] Connection header received
0809 05:28:54.582841 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:54.582846 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:54.582927 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:54.583048 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:54.584199 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:54.585193 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:54.586592 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:54.587097 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:54.587203 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:54.593121 (+ 5918us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.3:60963: BlockingRecv error: recv got EOF from 127.26.185.3:60963 (error 108)
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":362,"threads_started":1}
Aug 09 05:28:54 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:54 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
W20260809 05:28:54.854388 9391 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:54.839068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:48171 (local address 127.26.185.62:33873)
0809 05:28:54.839295 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:54.839300 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:54.839852 (+ 552us) server_negotiation.cc:407] Connection header received
0809 05:28:54.840057 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:54.840061 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:54.840161 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:54.840263 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:54.841350 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:54.842587 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:54.844632 (+ 2045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:54.845446 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:54.845627 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:54.854052 (+ 8425us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.2:48171: BlockingRecv error: recv got EOF from 127.26.185.2:48171 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 05:28:54.854452 9393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:54.838944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.2:48171)
0809 05:28:54.839718 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:54.839750 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:54.839926 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:54.840342 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:54.840346 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:54.840909 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:54.841162 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:54.841174 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:54.842764 (+ 1590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:54.842772 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:54.844452 (+ 1680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:54.844470 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:54.845695 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:54.845704 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:54.845981 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:54.847082 (+ 1101us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:54.847129 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:54.853678 (+ 6549us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":636,"thread_start_us":440,"threads_started":1}
Aug 09 05:28:55 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:55 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:55.063632 9394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:55.050749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.1:42555)
0809 05:28:55.051648 (+ 899us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:55.051668 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:55.051858 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:55.052328 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:55.052332 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:55.052895 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:55.053122 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:55.053140 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:55.054671 (+ 1531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:55.054677 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:55.056298 (+ 1621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:55.056319 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:55.057319 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:55.057325 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:55.057527 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:55.058413 (+ 886us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:55.058439 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:55.063181 (+ 4742us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":769,"thread_start_us":475,"threads_started":1}
W20260809 05:28:55.063946 9391 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:55.050835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:42555 (local address 127.26.185.62:33873)
0809 05:28:55.051162 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:55.051167 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:55.051806 (+ 639us) server_negotiation.cc:407] Connection header received
0809 05:28:55.052016 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:55.052021 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:55.052129 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:55.052245 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:55.053360 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:55.054423 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:55.056458 (+ 2035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:55.057116 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:55.057299 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:55.063544 (+ 6245us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.1:42555: BlockingRecv error: recv got EOF from 127.26.185.1:42555 (error 108)
Metrics: {"server-negotiator.queue_time_us":108}
Aug 09 05:28:55 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:55 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:55.610649 9395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:55.594518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.3:50243)
0809 05:28:55.595312 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:55.595335 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:55.595490 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:55.595936 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:55.595940 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:55.596468 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:55.596721 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:55.596734 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:55.597950 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:55.597954 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:55.598985 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:55.598999 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:55.599907 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:55.599912 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:55.600073 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:55.605589 (+ 5516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:55.605620 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:55.610291 (+ 4671us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":453,"threads_started":1}
W20260809 05:28:55.610937 9396 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:55.594593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:50243 (local address 127.26.185.62:33873)
0809 05:28:55.595380 (+ 787us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:55.595385 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:55.595407 (+ 22us) server_negotiation.cc:407] Connection header received
0809 05:28:55.595634 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:55.595638 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:55.595721 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:55.595831 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:55.596899 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:55.597779 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:55.599261 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:55.599743 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:55.599853 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:55.610642 (+ 10789us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.3:50243: BlockingRecv error: recv got EOF from 127.26.185.3:50243 (error 108)
Metrics: {"server-negotiator.queue_time_us":646,"thread_start_us":518,"threads_started":1}
Aug 09 05:28:55 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:55 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:55.868681 9399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:55.856234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.2:33745)
0809 05:28:55.857162 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:55.857181 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:55.857408 (+ 227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:55.857922 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:55.857929 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:55.858521 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:55.858759 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:55.858796 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:55.860098 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:55.860103 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:55.861286 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:55.861305 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:55.862230 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:55.862235 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:55.862597 (+ 362us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:55.863660 (+ 1063us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:55.863684 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:55.868332 (+ 4648us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":808,"thread_start_us":479,"threads_started":1}
W20260809 05:28:55.869026 9396 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:55.856359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:33745 (local address 127.26.185.62:33873)
0809 05:28:55.856857 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:55.856868 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:55.857307 (+ 439us) server_negotiation.cc:407] Connection header received
0809 05:28:55.857579 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:55.857584 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:55.857723 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:55.857865 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:55.858969 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:55.859889 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:55.861461 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:55.862008 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:55.862169 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:55.868685 (+ 6516us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.2:33745: BlockingRecv error: recv got EOF from 127.26.185.2:33745 (error 108)
Metrics: {"server-negotiator.queue_time_us":241}
Aug 09 05:28:56 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:56 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:56.081097 9400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:56.065954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.1:52885)
0809 05:28:56.067325 (+ 1371us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:56.067392 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:56.067588 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:56.068283 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:56.068293 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:56.069229 (+ 936us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:56.069627 (+ 398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:56.069643 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:56.071618 (+ 1975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:56.071625 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:56.073025 (+ 1400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:56.073043 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:56.074007 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:56.074013 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:56.074158 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:56.075058 (+ 900us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:56.075090 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:56.080620 (+ 5530us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1123,"thread_start_us":771,"threads_started":1}
W20260809 05:28:56.081753 9396 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:56.066214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:52885 (local address 127.26.185.62:33873)
0809 05:28:56.066573 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:56.066584 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:56.067580 (+ 996us) server_negotiation.cc:407] Connection header received
0809 05:28:56.067782 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:56.067789 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:56.067993 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:56.068138 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:56.069878 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:56.071350 (+ 1472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:56.073231 (+ 1881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:56.073742 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:56.073870 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:56.081114 (+ 7244us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.1:52885: BlockingRecv error: recv got EOF from 127.26.185.1:52885 (error 108)
Metrics: {"server-negotiator.queue_time_us":114}
Aug 09 05:28:56 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:56 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:56.625886 9403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:56.612217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.3:48321)
0809 05:28:56.613321 (+ 1104us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:56.613352 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:56.613558 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:56.614206 (+ 648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:56.614210 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:56.614784 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:56.615099 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:56.615114 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:56.616644 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:56.616649 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:56.618117 (+ 1468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:56.618135 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:56.618976 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:56.618980 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:56.619164 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:56.620057 (+ 893us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:56.620090 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:56.625413 (+ 5323us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":861,"thread_start_us":453,"threads_started":1}
W20260809 05:28:56.626116 9402 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:56.612295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:48321 (local address 127.26.185.62:33873)
0809 05:28:56.613144 (+ 849us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:56.613153 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:56.613468 (+ 315us) server_negotiation.cc:407] Connection header received
0809 05:28:56.613866 (+ 398us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:56.613870 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:56.614031 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:56.614154 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:56.615300 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:56.616371 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:56.618293 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:56.618815 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:56.618939 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:56.625746 (+ 6807us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.3:48321: BlockingRecv error: recv got EOF from 127.26.185.3:48321 (error 108)
Metrics: {"server-negotiator.queue_time_us":612,"thread_start_us":426,"threads_started":1}
Aug 09 05:28:56 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:56 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:56.887223 9404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:56.870393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.2:43761)
0809 05:28:56.871656 (+ 1263us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:56.871676 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:56.872069 (+ 393us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:56.872670 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:56.872690 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:56.873564 (+ 874us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:56.873905 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:56.873918 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:56.875725 (+ 1807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:56.875730 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:56.877566 (+ 1836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:56.877583 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:56.879665 (+ 2082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:56.879699 (+ 34us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:56.879994 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:56.881001 (+ 1007us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:56.881035 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:56.886735 (+ 5700us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1049,"thread_start_us":806,"threads_started":1}
W20260809 05:28:56.887456 9402 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:56.870559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:43761 (local address 127.26.185.62:33873)
0809 05:28:56.870811 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:56.870828 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:56.871868 (+ 1040us) server_negotiation.cc:407] Connection header received
0809 05:28:56.872217 (+ 349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:56.872222 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:56.872312 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:56.872415 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:56.874112 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:56.875511 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:56.877719 (+ 2208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:56.879343 (+ 1624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:56.879565 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:56.887141 (+ 7576us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.2:43761: BlockingRecv error: recv got EOF from 127.26.185.2:43761 (error 108)
Metrics: {"server-negotiator.queue_time_us":96}
Aug 09 05:28:57 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:57 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:57.096230 9405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:57.083095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.1:35821)
0809 05:28:57.084267 (+ 1172us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:57.084288 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:57.084510 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:57.085177 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:57.085181 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:57.085789 (+ 608us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:57.086021 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:57.086039 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:57.087524 (+ 1485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:57.087529 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:57.088701 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:57.088719 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:57.089578 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:57.089584 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:57.089741 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:57.090595 (+ 854us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:57.090629 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:57.095841 (+ 5212us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":996,"thread_start_us":815,"threads_started":1}
W20260809 05:28:57.096575 9402 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:57.083136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:35821 (local address 127.26.185.62:33873)
0809 05:28:57.083425 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:57.083434 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:57.084398 (+ 964us) server_negotiation.cc:407] Connection header received
0809 05:28:57.084680 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:57.084685 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:57.084794 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:57.084971 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:57.086280 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:57.087330 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:57.088883 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:57.089394 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:57.089512 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:57.096200 (+ 6688us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.1:35821: BlockingRecv error: recv got EOF from 127.26.185.1:35821 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 09 05:28:57 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:57 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:57.639917 9406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:57.627373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.3:48817)
0809 05:28:57.628273 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:57.628365 (+ 92us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:57.628608 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:57.629128 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:57.629132 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:57.629857 (+ 725us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:57.630133 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:57.630153 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:57.631722 (+ 1569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:57.631728 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:57.632893 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:57.632910 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:57.633962 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:57.633967 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:57.634112 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:57.634902 (+ 790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:57.634926 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:57.639602 (+ 4676us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":630,"thread_start_us":405,"threads_started":1}
W20260809 05:28:57.640295 9410 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:57.627493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:48817 (local address 127.26.185.62:33873)
0809 05:28:57.628698 (+ 1205us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:57.628704 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:57.628727 (+ 23us) server_negotiation.cc:407] Connection header received
0809 05:28:57.628792 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:57.628796 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:57.628878 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:57.629073 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:57.630370 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:57.631533 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:57.633073 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:57.633735 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:57.633873 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:57.639917 (+ 6044us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.3:48817: BlockingRecv error: recv got EOF from 127.26.185.3:48817 (error 108)
Metrics: {"server-negotiator.queue_time_us":1040,"thread_start_us":839,"threads_started":1}
Aug 09 05:28:57 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:57 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:57.900239 9411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:57.888527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.2:33733)
0809 05:28:57.889254 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:57.889274 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:57.889483 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:57.889925 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:57.889933 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:57.890501 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:57.890690 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:57.890700 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:57.892299 (+ 1599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:57.892306 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:57.893653 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:57.893670 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:57.894424 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:57.894429 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:57.894590 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:57.895332 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:57.895353 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:57.899813 (+ 4460us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":589,"thread_start_us":387,"threads_started":1}
W20260809 05:28:57.900318 9410 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:57.888658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:33733 (local address 127.26.185.62:33873)
0809 05:28:57.888964 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:57.888973 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:57.889407 (+ 434us) server_negotiation.cc:407] Connection header received
0809 05:28:57.889652 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:57.889657 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:57.889748 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:57.889866 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:57.890857 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:57.892065 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:57.893816 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:57.894265 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:57.894382 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:57.900056 (+ 5674us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.2:33733: BlockingRecv error: recv got EOF from 127.26.185.2:33733 (error 108)
Metrics: {"server-negotiator.queue_time_us":108}
Aug 09 05:28:58 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:58 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:58.110110 9412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:58.097815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.1:39085)
0809 05:28:58.098584 (+ 769us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:58.098604 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:58.098763 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:58.099307 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:58.099311 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:58.099830 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:58.100095 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:58.100108 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:58.101368 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:58.101373 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:58.102674 (+ 1301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:58.102692 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:58.103917 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:58.103923 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:58.104118 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:58.105086 (+ 968us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:58.105118 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:58.109657 (+ 4539us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":633,"thread_start_us":424,"threads_started":1}
W20260809 05:28:58.110342 9410 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:58.097950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:39085 (local address 127.26.185.62:33873)
0809 05:28:58.098203 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:58.098208 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:58.098703 (+ 495us) server_negotiation.cc:407] Connection header received
0809 05:28:58.098890 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:58.098895 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:58.099053 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:58.099195 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:58.100286 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:58.101165 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:58.102844 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:58.103729 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:58.103880 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:58.109992 (+ 6112us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.1:39085: BlockingRecv error: recv got EOF from 127.26.185.1:39085 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 09 05:28:58 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:58 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:58.652649 9413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:58.641302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.3:48387)
0809 05:28:58.642060 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:58.642082 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:58.642239 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:58.642668 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:58.642672 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:58.643314 (+ 642us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:58.643509 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:58.643521 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:58.644659 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:58.644663 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:58.645732 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:58.645746 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:58.646501 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:58.646506 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:58.646664 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:58.647500 (+ 836us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:58.647522 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:58.652350 (+ 4828us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":397,"threads_started":1}
W20260809 05:28:58.653117 9417 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:58.641340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:48387 (local address 127.26.185.62:33873)
0809 05:28:58.641936 (+ 596us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:58.641942 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:58.642190 (+ 248us) server_negotiation.cc:407] Connection header received
0809 05:28:58.642361 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:58.642365 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:58.642475 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:58.642586 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:58.643680 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:58.644499 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:58.645877 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:58.646344 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:58.646449 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:58.652628 (+ 6179us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.3:48387: BlockingRecv error: recv got EOF from 127.26.185.3:48387 (error 108)
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":333,"threads_started":1}
Aug 09 05:28:58 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:58 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:58.912487 9421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:58.901464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.2:54197)
0809 05:28:58.902053 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:58.902073 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:58.902221 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:58.902558 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:58.902562 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:58.903069 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:58.903272 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:58.903283 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:58.904443 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:58.904447 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:58.905645 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:58.905660 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:58.906359 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:58.906364 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:58.906485 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:58.907282 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:58.907302 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:58.912062 (+ 4760us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":334,"threads_started":1}
W20260809 05:28:58.912595 9417 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:58.901560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:54197 (local address 127.26.185.62:33873)
0809 05:28:58.901876 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:58.901883 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:58.902172 (+ 289us) server_negotiation.cc:407] Connection header received
0809 05:28:58.902334 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:58.902338 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:58.902416 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:58.902508 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:58.903420 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:58.904289 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:58.905777 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:58.906218 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:58.906320 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:58.912322 (+ 6002us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.2:54197: BlockingRecv error: recv got EOF from 127.26.185.2:54197 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 09 05:28:59 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:59 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:59.123411 9422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:59.111608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.1:60413)
0809 05:28:59.112362 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:59.112383 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:59.112553 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:59.112964 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:59.112968 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:59.113521 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:59.113752 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:59.113763 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:59.115237 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:59.115242 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:59.116369 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:59.116386 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:59.117202 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:59.117208 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:59.117369 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:59.118173 (+ 804us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:59.118193 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:59.123078 (+ 4885us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":607,"thread_start_us":452,"threads_started":1}
W20260809 05:28:59.123602 9417 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:59.111818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:60413 (local address 127.26.185.62:33873)
0809 05:28:59.112096 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:59.112102 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:59.112488 (+ 386us) server_negotiation.cc:407] Connection header received
0809 05:28:59.112696 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:59.112700 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:59.112802 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:59.112901 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:59.113963 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:59.114901 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:59.116549 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:59.117004 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:59.117113 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:59.123319 (+ 6206us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.1:60413: BlockingRecv error: recv got EOF from 127.26.185.1:60413 (error 108)
Metrics: {"server-negotiator.queue_time_us":106}
Aug 09 05:28:59 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:59 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:59.666647 9423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:59.654057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.3:40793)
0809 05:28:59.654805 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:59.654826 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:59.655060 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:59.655545 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:59.655549 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:59.656126 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:59.656374 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:59.656388 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:59.657730 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:59.657736 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:59.659217 (+ 1481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:59.659236 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:59.660302 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:59.660309 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:59.660509 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:59.661387 (+ 878us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:59.661411 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:59.666221 (+ 4810us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":422,"threads_started":1}
W20260809 05:28:59.666898 9424 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:59.654179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:40793 (local address 127.26.185.62:33873)
0809 05:28:59.654833 (+ 654us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:59.654838 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:59.654933 (+ 95us) server_negotiation.cc:407] Connection header received
0809 05:28:59.655259 (+ 326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:59.655265 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:59.655365 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:59.655489 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:59.656570 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:59.657525 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:59.659411 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:59.660047 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:59.660237 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:59.666539 (+ 6302us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.3:40793: BlockingRecv error: recv got EOF from 127.26.185.3:40793 (error 108)
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":374,"threads_started":1}
Aug 09 05:28:59 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:28:59 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:28:59.924785 9425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:28:59.914035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.2:58925)
0809 05:28:59.914708 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0809 05:28:59.914728 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 05:28:59.914940 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:28:59.915428 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:28:59.915432 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:28:59.916055 (+ 623us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:28:59.916397 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:59.916411 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:59.917699 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:59.917704 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:59.918685 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:28:59.918698 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:28:59.919423 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:28:59.919428 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:28:59.919590 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:59.920311 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:28:59.920331 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:28:59.924505 (+ 4174us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":373,"threads_started":1}
W20260809 05:28:59.925002 9424 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:28:59.914256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:58925 (local address 127.26.185.62:33873)
0809 05:28:59.914481 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0809 05:28:59.914488 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:28:59.914854 (+ 366us) server_negotiation.cc:407] Connection header received
0809 05:28:59.915146 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:28:59.915150 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:28:59.915232 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:28:59.915364 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:28:59.916566 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:59.917555 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:59.918820 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:28:59.919280 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:28:59.919388 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:28:59.924740 (+ 5352us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.2:58925: BlockingRecv error: recv got EOF from 127.26.185.2:58925 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 09 05:29:00 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:29:00 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:29:00.137151 9426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:00.124706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.1:32825)
0809 05:29:00.125484 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:00.125503 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 05:29:00.125655 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:29:00.126113 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:29:00.126117 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:29:00.126677 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:29:00.126895 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:00.126908 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:00.128247 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:00.128252 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:00.129348 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:00.129364 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:00.130431 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:00.130438 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:00.130656 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:00.131524 (+ 868us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:29:00.131547 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:29:00.136757 (+ 5210us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":639,"thread_start_us":434,"threads_started":1}
W20260809 05:29:00.137580 9424 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:29:00.124780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:32825 (local address 127.26.185.62:33873)
0809 05:29:00.125137 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:00.125143 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:00.125599 (+ 456us) server_negotiation.cc:407] Connection header received
0809 05:29:00.125793 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:00.125798 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:00.125883 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:00.126038 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:00.127126 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:00.128056 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:00.129663 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:00.130170 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:00.130334 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:00.137031 (+ 6697us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.1:32825: BlockingRecv error: recv got EOF from 127.26.185.1:32825 (error 108)
Metrics: {"server-negotiator.queue_time_us":152}
Aug 09 05:29:00 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:29:00 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:29:00.685539 9427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:00.668105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.3:44083)
0809 05:29:00.668899 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:00.668932 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 05:29:00.669137 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:29:00.670028 (+ 891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:29:00.670032 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:29:00.670587 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:29:00.670830 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:00.670841 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:00.672471 (+ 1630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:00.672476 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:00.673519 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:00.673537 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:00.674469 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:00.674474 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:00.674637 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:00.679658 (+ 5021us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:29:00.679697 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:29:00.685244 (+ 5547us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":369,"threads_started":1}
W20260809 05:29:00.685942 9428 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:29:00.668173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:44083 (local address 127.26.185.62:33873)
0809 05:29:00.669691 (+ 1518us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:00.669696 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:00.669713 (+ 17us) server_negotiation.cc:407] Connection header received
0809 05:29:00.669765 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:00.669769 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:00.669847 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:00.669949 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:00.671153 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:00.672266 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:00.673717 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:00.674302 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:00.674425 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:00.685593 (+ 11168us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.3:44083: BlockingRecv error: recv got EOF from 127.26.185.3:44083 (error 108)
Metrics: {"server-negotiator.queue_time_us":1396,"thread_start_us":1270,"threads_started":1}
Aug 09 05:29:00 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:29:00 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:29:00.937114 9429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:00.926108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.2:56303)
0809 05:29:00.926774 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:00.926793 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 05:29:00.926943 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:29:00.927308 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:29:00.927311 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:29:00.927835 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:29:00.928059 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:00.928070 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:00.929366 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:00.929373 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:00.930892 (+ 1519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:00.930913 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:00.931745 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:00.931751 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:00.931974 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:00.932740 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:29:00.932761 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:29:00.936795 (+ 4034us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":370,"threads_started":1}
W20260809 05:29:00.937608 9428 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:29:00.926228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:56303 (local address 127.26.185.62:33873)
0809 05:29:00.926545 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:00.926553 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:00.926898 (+ 345us) server_negotiation.cc:407] Connection header received
0809 05:29:00.927081 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:00.927086 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:00.927165 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:00.927260 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:00.928219 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:00.929188 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:00.931108 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:00.931568 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:00.931715 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:00.937118 (+ 5403us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.2:56303: BlockingRecv error: recv got EOF from 127.26.185.2:56303 (error 108)
Metrics: {"server-negotiator.queue_time_us":105}
Aug 09 05:29:01 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:29:01 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:29:01.150010 9431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:01.138371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.1:58431)
0809 05:29:01.138991 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:01.139032 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 05:29:01.139238 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:29:01.139658 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:29:01.139663 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:29:01.140238 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:29:01.140439 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:01.140448 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:01.141593 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:01.141600 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:01.142597 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:01.142611 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:01.143500 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:01.143507 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:01.143704 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:01.144488 (+ 784us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:29:01.144508 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:29:01.149718 (+ 5210us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":335,"threads_started":1}
W20260809 05:29:01.150429 9428 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:29:01.138549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:58431 (local address 127.26.185.62:33873)
0809 05:29:01.138817 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:01.138825 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:01.139136 (+ 311us) server_negotiation.cc:407] Connection header received
0809 05:29:01.139378 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:01.139386 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:01.139492 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:01.139609 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:01.140603 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:01.141434 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:01.142757 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:01.143329 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:01.143478 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:01.150004 (+ 6526us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.1:58431: BlockingRecv error: recv got EOF from 127.26.185.1:58431 (error 108)
Metrics: {"server-negotiator.queue_time_us":107}
Aug 09 05:29:01 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:29:01 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:29:01.698505 9432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:01.686953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.3:32829)
0809 05:29:01.687750 (+ 797us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:01.687770 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 05:29:01.687939 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:29:01.688355 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:29:01.688359 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:29:01.688918 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:29:01.689210 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:01.689227 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:01.690809 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:01.690813 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:01.692015 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:01.692029 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:01.692856 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:01.692861 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:01.693031 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:01.693788 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:29:01.693809 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:29:01.698195 (+ 4386us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":668,"thread_start_us":402,"threads_started":1}
W20260809 05:29:01.698896 9434 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:29:01.687101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:32829 (local address 127.26.185.62:33873)
0809 05:29:01.687775 (+ 674us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:01.687780 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:01.687947 (+ 167us) server_negotiation.cc:407] Connection header received
0809 05:29:01.688088 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:01.688092 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:01.688175 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:01.688293 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:01.689412 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:01.690635 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:01.692163 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:01.692682 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:01.692794 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:01.698533 (+ 5739us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.3:32829: BlockingRecv error: recv got EOF from 127.26.185.3:32829 (error 108)
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":352,"threads_started":1}
Aug 09 05:29:01 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:29:01 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:29:01.949544 9435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:01.938671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.2:50433)
0809 05:29:01.939434 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:01.939453 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 05:29:01.939643 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:29:01.940096 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:29:01.940100 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:29:01.940703 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:29:01.940894 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:01.940906 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:01.942170 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:01.942173 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:01.943207 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:01.943222 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:01.944028 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:01.944033 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:01.944190 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:01.944938 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:29:01.944959 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:29:01.949244 (+ 4285us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":618,"thread_start_us":432,"threads_started":1}
W20260809 05:29:01.949782 9434 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:29:01.938902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:50433 (local address 127.26.185.62:33873)
0809 05:29:01.939212 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:01.939220 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:01.939560 (+ 340us) server_negotiation.cc:407] Connection header received
0809 05:29:01.939816 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:01.939820 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:01.939904 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:01.940034 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:01.941060 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:01.942010 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:01.943372 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:01.943876 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:01.944000 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:01.949514 (+ 5514us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.2:50433: BlockingRecv error: recv got EOF from 127.26.185.2:50433 (error 108)
Metrics: {"server-negotiator.queue_time_us":109}
Aug 09 05:29:02 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:29:02 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:29:02.162922 9438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:02.151621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.1:45021)
0809 05:29:02.152356 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:02.152376 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 05:29:02.152521 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:29:02.152920 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:29:02.152923 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:29:02.153426 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:29:02.153671 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:02.153683 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:02.154967 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:02.154970 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:02.156017 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:02.156030 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:02.156927 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:02.156934 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:02.157184 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:02.157935 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:29:02.157954 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:29:02.162597 (+ 4643us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":581,"thread_start_us":373,"threads_started":1}
W20260809 05:29:02.163151 9434 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:29:02.151740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:45021 (local address 127.26.185.62:33873)
0809 05:29:02.151968 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:02.151974 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:02.152469 (+ 495us) server_negotiation.cc:407] Connection header received
0809 05:29:02.152654 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:02.152659 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:02.152756 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:02.152856 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:02.153859 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:02.154819 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:02.156219 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:02.156700 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:02.156928 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:02.162855 (+ 5927us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.1:45021: BlockingRecv error: recv got EOF from 127.26.185.1:45021 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 09 05:29:02 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:29:02 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.3@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:29:02.710779 9439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:02.699781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.3:33453)
0809 05:29:02.700502 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:02.700522 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 05:29:02.700659 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:29:02.701038 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:29:02.701042 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:29:02.701582 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:29:02.701770 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:02.701780 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:02.702910 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:02.702914 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:02.704085 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:02.704123 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:02.704941 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:02.704945 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:02.705095 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:02.705866 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:29:02.705893 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:29:02.710492 (+ 4599us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":413,"threads_started":1}
W20260809 05:29:02.711089 9442 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:29:02.699868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:33453 (local address 127.26.185.62:33873)
0809 05:29:02.700594 (+ 726us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:02.700599 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:02.700618 (+ 19us) server_negotiation.cc:407] Connection header received
0809 05:29:02.700782 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:02.700787 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:02.700876 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:02.700984 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:02.701905 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:02.702709 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:02.704268 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:02.704807 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:02.704910 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:02.710746 (+ 5836us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.3:33453: BlockingRecv error: recv got EOF from 127.26.185.3:33453 (error 108)
Metrics: {"server-negotiator.queue_time_us":601,"thread_start_us":357,"threads_started":1}
Aug 09 05:29:02 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:29:02 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.2@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:29:02.962885 9443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:02.951465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.2:56949)
0809 05:29:02.952113 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:02.952132 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 05:29:02.952274 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:29:02.952721 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:29:02.952728 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:29:02.953308 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:29:02.953536 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:02.953548 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:02.954741 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:02.954745 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:02.955858 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:02.955872 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:02.956804 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:02.956812 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:02.957021 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:02.957865 (+ 844us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:29:02.957886 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:29:02.962430 (+ 4544us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":362,"threads_started":1}
W20260809 05:29:02.963050 9442 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:29:02.951542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:56949 (local address 127.26.185.62:33873)
0809 05:29:02.951862 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:02.951871 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:02.952254 (+ 383us) server_negotiation.cc:407] Connection header received
0809 05:29:02.952405 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:02.952410 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:02.952501 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:02.952630 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:02.953727 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:02.954590 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:02.956061 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:02.956596 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:02.956721 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:02.962733 (+ 6012us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.2:56949: BlockingRecv error: recv got EOF from 127.26.185.2:56949 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 09 05:29:03 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 05:29:03 dist-test-slave-h3ft krb5kdc[7923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.185.1@KRBTEST.COM for oryx/127.26.185.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 05:29:03.176173 9444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:03.164314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33873 (local address 127.26.185.1:50533)
0809 05:29:03.165125 (+ 811us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:03.165147 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 05:29:03.165327 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:29:03.165722 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:29:03.165726 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:29:03.166307 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:29:03.166626 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:03.166645 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:03.168290 (+ 1645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:03.168296 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:03.169509 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:03.169525 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:03.170276 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:03.170280 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:03.170429 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:03.171197 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:29:03.171216 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:29:03.175824 (+ 4608us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.185.62:33873: Server oryx/127.26.185.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":658,"thread_start_us":478,"threads_started":1}
W20260809 05:29:03.176641 9442 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:29:03.164556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:50533 (local address 127.26.185.62:33873)
0809 05:29:03.164816 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:03.164822 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:03.165247 (+ 425us) server_negotiation.cc:407] Connection header received
0809 05:29:03.165466 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:03.165470 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:03.165550 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:03.165654 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:03.166823 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:03.168062 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:03.169660 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:03.170129 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:03.170237 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:03.176193 (+ 5956us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.185.1:50533: BlockingRecv error: recv got EOF from 127.26.185.1:50533 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
I20260809 05:29:03.321203 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 8759
I20260809 05:29:03.338189 9449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:03.322949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37484 (local address 127.26.185.1:38561)
0809 05:29:03.323819 (+ 870us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:03.323835 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:03.323876 (+ 41us) server_negotiation.cc:407] Connection header received
0809 05:29:03.323963 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:03.323972 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:03.324303 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:03.324509 (+ 206us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:03.326334 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:03.327738 (+ 1404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:03.329392 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:03.330156 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:03.330276 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:03.333984 (+ 3708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:29:03.333996 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:29:03.334016 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:29:03.334072 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:29:03.337504 (+ 3432us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.26.185.1@KRBTEST.COM not found in keytab (ticket kvno 2)
0809 05:29:03.337895 (+ 391us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37484: Request ticket server kudu/127.26.185.1@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":657,"thread_start_us":436,"threads_started":1}
W20260809 05:29:03.338364 9449 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37484: Request ticket server kudu/127.26.185.1@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260809 05:29:03.338492 27364 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 8759: Not authorized: Client connection negotiation failed: client connection to 127.26.185.1:38561: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.26.185.1@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260809 05:29:03.338763 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 8759
I20260809 05:29:03.371407 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 8987
I20260809 05:29:03.390452 9450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:03.373041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43900 (local address 127.26.185.2:38269)
0809 05:29:03.373861 (+ 820us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:03.373871 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:03.373911 (+ 40us) server_negotiation.cc:407] Connection header received
0809 05:29:03.374001 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:03.374009 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:03.374331 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:03.376739 (+ 2408us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:03.378958 (+ 2219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:03.380284 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:03.381881 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:03.382689 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:03.382824 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:03.385965 (+ 3141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:29:03.386014 (+ 49us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:29:03.386045 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:29:03.386107 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:29:03.389743 (+ 3636us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.26.185.2@KRBTEST.COM not found in keytab (ticket kvno 2)
0809 05:29:03.390138 (+ 395us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:43900: Request ticket server kudu/127.26.185.2@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":601,"thread_start_us":409,"threads_started":1}
W20260809 05:29:03.390609 9450 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:43900: Request ticket server kudu/127.26.185.2@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260809 05:29:03.390774 27364 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 8987: Not authorized: Client connection negotiation failed: client connection to 127.26.185.2:38269: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.26.185.2@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260809 05:29:03.391040 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 8987
I20260809 05:29:03.427271 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 9169
I20260809 05:29:03.444778 9452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:03.429131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57086 (local address 127.26.185.3:37617)
0809 05:29:03.429971 (+ 840us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:03.429981 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:03.430017 (+ 36us) server_negotiation.cc:407] Connection header received
0809 05:29:03.430117 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:03.430127 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:03.430471 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:03.430697 (+ 226us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:03.433293 (+ 2596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:03.434527 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:03.436083 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:03.436834 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:03.437066 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:03.440210 (+ 3144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:29:03.440222 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:29:03.440242 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:29:03.440290 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:29:03.444053 (+ 3763us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.26.185.3@KRBTEST.COM not found in keytab (ticket kvno 2)
0809 05:29:03.444451 (+ 398us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57086: Request ticket server kudu/127.26.185.3@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":553,"thread_start_us":383,"threads_started":1}
W20260809 05:29:03.444938 9452 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57086: Request ticket server kudu/127.26.185.3@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260809 05:29:03.445030 27364 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 9169: Not authorized: Client connection negotiation failed: client connection to 127.26.185.3:37617: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.26.185.3@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260809 05:29:03.445241 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 9169
I20260809 05:29:03.479406 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 8663
I20260809 05:29:03.481480 8751 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:29:03.629285 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 8663
2026-08-09T05:29:03Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (23462 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-09T05:29:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:29:03Z Disabled control of system clock
I20260809 05:29:03.761973 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:33525
--webserver_interface=127.26.185.62
--webserver_port=0
--builtin_ntp_servers=127.26.185.20:36715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:33525
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 05:29:04.233204 9457 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:29:04.233611 9457 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:29:04.233811 9457 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:29:04.241935 9457 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:29:04.242091 9457 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:29:04.242184 9457 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:29:04.242277 9457 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:29:04.242373 9457 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:29:04.252805 9457 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:36715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:33525
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:33525
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:29:04.254799 9457 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:29:04.257395 9457 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:29:04.273900 9467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:29:04.273947 9465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:29:04.273947 9464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:29:04.274667 9457 server_base.cc:1034] running on GCE node
I20260809 05:29:04.275910 9457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:29:04.278337 9457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:29:04.279646 9457 hybrid_clock.cc:648] HybridClock initialized: now 1786253344279575 us; error 56 us; skew 500 ppm
I20260809 05:29:04.280280 9457 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 05:29:04.284261 9457 webserver.cc:460] Webserver started at http://127.26.185.62:35061/ using document root <none> and password file <none>
I20260809 05:29:04.285401 9457 fs_manager.cc:359] Metadata directory not provided
I20260809 05:29:04.285532 9457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:29:04.286057 9457 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:29:04.290388 9457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "50f6d94118354312831a8f5b55119412"
format_stamp: "Formatted at 2026-08-09 05:29:04 on dist-test-slave-h3ft"
server_key: "385e9fa2c463310f8a262e56b4f7ff28"
server_key_iv: "ed58dc6321039d42ffb5b3ea50772131"
server_key_version: "encryptionkey@0"
I20260809 05:29:04.291617 9457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "50f6d94118354312831a8f5b55119412"
format_stamp: "Formatted at 2026-08-09 05:29:04 on dist-test-slave-h3ft"
server_key: "385e9fa2c463310f8a262e56b4f7ff28"
server_key_iv: "ed58dc6321039d42ffb5b3ea50772131"
server_key_version: "encryptionkey@0"
I20260809 05:29:04.298928 9457 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260809 05:29:04.303755 9479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:29:04.305732 9457 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 05:29:04.306002 9457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "50f6d94118354312831a8f5b55119412"
format_stamp: "Formatted at 2026-08-09 05:29:04 on dist-test-slave-h3ft"
server_key: "385e9fa2c463310f8a262e56b4f7ff28"
server_key_iv: "ed58dc6321039d42ffb5b3ea50772131"
server_key_version: "encryptionkey@0"
I20260809 05:29:04.306290 9457 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:29:04.339710 9457 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:29:04.340955 9457 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:29:04.341356 9457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:29:04.364544 9457 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:33525
I20260809 05:29:04.364578 9550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:33525 every 8 connection(s)
I20260809 05:29:04.366492 9457 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:29:04.371881 9551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:29:04.376403 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 9457
I20260809 05:29:04.376721 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:29:04.377576 27364 external_mini_cluster.cc:1428] Setting key 1274b588ee491b25a00c047c9eddd502
I20260809 05:29:04.389315 9551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50f6d94118354312831a8f5b55119412: Bootstrap starting.
I20260809 05:29:04.394340 9551 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 50f6d94118354312831a8f5b55119412: Neither blocks nor log segments found. Creating new log.
I20260809 05:29:04.395574 9554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:04.380511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59788 (local address 127.26.185.62:33525)
0809 05:29:04.381837 (+ 1326us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:04.381853 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:04.381916 (+ 63us) server_negotiation.cc:407] Connection header received
0809 05:29:04.383920 (+ 2004us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:04.383953 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:04.384617 (+ 664us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:04.385080 (+ 463us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:04.386047 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:04.387636 (+ 1589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:04.389770 (+ 2134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:04.390558 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:04.390722 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:04.392372 (+ 1650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:29:04.392382 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:29:04.392401 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:29:04.393139 (+ 738us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:29:04.393261 (+ 122us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:29:04.393287 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:29:04.393389 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 05:29:04.393681 (+ 292us) server_negotiation.cc:299] Negotiation successful
0809 05:29:04.394173 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":771,"thread_start_us":476,"threads_started":1}
I20260809 05:29:04.395963 9551 log.cc:824] T 00000000000000000000000000000000 P 50f6d94118354312831a8f5b55119412: Log is configured to *not* fsync() on all Append() calls
I20260809 05:29:04.400022 9551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50f6d94118354312831a8f5b55119412: No bootstrap required, opened a new log
I20260809 05:29:04.409291 9551 raft_consensus.cc:348] T 00000000000000000000000000000000 P 50f6d94118354312831a8f5b55119412 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50f6d94118354312831a8f5b55119412" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33525 } }
I20260809 05:29:04.409768 9551 raft_consensus.cc:374] T 00000000000000000000000000000000 P 50f6d94118354312831a8f5b55119412 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:29:04.409907 9551 raft_consensus.cc:729] T 00000000000000000000000000000000 P 50f6d94118354312831a8f5b55119412 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f6d94118354312831a8f5b55119412, State: Initialized, Role: FOLLOWER
I20260809 05:29:04.410696 9551 consensus_queue.cc:260] T 00000000000000000000000000000000 P 50f6d94118354312831a8f5b55119412 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50f6d94118354312831a8f5b55119412" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33525 } }
I20260809 05:29:04.410939 9551 raft_consensus.cc:388] T 00000000000000000000000000000000 P 50f6d94118354312831a8f5b55119412 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:29:04.411168 9551 raft_consensus.cc:482] T 00000000000000000000000000000000 P 50f6d94118354312831a8f5b55119412 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:29:04.411384 9551 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 50f6d94118354312831a8f5b55119412 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:29:04.413980 9551 raft_consensus.cc:504] T 00000000000000000000000000000000 P 50f6d94118354312831a8f5b55119412 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50f6d94118354312831a8f5b55119412" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33525 } }
I20260809 05:29:04.414641 9551 leader_election.cc:302] T 00000000000000000000000000000000 P 50f6d94118354312831a8f5b55119412 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 50f6d94118354312831a8f5b55119412; no voters:
I20260809 05:29:04.415450 9551 leader_election.cc:288] T 00000000000000000000000000000000 P 50f6d94118354312831a8f5b55119412 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:29:04.415602 9559 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 50f6d94118354312831a8f5b55119412 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:29:04.417230 9559 raft_consensus.cc:686] T 00000000000000000000000000000000 P 50f6d94118354312831a8f5b55119412 [term 1 LEADER]: Becoming Leader. State: Replica: 50f6d94118354312831a8f5b55119412, State: Running, Role: LEADER
I20260809 05:29:04.417994 9559 consensus_queue.cc:237] T 00000000000000000000000000000000 P 50f6d94118354312831a8f5b55119412 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50f6d94118354312831a8f5b55119412" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33525 } }
I20260809 05:29:04.418326 9551 sys_catalog.cc:564] T 00000000000000000000000000000000 P 50f6d94118354312831a8f5b55119412 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:29:04.421959 9564 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50f6d94118354312831a8f5b55119412 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 50f6d94118354312831a8f5b55119412. Latest consensus state: current_term: 1 leader_uuid: "50f6d94118354312831a8f5b55119412" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50f6d94118354312831a8f5b55119412" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33525 } } }
I20260809 05:29:04.422511 9564 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50f6d94118354312831a8f5b55119412 [sys.catalog]: This master's current role is: LEADER
I20260809 05:29:04.421983 9560 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50f6d94118354312831a8f5b55119412 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "50f6d94118354312831a8f5b55119412" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50f6d94118354312831a8f5b55119412" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33525 } } }
I20260809 05:29:04.422967 9560 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50f6d94118354312831a8f5b55119412 [sys.catalog]: This master's current role is: LEADER
I20260809 05:29:04.423681 9574 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:29:04.430331 9574 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:29:04.448851 9574 catalog_manager.cc:1347] Generated new cluster ID: 14de8621e14e442cbb46fcd6ed7fc2bb
I20260809 05:29:04.449030 9574 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:29:04.464438 9574 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:29:04.466183 9574 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:29:04.476825 9574 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 50f6d94118354312831a8f5b55119412: Generated new TSK 0
I20260809 05:29:04.478049 9574 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 05:29:04.488170 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:0
--local_ip_for_outbound_sockets=127.26.185.1
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:33525
--builtin_ntp_servers=127.26.185.20:36715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260809 05:29:04.963889 9591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:29:04.964350 9591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:29:04.964514 9591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:29:04.973143 9591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:29:04.973315 9591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:29:04.973518 9591 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:29:04.985193 9591 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:36715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:33525
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:29:04.987210 9591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:29:04.989805 9591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:29:05.008239 9598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:29:05.008307 9602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:29:05.008353 9599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:29:05.009377 9591 server_base.cc:1034] running on GCE node
I20260809 05:29:05.010281 9591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:29:05.011734 9591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:29:05.013042 9591 hybrid_clock.cc:648] HybridClock initialized: now 1786253345012963 us; error 68 us; skew 500 ppm
I20260809 05:29:05.013540 9591 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 05:29:05.016939 9591 webserver.cc:460] Webserver started at http://127.26.185.1:33505/ using document root <none> and password file <none>
I20260809 05:29:05.017927 9591 fs_manager.cc:359] Metadata directory not provided
I20260809 05:29:05.018088 9591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:29:05.018553 9591 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:29:05.022787 9591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/data/instance:
uuid: "67cb13f014ee4e7994dadd60547ecb44"
format_stamp: "Formatted at 2026-08-09 05:29:05 on dist-test-slave-h3ft"
server_key: "1c8b52633dd36738663196941bca8dfd"
server_key_iv: "769037a7695c22625049c774bc048e47"
server_key_version: "encryptionkey@0"
I20260809 05:29:05.023953 9591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance:
uuid: "67cb13f014ee4e7994dadd60547ecb44"
format_stamp: "Formatted at 2026-08-09 05:29:05 on dist-test-slave-h3ft"
server_key: "1c8b52633dd36738663196941bca8dfd"
server_key_iv: "769037a7695c22625049c774bc048e47"
server_key_version: "encryptionkey@0"
I20260809 05:29:05.030797 9591 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260809 05:29:05.035384 9613 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:29:05.037305 9591 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 05:29:05.037573 9591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "67cb13f014ee4e7994dadd60547ecb44"
format_stamp: "Formatted at 2026-08-09 05:29:05 on dist-test-slave-h3ft"
server_key: "1c8b52633dd36738663196941bca8dfd"
server_key_iv: "769037a7695c22625049c774bc048e47"
server_key_version: "encryptionkey@0"
I20260809 05:29:05.037875 9591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:29:05.072361 9591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:29:05.073760 9591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:29:05.074229 9591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:29:05.075630 9591 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:29:05.077778 9591 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:29:05.077956 9591 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:29:05.078111 9591 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:29:05.078207 9591 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:29:05.122494 9591 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:36913
I20260809 05:29:05.122538 9770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:36913 every 8 connection(s)
I20260809 05:29:05.124410 9591 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:29:05.132797 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 9591
I20260809 05:29:05.133107 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance
I20260809 05:29:05.134071 27364 external_mini_cluster.cc:1428] Setting key 36a1784917f94d124c1bbcbe31e0a7d7
I20260809 05:29:05.138335 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:0
--local_ip_for_outbound_sockets=127.26.185.2
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:33525
--builtin_ntp_servers=127.26.185.20:36715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 05:29:05.143396 9773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:05.128213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:35183 (local address 127.26.185.62:33525)
0809 05:29:05.128875 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:05.128881 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:05.130603 (+ 1722us) server_negotiation.cc:407] Connection header received
0809 05:29:05.133385 (+ 2782us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:05.133391 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:05.133499 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:05.133621 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:05.135534 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:05.136585 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:05.139415 (+ 2830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:05.140138 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:05.140305 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:05.142188 (+ 1883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:29:05.142193 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:29:05.142197 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:29:05.142222 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:29:05.142275 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:29:05.142298 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:29:05.142405 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 05:29:05.142734 (+ 329us) server_negotiation.cc:299] Negotiation successful
0809 05:29:05.142915 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":371,"threads_started":1}
I20260809 05:29:05.144850 9775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:05.128999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33525 (local address 127.26.185.1:35183)
0809 05:29:05.130351 (+ 1352us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:05.130414 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0809 05:29:05.132849 (+ 2435us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:29:05.134040 (+ 1191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:29:05.134064 (+ 24us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:29:05.134244 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:29:05.135322 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:05.135349 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:05.136903 (+ 1554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:05.136909 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:05.139100 (+ 2191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:05.139128 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:05.140449 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:05.140458 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:05.140775 (+ 317us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:05.141744 (+ 969us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 05:29:05.141747 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:29:05.141806 (+ 59us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 05:29:05.141923 (+ 117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:29:05.142405 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:29:05.142422 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:29:05.142434 (+ 12us) client_negotiation.cc:769] Sending connection context
0809 05:29:05.142705 (+ 271us) client_negotiation.cc:240] Negotiation successful
0809 05:29:05.143292 (+ 587us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":658,"thread_start_us":399,"threads_started":1}
I20260809 05:29:05.146944 9771 heartbeater.cc:347] Connected to a master server at 127.26.185.62:33525
I20260809 05:29:05.147439 9771 heartbeater.cc:464] Registering TS with master...
I20260809 05:29:05.148460 9771 heartbeater.cc:511] Master 127.26.185.62:33525 requested a full tablet report, sending...
I20260809 05:29:05.151295 9506 ts_manager.cc:194] Registered new tserver with Master: 67cb13f014ee4e7994dadd60547ecb44 (127.26.185.1:36913)
I20260809 05:29:05.153174 9506 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.185.1:35183
W20260809 05:29:05.596130 9776 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:29:05.596652 9776 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:29:05.596830 9776 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:29:05.605679 9776 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:29:05.605886 9776 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:29:05.606099 9776 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:29:05.617254 9776 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:36715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:33525
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:29:05.619282 9776 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:29:05.621806 9776 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:29:05.638819 9784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:29:05.639096 9790 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:29:05.638806 9782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:29:05.639868 9776 server_base.cc:1034] running on GCE node
I20260809 05:29:05.640848 9776 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:29:05.642279 9776 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:29:05.643577 9776 hybrid_clock.cc:648] HybridClock initialized: now 1786253345643509 us; error 57 us; skew 500 ppm
I20260809 05:29:05.644094 9776 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 05:29:05.647439 9776 webserver.cc:460] Webserver started at http://127.26.185.2:40067/ using document root <none> and password file <none>
I20260809 05:29:05.648406 9776 fs_manager.cc:359] Metadata directory not provided
I20260809 05:29:05.648562 9776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:29:05.648980 9776 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:29:05.652719 9776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/data/instance:
uuid: "4599cc2983624a209e637733f0211e7d"
format_stamp: "Formatted at 2026-08-09 05:29:05 on dist-test-slave-h3ft"
server_key: "d706dc66414ecb5f3a256b392a40adff"
server_key_iv: "ce66a6736717a914f7520f11c3c3c723"
server_key_version: "encryptionkey@0"
I20260809 05:29:05.653718 9776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance:
uuid: "4599cc2983624a209e637733f0211e7d"
format_stamp: "Formatted at 2026-08-09 05:29:05 on dist-test-slave-h3ft"
server_key: "d706dc66414ecb5f3a256b392a40adff"
server_key_iv: "ce66a6736717a914f7520f11c3c3c723"
server_key_version: "encryptionkey@0"
I20260809 05:29:05.660573 9776 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260809 05:29:05.665432 9797 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:29:05.667435 9776 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260809 05:29:05.667702 9776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "4599cc2983624a209e637733f0211e7d"
format_stamp: "Formatted at 2026-08-09 05:29:05 on dist-test-slave-h3ft"
server_key: "d706dc66414ecb5f3a256b392a40adff"
server_key_iv: "ce66a6736717a914f7520f11c3c3c723"
server_key_version: "encryptionkey@0"
I20260809 05:29:05.668015 9776 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:29:05.694926 9776 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:29:05.696341 9776 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:29:05.696795 9776 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:29:05.698207 9776 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:29:05.700335 9776 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:29:05.700493 9776 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:29:05.700668 9776 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:29:05.700768 9776 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:29:05.745924 9776 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:42139
I20260809 05:29:05.746014 9961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:42139 every 8 connection(s)
I20260809 05:29:05.747978 9776 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:29:05.753811 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 9776
I20260809 05:29:05.754163 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance
I20260809 05:29:05.754746 27364 external_mini_cluster.cc:1428] Setting key fd2cf64c6b64e175100f4113006a87d5
I20260809 05:29:05.758496 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:0
--local_ip_for_outbound_sockets=127.26.185.3
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:33525
--builtin_ntp_servers=127.26.185.20:36715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 05:29:05.771379 9966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:05.752013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:38961 (local address 127.26.185.62:33525)
0809 05:29:05.752750 (+ 737us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:05.752757 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:05.754791 (+ 2034us) server_negotiation.cc:407] Connection header received
0809 05:29:05.757110 (+ 2319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:05.757116 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:05.757227 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:05.757369 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:05.758921 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:05.759836 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:05.761734 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:05.762300 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:05.762470 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:05.770081 (+ 7611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:29:05.770089 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:29:05.770093 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:29:05.770123 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:29:05.770190 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:29:05.770207 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:29:05.770339 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 05:29:05.770684 (+ 345us) server_negotiation.cc:299] Negotiation successful
0809 05:29:05.770851 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":579,"thread_start_us":383,"threads_started":1}
I20260809 05:29:05.773138 9967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:05.752978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33525 (local address 127.26.185.2:38961)
0809 05:29:05.754504 (+ 1526us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:05.754570 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0809 05:29:05.756751 (+ 2181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:29:05.757714 (+ 963us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:29:05.757725 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:29:05.757851 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:29:05.758700 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:05.758736 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:05.760018 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:05.760024 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:05.761547 (+ 1523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:05.761563 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:05.762610 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:05.762618 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:05.762915 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:05.769439 (+ 6524us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 05:29:05.769443 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:29:05.769519 (+ 76us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 05:29:05.769683 (+ 164us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:29:05.770352 (+ 669us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:29:05.770374 (+ 22us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:29:05.770392 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 05:29:05.770666 (+ 274us) client_negotiation.cc:240] Negotiation successful
0809 05:29:05.771408 (+ 742us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":750,"thread_start_us":496,"threads_started":1}
I20260809 05:29:05.775394 9962 heartbeater.cc:347] Connected to a master server at 127.26.185.62:33525
I20260809 05:29:05.775843 9962 heartbeater.cc:464] Registering TS with master...
I20260809 05:29:05.777153 9962 heartbeater.cc:511] Master 127.26.185.62:33525 requested a full tablet report, sending...
I20260809 05:29:05.779816 9506 ts_manager.cc:194] Registered new tserver with Master: 4599cc2983624a209e637733f0211e7d (127.26.185.2:42139)
I20260809 05:29:05.781384 9506 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.185.2:38961
I20260809 05:29:06.157523 9771 heartbeater.cc:503] Master 127.26.185.62:33525 was elected leader, sending a full tablet report...
W20260809 05:29:06.218212 9969 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:29:06.218827 9969 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:29:06.219060 9969 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:29:06.233388 9969 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:29:06.233579 9969 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:29:06.233824 9969 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:29:06.250744 9969 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:36715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:33525
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:29:06.253448 9969 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:29:06.257113 9969 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:29:06.276501 9975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:29:06.276433 9978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:29:06.276384 9976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:29:06.278517 9969 server_base.cc:1034] running on GCE node
I20260809 05:29:06.279408 9969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:29:06.280668 9969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:29:06.281901 9969 hybrid_clock.cc:648] HybridClock initialized: now 1786253346281781 us; error 106 us; skew 500 ppm
I20260809 05:29:06.282337 9969 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 05:29:06.285648 9969 webserver.cc:460] Webserver started at http://127.26.185.3:42081/ using document root <none> and password file <none>
I20260809 05:29:06.286708 9969 fs_manager.cc:359] Metadata directory not provided
I20260809 05:29:06.286823 9969 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:29:06.287352 9969 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:29:06.291322 9969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/data/instance:
uuid: "e83e227aa9514812a67cdf4b4784d623"
format_stamp: "Formatted at 2026-08-09 05:29:06 on dist-test-slave-h3ft"
server_key: "29c54614e2d4f3792e6cdf5d6eee8675"
server_key_iv: "117d81dc8e59e22dd7a028adb338968a"
server_key_version: "encryptionkey@0"
I20260809 05:29:06.292335 9969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance:
uuid: "e83e227aa9514812a67cdf4b4784d623"
format_stamp: "Formatted at 2026-08-09 05:29:06 on dist-test-slave-h3ft"
server_key: "29c54614e2d4f3792e6cdf5d6eee8675"
server_key_iv: "117d81dc8e59e22dd7a028adb338968a"
server_key_version: "encryptionkey@0"
I20260809 05:29:06.299522 9969 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260809 05:29:06.304191 9985 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:29:06.306071 9969 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260809 05:29:06.306272 9969 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "e83e227aa9514812a67cdf4b4784d623"
format_stamp: "Formatted at 2026-08-09 05:29:06 on dist-test-slave-h3ft"
server_key: "29c54614e2d4f3792e6cdf5d6eee8675"
server_key_iv: "117d81dc8e59e22dd7a028adb338968a"
server_key_version: "encryptionkey@0"
I20260809 05:29:06.306524 9969 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:29:06.336374 9969 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:29:06.337605 9969 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:29:06.337975 9969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:29:06.339294 9969 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:29:06.341202 9969 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:29:06.341308 9969 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:29:06.341398 9969 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:29:06.341459 9969 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:29:06.385808 9969 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:34143
I20260809 05:29:06.385874 10144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:34143 every 8 connection(s)
I20260809 05:29:06.387620 9969 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:29:06.389161 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 9969
I20260809 05:29:06.389401 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance
I20260809 05:29:06.389915 27364 external_mini_cluster.cc:1428] Setting key 03ef6c3ec8fed9530446f57744c4ac5f
I20260809 05:29:06.404819 10148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:06.391184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:37715 (local address 127.26.185.62:33525)
0809 05:29:06.392040 (+ 856us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:06.392048 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:06.393889 (+ 1841us) server_negotiation.cc:407] Connection header received
0809 05:29:06.396164 (+ 2275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:06.396169 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:06.396258 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:06.396366 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:06.397776 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:06.398693 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:06.401206 (+ 2513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:06.401677 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:06.401795 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:06.403617 (+ 1822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:29:06.403623 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:29:06.403626 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:29:06.403654 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:29:06.403707 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:29:06.403721 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:29:06.403799 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 05:29:06.404153 (+ 354us) server_negotiation.cc:299] Negotiation successful
0809 05:29:06.404312 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":695,"thread_start_us":530,"threads_started":1}
I20260809 05:29:06.406338 10149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:06.392200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33525 (local address 127.26.185.3:37715)
0809 05:29:06.393653 (+ 1453us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:06.393719 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0809 05:29:06.395834 (+ 2115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:29:06.396645 (+ 811us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:29:06.396656 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:29:06.396782 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:29:06.397597 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:06.397618 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:06.398911 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:06.398916 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:06.401022 (+ 2106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:06.401045 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:06.401966 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:06.401972 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:06.402248 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:06.403194 (+ 946us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 05:29:06.403197 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:29:06.403254 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 05:29:06.403378 (+ 124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:29:06.403826 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:29:06.403836 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:29:06.403843 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 05:29:06.404078 (+ 235us) client_negotiation.cc:240] Negotiation successful
0809 05:29:06.404575 (+ 497us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":698,"thread_start_us":409,"threads_started":1}
I20260809 05:29:06.408308 10145 heartbeater.cc:347] Connected to a master server at 127.26.185.62:33525
I20260809 05:29:06.408766 10145 heartbeater.cc:464] Registering TS with master...
I20260809 05:29:06.409776 10145 heartbeater.cc:511] Master 127.26.185.62:33525 requested a full tablet report, sending...
I20260809 05:29:06.411748 9506 ts_manager.cc:194] Registered new tserver with Master: e83e227aa9514812a67cdf4b4784d623 (127.26.185.3:34143)
I20260809 05:29:06.412897 9506 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.185.3:37715
I20260809 05:29:06.421480 27364 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 05:29:06.429889 10148 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:29:06.427534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59798 (local address 127.26.185.62:33525)
0809 05:29:06.427826 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:06.427837 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:06.428416 (+ 579us) server_negotiation.cc:407] Connection header received
0809 05:29:06.428643 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:06.428648 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:06.428732 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:06.428832 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:06.429567 (+ 735us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59798: BlockingRecv error: recv got EOF from 127.0.0.1:59798 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 05:29:06.430292 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 9591
I20260809 05:29:06.441043 10159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:06.432288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37122 (local address 127.26.185.1:36913)
0809 05:29:06.432993 (+ 705us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:06.433008 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:06.433045 (+ 37us) server_negotiation.cc:407] Connection header received
0809 05:29:06.433165 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:06.433174 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:06.433512 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:06.433687 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:06.434200 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:06.435512 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:06.436885 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:06.437627 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:06.437742 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:06.439151 (+ 1409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:29:06.439162 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:29:06.439182 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:29:06.439959 (+ 777us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:29:06.440023 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:29:06.440049 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:29:06.440194 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 05:29:06.440365 (+ 171us) server_negotiation.cc:299] Negotiation successful
0809 05:29:06.440517 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":502,"thread_start_us":341,"threads_started":1}
I20260809 05:29:06.442941 9765 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:29:06.539324 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 9591
I20260809 05:29:06.569557 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 9776
I20260809 05:29:06.580356 10161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:06.570872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57796 (local address 127.26.185.2:42139)
0809 05:29:06.571723 (+ 851us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:06.571736 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:06.571786 (+ 50us) server_negotiation.cc:407] Connection header received
0809 05:29:06.571901 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:06.571912 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:06.572322 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:06.572558 (+ 236us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:06.573208 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:06.574994 (+ 1786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:06.576486 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:06.577189 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:06.577300 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:06.578470 (+ 1170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:29:06.578480 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:29:06.578498 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:29:06.579399 (+ 901us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:29:06.579468 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:29:06.579493 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:29:06.579599 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 05:29:06.579783 (+ 184us) server_negotiation.cc:299] Negotiation successful
0809 05:29:06.579948 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":639,"thread_start_us":436,"threads_started":1}
I20260809 05:29:06.582358 9954 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:29:06.676512 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 9776
I20260809 05:29:06.704759 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 9969
I20260809 05:29:06.716351 10165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:06.706299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49924 (local address 127.26.185.3:34143)
0809 05:29:06.707226 (+ 927us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:06.707235 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:06.707277 (+ 42us) server_negotiation.cc:407] Connection header received
0809 05:29:06.707361 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:06.707369 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:06.707682 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:06.707841 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:06.708413 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:06.709694 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:06.711517 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:06.712426 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:06.712574 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:06.714005 (+ 1431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:29:06.714017 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:29:06.714038 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:29:06.714928 (+ 890us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:29:06.715078 (+ 150us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:29:06.715118 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:29:06.715247 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 05:29:06.715583 (+ 336us) server_negotiation.cc:299] Negotiation successful
0809 05:29:06.715837 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":659,"thread_start_us":458,"threads_started":1}
I20260809 05:29:06.718371 10138 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:29:06.813467 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 9969
I20260809 05:29:06.848712 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 9457
I20260809 05:29:06.850898 9546 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:29:06.980895 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 9457
2026-08-09T05:29:07Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (3344 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-09T05:29:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:29:07Z Disabled control of system clock
I20260809 05:29:07.104805 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:46649
--webserver_interface=127.26.185.62
--webserver_port=0
--builtin_ntp_servers=127.26.185.20:35905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:46649
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 05:29:07.546635 10176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:29:07.547138 10176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:29:07.547348 10176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:29:07.555775 10176 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:29:07.555972 10176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:29:07.556018 10176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:29:07.556152 10176 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:29:07.556224 10176 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:29:07.567204 10176 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:35905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:46649
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:46649
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:29:07.569375 10176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:29:07.572026 10176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:29:07.589125 10183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:29:07.589149 10182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:29:07.590188 10185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:29:07.590219 10176 server_base.cc:1034] running on GCE node
I20260809 05:29:07.591574 10176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:29:07.593647 10176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:29:07.594925 10176 hybrid_clock.cc:648] HybridClock initialized: now 1786253347594843 us; error 115 us; skew 500 ppm
I20260809 05:29:07.595454 10176 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 05:29:07.598613 10176 webserver.cc:460] Webserver started at http://127.26.185.62:38915/ using document root <none> and password file <none>
I20260809 05:29:07.599706 10176 fs_manager.cc:359] Metadata directory not provided
I20260809 05:29:07.599864 10176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:29:07.600288 10176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:29:07.604259 10176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "7a744705491241109de05b3336e0bc84"
format_stamp: "Formatted at 2026-08-09 05:29:07 on dist-test-slave-h3ft"
server_key: "95818d79bd7a198bec7b960174efdfd9"
server_key_iv: "3c1c69039a3e7de6a06a509fa6af7100"
server_key_version: "encryptionkey@0"
I20260809 05:29:07.605355 10176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "7a744705491241109de05b3336e0bc84"
format_stamp: "Formatted at 2026-08-09 05:29:07 on dist-test-slave-h3ft"
server_key: "95818d79bd7a198bec7b960174efdfd9"
server_key_iv: "3c1c69039a3e7de6a06a509fa6af7100"
server_key_version: "encryptionkey@0"
I20260809 05:29:07.612547 10176 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.004s
I20260809 05:29:07.617318 10192 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:29:07.619319 10176 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260809 05:29:07.619575 10176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "7a744705491241109de05b3336e0bc84"
format_stamp: "Formatted at 2026-08-09 05:29:07 on dist-test-slave-h3ft"
server_key: "95818d79bd7a198bec7b960174efdfd9"
server_key_iv: "3c1c69039a3e7de6a06a509fa6af7100"
server_key_version: "encryptionkey@0"
I20260809 05:29:07.619874 10176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:29:07.627593 10176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:29:07.628777 10176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:29:07.629195 10176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:29:07.653447 10176 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:46649
I20260809 05:29:07.653494 10265 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:46649 every 8 connection(s)
I20260809 05:29:07.655495 10176 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:29:07.658340 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 10176
I20260809 05:29:07.658632 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:29:07.659723 27364 external_mini_cluster.cc:1428] Setting key bfaba753975033a1c651bc2b5ec5f5f3
I20260809 05:29:07.662940 10268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:29:07.672180 10274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:07.662677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50002 (local address 127.26.185.62:46649)
0809 05:29:07.664311 (+ 1634us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:07.664341 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:07.664410 (+ 69us) server_negotiation.cc:407] Connection header received
0809 05:29:07.666501 (+ 2091us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:07.666536 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:07.667280 (+ 744us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:07.667809 (+ 529us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:07.669645 (+ 1836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:29:07.669653 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:29:07.669675 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:29:07.669697 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:29:07.669820 (+ 123us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:29:07.669843 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:29:07.670077 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0809 05:29:07.670223 (+ 146us) server_negotiation.cc:299] Negotiation successful
0809 05:29:07.670704 (+ 481us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1005,"thread_start_us":702,"threads_started":1}
I20260809 05:29:07.680492 10268 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a744705491241109de05b3336e0bc84: Bootstrap starting.
I20260809 05:29:07.685103 10268 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7a744705491241109de05b3336e0bc84: Neither blocks nor log segments found. Creating new log.
I20260809 05:29:07.686820 10268 log.cc:824] T 00000000000000000000000000000000 P 7a744705491241109de05b3336e0bc84: Log is configured to *not* fsync() on all Append() calls
I20260809 05:29:07.691570 10268 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a744705491241109de05b3336e0bc84: No bootstrap required, opened a new log
I20260809 05:29:07.701293 10268 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7a744705491241109de05b3336e0bc84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a744705491241109de05b3336e0bc84" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 46649 } }
I20260809 05:29:07.701907 10268 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7a744705491241109de05b3336e0bc84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:29:07.702052 10268 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7a744705491241109de05b3336e0bc84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a744705491241109de05b3336e0bc84, State: Initialized, Role: FOLLOWER
I20260809 05:29:07.702885 10268 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7a744705491241109de05b3336e0bc84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a744705491241109de05b3336e0bc84" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 46649 } }
I20260809 05:29:07.703262 10268 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7a744705491241109de05b3336e0bc84 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:29:07.703437 10268 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7a744705491241109de05b3336e0bc84 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:29:07.703670 10268 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7a744705491241109de05b3336e0bc84 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:29:07.706393 10268 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7a744705491241109de05b3336e0bc84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a744705491241109de05b3336e0bc84" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 46649 } }
I20260809 05:29:07.707239 10268 leader_election.cc:302] T 00000000000000000000000000000000 P 7a744705491241109de05b3336e0bc84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7a744705491241109de05b3336e0bc84; no voters:
I20260809 05:29:07.708081 10268 leader_election.cc:288] T 00000000000000000000000000000000 P 7a744705491241109de05b3336e0bc84 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:29:07.708369 10276 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7a744705491241109de05b3336e0bc84 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:29:07.710659 10276 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7a744705491241109de05b3336e0bc84 [term 1 LEADER]: Becoming Leader. State: Replica: 7a744705491241109de05b3336e0bc84, State: Running, Role: LEADER
I20260809 05:29:07.711536 10276 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7a744705491241109de05b3336e0bc84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a744705491241109de05b3336e0bc84" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 46649 } }
I20260809 05:29:07.711885 10268 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7a744705491241109de05b3336e0bc84 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:29:07.715553 10279 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a744705491241109de05b3336e0bc84 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7a744705491241109de05b3336e0bc84. Latest consensus state: current_term: 1 leader_uuid: "7a744705491241109de05b3336e0bc84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a744705491241109de05b3336e0bc84" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 46649 } } }
I20260809 05:29:07.716137 10277 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a744705491241109de05b3336e0bc84 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7a744705491241109de05b3336e0bc84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a744705491241109de05b3336e0bc84" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 46649 } } }
I20260809 05:29:07.716467 10279 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a744705491241109de05b3336e0bc84 [sys.catalog]: This master's current role is: LEADER
I20260809 05:29:07.716533 10277 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a744705491241109de05b3336e0bc84 [sys.catalog]: This master's current role is: LEADER
I20260809 05:29:07.717669 10288 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:29:07.726241 10288 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:29:07.741693 10288 catalog_manager.cc:1347] Generated new cluster ID: 9a9f354694b84ec39823ee47e624b5a4
I20260809 05:29:07.742000 10288 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:29:07.779254 10288 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:29:07.780267 10288 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:29:07.791507 10288 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7a744705491241109de05b3336e0bc84: Generated new TSK 0
I20260809 05:29:07.792840 10288 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 05:29:07.799081 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:0
--local_ip_for_outbound_sockets=127.26.185.1
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:46649
--builtin_ntp_servers=127.26.185.20:35905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 05:29:08.282388 10302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:29:08.282845 10302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:29:08.283005 10302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:29:08.291723 10302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:29:08.291887 10302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:29:08.292026 10302 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:29:08.303313 10302 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:35905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:46649
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:29:08.305133 10302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:29:08.307547 10302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:29:08.324777 10311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:29:08.324888 10314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:29:08.324885 10312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:29:08.329205 10302 server_base.cc:1034] running on GCE node
I20260809 05:29:08.330118 10302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:29:08.331569 10302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:29:08.332880 10302 hybrid_clock.cc:648] HybridClock initialized: now 1786253348332781 us; error 81 us; skew 500 ppm
I20260809 05:29:08.333345 10302 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 05:29:08.336540 10302 webserver.cc:460] Webserver started at http://127.26.185.1:38147/ using document root <none> and password file <none>
I20260809 05:29:08.337483 10302 fs_manager.cc:359] Metadata directory not provided
I20260809 05:29:08.337639 10302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:29:08.338042 10302 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:29:08.341830 10302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/data/instance:
uuid: "2486fe25b899475f829870567a7566b7"
format_stamp: "Formatted at 2026-08-09 05:29:08 on dist-test-slave-h3ft"
server_key: "50c4e882be0b532b5b3e916194996667"
server_key_iv: "52559919b095a9bff4131998c527e149"
server_key_version: "encryptionkey@0"
I20260809 05:29:08.342877 10302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance:
uuid: "2486fe25b899475f829870567a7566b7"
format_stamp: "Formatted at 2026-08-09 05:29:08 on dist-test-slave-h3ft"
server_key: "50c4e882be0b532b5b3e916194996667"
server_key_iv: "52559919b095a9bff4131998c527e149"
server_key_version: "encryptionkey@0"
I20260809 05:29:08.349923 10302 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260809 05:29:08.354686 10322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:29:08.356819 10302 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:29:08.357085 10302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "2486fe25b899475f829870567a7566b7"
format_stamp: "Formatted at 2026-08-09 05:29:08 on dist-test-slave-h3ft"
server_key: "50c4e882be0b532b5b3e916194996667"
server_key_iv: "52559919b095a9bff4131998c527e149"
server_key_version: "encryptionkey@0"
I20260809 05:29:08.357393 10302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:29:08.364900 10302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:29:08.366034 10302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:29:08.366380 10302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:29:08.367671 10302 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:29:08.369565 10302 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:29:08.369714 10302 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:29:08.369858 10302 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:29:08.369956 10302 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:29:08.410840 10302 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:38647
I20260809 05:29:08.410921 10489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:38647 every 8 connection(s)
I20260809 05:29:08.412838 10302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:29:08.416741 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 10302
I20260809 05:29:08.417035 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance
I20260809 05:29:08.418076 27364 external_mini_cluster.cc:1428] Setting key 7aeec2a8942179017114bb4bbeb34c4d
I20260809 05:29:08.422196 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:0
--local_ip_for_outbound_sockets=127.26.185.2
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:46649
--builtin_ntp_servers=127.26.185.20:35905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 05:29:08.425247 10493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:08.416647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:32979 (local address 127.26.185.62:46649)
0809 05:29:08.417526 (+ 879us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:08.417534 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:08.419391 (+ 1857us) server_negotiation.cc:407] Connection header received
0809 05:29:08.421969 (+ 2578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:08.421974 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:08.422040 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:08.422150 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:08.424276 (+ 2126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:29:08.424281 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:29:08.424285 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:29:08.424308 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:29:08.424365 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:29:08.424379 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:29:08.424558 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0809 05:29:08.424810 (+ 252us) server_negotiation.cc:299] Negotiation successful
0809 05:29:08.424886 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":703,"thread_start_us":527,"threads_started":1}
I20260809 05:29:08.427122 10495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:08.417533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:46649 (local address 127.26.185.1:32979)
0809 05:29:08.419172 (+ 1639us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:08.419224 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 05:29:08.421571 (+ 2347us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:29:08.422539 (+ 968us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:29:08.422556 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:29:08.422724 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:29:08.423749 (+ 1025us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 05:29:08.423755 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:29:08.423830 (+ 75us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 05:29:08.424003 (+ 173us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:29:08.424547 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:29:08.424563 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:29:08.424576 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 05:29:08.424926 (+ 350us) client_negotiation.cc:240] Negotiation successful
0809 05:29:08.425324 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":725,"thread_start_us":458,"threads_started":1}
I20260809 05:29:08.429194 10490 heartbeater.cc:347] Connected to a master server at 127.26.185.62:46649
I20260809 05:29:08.429608 10490 heartbeater.cc:464] Registering TS with master...
I20260809 05:29:08.430425 10490 heartbeater.cc:511] Master 127.26.185.62:46649 requested a full tablet report, sending...
I20260809 05:29:08.433192 10219 ts_manager.cc:194] Registered new tserver with Master: 2486fe25b899475f829870567a7566b7 (127.26.185.1:38647)
W20260809 05:29:08.891641 10496 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:29:08.892158 10496 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:29:08.892355 10496 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:29:08.900998 10496 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:29:08.901226 10496 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:29:08.901437 10496 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:29:08.912254 10496 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:35905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:46649
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:29:08.914351 10496 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:29:08.916838 10496 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:29:08.937170 10504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:29:08.937340 10505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:29:08.937350 10507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:29:08.939112 10496 server_base.cc:1034] running on GCE node
I20260809 05:29:08.940073 10496 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:29:08.941504 10496 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:29:08.942840 10496 hybrid_clock.cc:648] HybridClock initialized: now 1786253348942749 us; error 76 us; skew 500 ppm
I20260809 05:29:08.943347 10496 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 05:29:08.946671 10496 webserver.cc:460] Webserver started at http://127.26.185.2:32825/ using document root <none> and password file <none>
I20260809 05:29:08.947777 10496 fs_manager.cc:359] Metadata directory not provided
I20260809 05:29:08.947943 10496 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:29:08.948367 10496 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:29:08.952263 10496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/data/instance:
uuid: "21ab018eec6d45ba9ecc62bce81020fb"
format_stamp: "Formatted at 2026-08-09 05:29:08 on dist-test-slave-h3ft"
server_key: "0da42e37903f74917c7ce046223aede2"
server_key_iv: "aa3fc3f7f18bb03a61562f4709aea759"
server_key_version: "encryptionkey@0"
I20260809 05:29:08.953363 10496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance:
uuid: "21ab018eec6d45ba9ecc62bce81020fb"
format_stamp: "Formatted at 2026-08-09 05:29:08 on dist-test-slave-h3ft"
server_key: "0da42e37903f74917c7ce046223aede2"
server_key_iv: "aa3fc3f7f18bb03a61562f4709aea759"
server_key_version: "encryptionkey@0"
I20260809 05:29:08.961119 10496 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.004s
I20260809 05:29:08.966547 10514 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:29:08.969462 10496 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.002s
I20260809 05:29:08.969798 10496 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "21ab018eec6d45ba9ecc62bce81020fb"
format_stamp: "Formatted at 2026-08-09 05:29:08 on dist-test-slave-h3ft"
server_key: "0da42e37903f74917c7ce046223aede2"
server_key_iv: "aa3fc3f7f18bb03a61562f4709aea759"
server_key_version: "encryptionkey@0"
I20260809 05:29:08.970170 10496 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:29:08.978778 10496 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:29:08.980181 10496 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:29:08.980576 10496 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:29:08.981889 10496 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:29:08.983958 10496 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:29:08.984119 10496 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:29:08.984273 10496 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:29:08.984378 10496 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:29:09.027271 10496 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:35527
I20260809 05:29:09.027311 10671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:35527 every 8 connection(s)
I20260809 05:29:09.029194 10496 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:29:09.036417 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 10496
I20260809 05:29:09.036615 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance
I20260809 05:29:09.037233 27364 external_mini_cluster.cc:1428] Setting key 278e041dba155ebb5656ca6c0810c7c8
I20260809 05:29:09.041291 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:0
--local_ip_for_outbound_sockets=127.26.185.3
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:46649
--builtin_ntp_servers=127.26.185.20:35905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 05:29:09.041386 10674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:09.033142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:35351 (local address 127.26.185.62:46649)
0809 05:29:09.033788 (+ 646us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:09.033796 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:09.035561 (+ 1765us) server_negotiation.cc:407] Connection header received
0809 05:29:09.037947 (+ 2386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:09.037955 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:09.038056 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:09.038188 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:09.040377 (+ 2189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:29:09.040383 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:29:09.040387 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:29:09.040411 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:29:09.040477 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:29:09.040493 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:29:09.040664 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 05:29:09.040898 (+ 234us) server_negotiation.cc:299] Negotiation successful
0809 05:29:09.041000 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":483,"thread_start_us":345,"threads_started":1}
I20260809 05:29:09.043259 10675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:09.033957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:46649 (local address 127.26.185.2:35351)
0809 05:29:09.035322 (+ 1365us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:09.035380 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 05:29:09.037507 (+ 2127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:29:09.038583 (+ 1076us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:29:09.038595 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:29:09.038739 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:29:09.039875 (+ 1136us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 05:29:09.039880 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:29:09.039951 (+ 71us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 05:29:09.040134 (+ 183us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:29:09.040610 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:29:09.040626 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:29:09.040638 (+ 12us) client_negotiation.cc:769] Sending connection context
0809 05:29:09.041044 (+ 406us) client_negotiation.cc:240] Negotiation successful
0809 05:29:09.041472 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":626,"thread_start_us":359,"threads_started":1}
I20260809 05:29:09.045549 10672 heartbeater.cc:347] Connected to a master server at 127.26.185.62:46649
I20260809 05:29:09.046116 10672 heartbeater.cc:464] Registering TS with master...
I20260809 05:29:09.047158 10672 heartbeater.cc:511] Master 127.26.185.62:46649 requested a full tablet report, sending...
I20260809 05:29:09.049528 10219 ts_manager.cc:194] Registered new tserver with Master: 21ab018eec6d45ba9ecc62bce81020fb (127.26.185.2:35527)
I20260809 05:29:09.437191 10490 heartbeater.cc:503] Master 127.26.185.62:46649 was elected leader, sending a full tablet report...
W20260809 05:29:09.497259 10676 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:29:09.497653 10676 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:29:09.497761 10676 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:29:09.505944 10676 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:29:09.506112 10676 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:29:09.506249 10676 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:29:09.516986 10676 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:35905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:46649
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:29:09.518963 10676 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:29:09.521332 10676 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:29:09.538470 10687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:29:09.538400 10690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:29:09.538460 10685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:29:09.539407 10676 server_base.cc:1034] running on GCE node
I20260809 05:29:09.540342 10676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:29:09.541590 10676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:29:09.542889 10676 hybrid_clock.cc:648] HybridClock initialized: now 1786253349542756 us; error 123 us; skew 500 ppm
I20260809 05:29:09.543347 10676 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 05:29:09.547566 10676 webserver.cc:460] Webserver started at http://127.26.185.3:43843/ using document root <none> and password file <none>
I20260809 05:29:09.548568 10676 fs_manager.cc:359] Metadata directory not provided
I20260809 05:29:09.548722 10676 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:29:09.549160 10676 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:29:09.553088 10676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/data/instance:
uuid: "4e257f4d1c48484eb62b3eab80566aad"
format_stamp: "Formatted at 2026-08-09 05:29:09 on dist-test-slave-h3ft"
server_key: "e4bcc7a86b091ea97ffed5b5bf152541"
server_key_iv: "ebcf30f0b2b8f8c7470d6469a0cd96ca"
server_key_version: "encryptionkey@0"
I20260809 05:29:09.554119 10676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance:
uuid: "4e257f4d1c48484eb62b3eab80566aad"
format_stamp: "Formatted at 2026-08-09 05:29:09 on dist-test-slave-h3ft"
server_key: "e4bcc7a86b091ea97ffed5b5bf152541"
server_key_iv: "ebcf30f0b2b8f8c7470d6469a0cd96ca"
server_key_version: "encryptionkey@0"
I20260809 05:29:09.560873 10676 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260809 05:29:09.565738 10699 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:29:09.567759 10676 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260809 05:29:09.567994 10676 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "4e257f4d1c48484eb62b3eab80566aad"
format_stamp: "Formatted at 2026-08-09 05:29:09 on dist-test-slave-h3ft"
server_key: "e4bcc7a86b091ea97ffed5b5bf152541"
server_key_iv: "ebcf30f0b2b8f8c7470d6469a0cd96ca"
server_key_version: "encryptionkey@0"
I20260809 05:29:09.568292 10676 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:29:09.576005 10676 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:29:09.577256 10676 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:29:09.577620 10676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:29:09.578817 10676 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:29:09.580816 10676 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:29:09.580958 10676 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:29:09.581118 10676 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:29:09.581216 10676 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:29:09.628188 10676 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:32943
I20260809 05:29:09.628285 10866 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:32943 every 8 connection(s)
I20260809 05:29:09.630049 10676 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:29:09.637003 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 10676
I20260809 05:29:09.637287 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance
I20260809 05:29:09.637931 27364 external_mini_cluster.cc:1428] Setting key ce96ed824123348355d4ff9f953f0f6b
I20260809 05:29:09.641551 10870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:09.633585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:35755 (local address 127.26.185.62:46649)
0809 05:29:09.634193 (+ 608us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:09.634202 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:09.636085 (+ 1883us) server_negotiation.cc:407] Connection header received
0809 05:29:09.638452 (+ 2367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:09.638459 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:09.638549 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:09.638704 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:09.640526 (+ 1822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:29:09.640533 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:29:09.640539 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:29:09.640571 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:29:09.640628 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:29:09.640642 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:29:09.640782 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 05:29:09.641046 (+ 264us) server_negotiation.cc:299] Negotiation successful
0809 05:29:09.641137 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":342,"threads_started":1}
I20260809 05:29:09.642860 10871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:09.634338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:46649 (local address 127.26.185.3:35755)
0809 05:29:09.635885 (+ 1547us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:09.635938 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 05:29:09.638042 (+ 2104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:29:09.639067 (+ 1025us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:29:09.639082 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:29:09.639224 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:29:09.640136 (+ 912us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 05:29:09.640139 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:29:09.640192 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 05:29:09.640308 (+ 116us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:29:09.640753 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:29:09.640767 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:29:09.640777 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 05:29:09.641152 (+ 375us) client_negotiation.cc:240] Negotiation successful
0809 05:29:09.641509 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":764,"thread_start_us":468,"threads_started":1}
I20260809 05:29:09.644577 10868 heartbeater.cc:347] Connected to a master server at 127.26.185.62:46649
I20260809 05:29:09.645108 10868 heartbeater.cc:464] Registering TS with master...
I20260809 05:29:09.645925 10868 heartbeater.cc:511] Master 127.26.185.62:46649 requested a full tablet report, sending...
I20260809 05:29:09.647926 10219 ts_manager.cc:194] Registered new tserver with Master: 4e257f4d1c48484eb62b3eab80566aad (127.26.185.3:32943)
I20260809 05:29:09.655527 27364 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 05:29:09.663697 10870 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:29:09.661317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52608 (local address 127.26.185.62:46649)
0809 05:29:09.661557 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:09.661564 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:09.662484 (+ 920us) server_negotiation.cc:407] Connection header received
0809 05:29:09.662666 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:09.662671 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:09.662737 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:09.662832 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:09.663387 (+ 555us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52608: BlockingRecv error: recv got EOF from 127.0.0.1:52608 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 05:29:09.664529 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 10302
I20260809 05:29:09.669358 10881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:09.666002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54556 (local address 127.26.185.1:38647)
0809 05:29:09.666739 (+ 737us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:09.666748 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:09.666787 (+ 39us) server_negotiation.cc:407] Connection header received
0809 05:29:09.666877 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:09.666885 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:09.667254 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:09.667425 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:09.668572 (+ 1147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:29:09.668581 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:29:09.668597 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:29:09.668611 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:29:09.668670 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:29:09.668687 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:29:09.668853 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 05:29:09.668906 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 05:29:09.669030 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":368,"threads_started":1}
I20260809 05:29:09.671267 10484 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:29:09.765590 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 10302
I20260809 05:29:09.797236 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 10496
I20260809 05:29:09.802255 10883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:09.798695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37326 (local address 127.26.185.2:35527)
0809 05:29:09.799397 (+ 702us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:09.799406 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:09.799443 (+ 37us) server_negotiation.cc:407] Connection header received
0809 05:29:09.799525 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:09.799534 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:09.799833 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:09.800109 (+ 276us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:09.801364 (+ 1255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:29:09.801372 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:29:09.801388 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:29:09.801408 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:29:09.801457 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:29:09.801473 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:29:09.801668 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0809 05:29:09.801767 (+ 99us) server_negotiation.cc:299] Negotiation successful
0809 05:29:09.801902 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":530,"thread_start_us":370,"threads_started":1}
I20260809 05:29:09.804246 10665 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:29:09.898217 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 10496
I20260809 05:29:09.929999 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 10676
I20260809 05:29:09.936149 10886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:09.931657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51554 (local address 127.26.185.3:32943)
0809 05:29:09.932784 (+ 1127us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:09.932793 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:09.932835 (+ 42us) server_negotiation.cc:407] Connection header received
0809 05:29:09.932970 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:09.932979 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:09.933308 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:09.933484 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:09.934790 (+ 1306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:29:09.934798 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:29:09.934814 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:29:09.934838 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:29:09.934937 (+ 99us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:29:09.934957 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:29:09.935234 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0809 05:29:09.935520 (+ 286us) server_negotiation.cc:299] Negotiation successful
0809 05:29:09.935701 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":937,"thread_start_us":618,"threads_started":1}
I20260809 05:29:09.937917 10861 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:29:10.035107 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 10676
I20260809 05:29:10.071919 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 10176
I20260809 05:29:10.074087 10258 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:29:10.196019 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 10176
2026-08-09T05:29:10Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (3210 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:29:10 dist-test-slave-h3ft krb5kdc[10894](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:29:10 dist-test-slave-h3ft krb5kdc[10894](info): set up 2 sockets
Aug 09 05:29:10 dist-test-slave-h3ft krb5kdc[10894](info): commencing operation
krb5kdc: starting...
W20260809 05:29:11.617719 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.362s user 0.001s sys 0.058s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:29:11 dist-test-slave-h3ft krb5kdc[10894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253351, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:29:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:29:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
I20260809 05:29:12.008534 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:45335
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:46257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:45335
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:29:12.434618 10916 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:29:12.435081 10916 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:29:12.435267 10916 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:29:12.443238 10916 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:29:12.443368 10916 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:29:12.443454 10916 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:29:12.443552 10916 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:29:12.443616 10916 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:29:12.454867 10916 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:46257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:45335
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:45335
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:29:12.457115 10916 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:29:12.459062 10916 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:29:12.473949 10921 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:29:12.474086 10923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:29:12.474054 10925 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:29:12.475203 10916 server_base.cc:1034] running on GCE node
I20260809 05:29:12.476101 10916 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:29:12.477794 10916 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:29:12.479127 10916 hybrid_clock.cc:648] HybridClock initialized: now 1786253352479065 us; error 41 us; skew 500 ppm
I20260809 05:29:12.479508 10916 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:29:12 dist-test-slave-h3ft krb5kdc[10894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253352, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:29:12.488332 10916 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:29:12.490342 10916 webserver.cc:460] Webserver started at http://127.26.185.62:41091/ using document root <none> and password file <none>
I20260809 05:29:12.491362 10916 fs_manager.cc:359] Metadata directory not provided
I20260809 05:29:12.491494 10916 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:29:12.491830 10916 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:29:12.495698 10916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "b20128baed684b7baee8015634c4bdee"
format_stamp: "Formatted at 2026-08-09 05:29:12 on dist-test-slave-h3ft"
server_key: "ff0610b3edffc0ad7b89462e5a6bb29c"
server_key_iv: "5cdd63edcce7662f2d30d27b90e8b9be"
server_key_version: "encryptionkey@0"
I20260809 05:29:12.496603 10916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "b20128baed684b7baee8015634c4bdee"
format_stamp: "Formatted at 2026-08-09 05:29:12 on dist-test-slave-h3ft"
server_key: "ff0610b3edffc0ad7b89462e5a6bb29c"
server_key_iv: "5cdd63edcce7662f2d30d27b90e8b9be"
server_key_version: "encryptionkey@0"
I20260809 05:29:12.503755 10916 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260809 05:29:12.508442 10940 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:29:12.510239 10916 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 05:29:12.510425 10916 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "b20128baed684b7baee8015634c4bdee"
format_stamp: "Formatted at 2026-08-09 05:29:12 on dist-test-slave-h3ft"
server_key: "ff0610b3edffc0ad7b89462e5a6bb29c"
server_key_iv: "5cdd63edcce7662f2d30d27b90e8b9be"
server_key_version: "encryptionkey@0"
I20260809 05:29:12.510648 10916 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:29:12.529091 10916 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:29:12.535122 10916 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:29:12.535454 10916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:29:12.559069 10916 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:45335
I20260809 05:29:12.559185 11013 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:45335 every 8 connection(s)
I20260809 05:29:12.561101 10916 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:29:12.566109 11014 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:29:12.570462 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 10916
I20260809 05:29:12.570730 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:29:12.571579 27364 external_mini_cluster.cc:1428] Setting key d52c3a99c7d5ea8751a36c04704198b6
I20260809 05:29:12.582470 11014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b20128baed684b7baee8015634c4bdee: Bootstrap starting.
I20260809 05:29:12.587500 11014 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b20128baed684b7baee8015634c4bdee: Neither blocks nor log segments found. Creating new log.
I20260809 05:29:12.589217 11014 log.cc:824] T 00000000000000000000000000000000 P b20128baed684b7baee8015634c4bdee: Log is configured to *not* fsync() on all Append() calls
Aug 09 05:29:12 dist-test-slave-h3ft krb5kdc[10894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253351, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:29:12.593809 11014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b20128baed684b7baee8015634c4bdee: No bootstrap required, opened a new log
I20260809 05:29:12.599995 11018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:12.574339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36032 (local address 127.26.185.62:45335)
0809 05:29:12.575353 (+ 1014us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:12.575369 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:12.575424 (+ 55us) server_negotiation.cc:407] Connection header received
0809 05:29:12.577309 (+ 1885us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:12.577340 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:12.577942 (+ 602us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:12.578399 (+ 457us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:12.580732 (+ 2333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:12.582249 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:12.584275 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:12.585049 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:12.585248 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:12.591277 (+ 6029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:29:12.591287 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:29:12.591308 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:29:12.591357 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:29:12.594904 (+ 3547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:29:12.595754 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:29:12.595762 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:29:12.595770 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:29:12.595978 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:29:12.596473 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:29:12.596488 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:29:12.596491 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:29:12.597166 (+ 675us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:29:12.597598 (+ 432us) server_negotiation.cc:1035] Waiting for connection context
0809 05:29:12.598056 (+ 458us) server_negotiation.cc:299] Negotiation successful
0809 05:29:12.598584 (+ 528us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":743,"thread_start_us":428,"threads_started":1}
I20260809 05:29:12.604465 11014 raft_consensus.cc:348] T 00000000000000000000000000000000 P b20128baed684b7baee8015634c4bdee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b20128baed684b7baee8015634c4bdee" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 45335 } }
I20260809 05:29:12.605024 11014 raft_consensus.cc:374] T 00000000000000000000000000000000 P b20128baed684b7baee8015634c4bdee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:29:12.605147 11014 raft_consensus.cc:729] T 00000000000000000000000000000000 P b20128baed684b7baee8015634c4bdee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b20128baed684b7baee8015634c4bdee, State: Initialized, Role: FOLLOWER
I20260809 05:29:12.605863 11014 consensus_queue.cc:260] T 00000000000000000000000000000000 P b20128baed684b7baee8015634c4bdee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b20128baed684b7baee8015634c4bdee" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 45335 } }
I20260809 05:29:12.606104 11014 raft_consensus.cc:388] T 00000000000000000000000000000000 P b20128baed684b7baee8015634c4bdee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:29:12.606218 11014 raft_consensus.cc:482] T 00000000000000000000000000000000 P b20128baed684b7baee8015634c4bdee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:29:12.606353 11014 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b20128baed684b7baee8015634c4bdee [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:29:12.609252 11014 raft_consensus.cc:504] T 00000000000000000000000000000000 P b20128baed684b7baee8015634c4bdee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b20128baed684b7baee8015634c4bdee" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 45335 } }
I20260809 05:29:12.609897 11014 leader_election.cc:302] T 00000000000000000000000000000000 P b20128baed684b7baee8015634c4bdee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b20128baed684b7baee8015634c4bdee; no voters:
I20260809 05:29:12.610608 11014 leader_election.cc:288] T 00000000000000000000000000000000 P b20128baed684b7baee8015634c4bdee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:29:12.610785 11022 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b20128baed684b7baee8015634c4bdee [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:29:12.611589 11022 raft_consensus.cc:686] T 00000000000000000000000000000000 P b20128baed684b7baee8015634c4bdee [term 1 LEADER]: Becoming Leader. State: Replica: b20128baed684b7baee8015634c4bdee, State: Running, Role: LEADER
I20260809 05:29:12.612188 11022 consensus_queue.cc:237] T 00000000000000000000000000000000 P b20128baed684b7baee8015634c4bdee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b20128baed684b7baee8015634c4bdee" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 45335 } }
I20260809 05:29:12.613133 11014 sys_catalog.cc:564] T 00000000000000000000000000000000 P b20128baed684b7baee8015634c4bdee [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:29:12.615590 11027 sys_catalog.cc:455] T 00000000000000000000000000000000 P b20128baed684b7baee8015634c4bdee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b20128baed684b7baee8015634c4bdee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b20128baed684b7baee8015634c4bdee" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 45335 } } }
I20260809 05:29:12.615994 11027 sys_catalog.cc:458] T 00000000000000000000000000000000 P b20128baed684b7baee8015634c4bdee [sys.catalog]: This master's current role is: LEADER
I20260809 05:29:12.616596 11028 sys_catalog.cc:455] T 00000000000000000000000000000000 P b20128baed684b7baee8015634c4bdee [sys.catalog]: SysCatalogTable state changed. Reason: New leader b20128baed684b7baee8015634c4bdee. Latest consensus state: current_term: 1 leader_uuid: "b20128baed684b7baee8015634c4bdee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b20128baed684b7baee8015634c4bdee" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 45335 } } }
I20260809 05:29:12.616945 11028 sys_catalog.cc:458] T 00000000000000000000000000000000 P b20128baed684b7baee8015634c4bdee [sys.catalog]: This master's current role is: LEADER
I20260809 05:29:12.617116 11031 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:29:12.624603 11031 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:29:12.636264 11031 catalog_manager.cc:1347] Generated new cluster ID: da273857efbc4b3ebadee1f92038156e
I20260809 05:29:12.636444 11031 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:29:12.663478 11031 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:29:12.665889 11031 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:29:12.675879 11031 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b20128baed684b7baee8015634c4bdee: Generated new TSK 0
I20260809 05:29:12.677246 11031 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.185.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
I20260809 05:29:12.776278 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:0
--local_ip_for_outbound_sockets=127.26.185.1
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:45335
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:46257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:29:13.221181 11054 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:29:13.221642 11054 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:29:13.221843 11054 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:29:13.230182 11054 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:29:13.230386 11054 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:29:13.230613 11054 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:29:13.241958 11054 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:46257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:45335
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:29:13.243877 11054 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:29:13.245676 11054 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:29:13.262197 11062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:29:13.262387 11064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:29:13.262595 11061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:29:13.263438 11054 server_base.cc:1034] running on GCE node
I20260809 05:29:13.264189 11054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:29:13.265403 11054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:29:13.266665 11054 hybrid_clock.cc:648] HybridClock initialized: now 1786253353266608 us; error 49 us; skew 500 ppm
I20260809 05:29:13.267143 11054 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:29:13 dist-test-slave-h3ft krb5kdc[10894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253353, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:29:13.271220 11054 init.cc:377] Logged in from keytab as kudu/127.26.185.1@KRBTEST.COM (short username kudu)
I20260809 05:29:13.273113 11054 webserver.cc:460] Webserver started at http://127.26.185.1:43297/ using document root <none> and password file <none>
I20260809 05:29:13.274031 11054 fs_manager.cc:359] Metadata directory not provided
I20260809 05:29:13.274194 11054 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:29:13.274585 11054 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:29:13.278236 11054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/data/instance:
uuid: "08585a05dbb84bf7b72cfadffd78bc15"
format_stamp: "Formatted at 2026-08-09 05:29:13 on dist-test-slave-h3ft"
server_key: "71106901a46c642f1a9cceb367276332"
server_key_iv: "a815a10a9ef72f90d05197c45d04ce0d"
server_key_version: "encryptionkey@0"
I20260809 05:29:13.279217 11054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance:
uuid: "08585a05dbb84bf7b72cfadffd78bc15"
format_stamp: "Formatted at 2026-08-09 05:29:13 on dist-test-slave-h3ft"
server_key: "71106901a46c642f1a9cceb367276332"
server_key_iv: "a815a10a9ef72f90d05197c45d04ce0d"
server_key_version: "encryptionkey@0"
I20260809 05:29:13.285413 11054 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260809 05:29:13.289839 11073 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:29:13.291720 11054 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:29:13.291934 11054 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "08585a05dbb84bf7b72cfadffd78bc15"
format_stamp: "Formatted at 2026-08-09 05:29:13 on dist-test-slave-h3ft"
server_key: "71106901a46c642f1a9cceb367276332"
server_key_iv: "a815a10a9ef72f90d05197c45d04ce0d"
server_key_version: "encryptionkey@0"
I20260809 05:29:13.292189 11054 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:29:13.315734 11054 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:29:13.321996 11054 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:29:13.322430 11054 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:29:13.323889 11054 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:29:13.325812 11054 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:29:13.325938 11054 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:29:13.326122 11054 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:29:13.326207 11054 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:29:13.367503 11054 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:39771
I20260809 05:29:13.367553 11248 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:39771 every 8 connection(s)
I20260809 05:29:13.369220 11054 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:29:13.369990 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 11054
I20260809 05:29:13.370275 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance
I20260809 05:29:13.371285 27364 external_mini_cluster.cc:1428] Setting key 5b3a432b8e464e0530b6e4994d0d4918
Aug 09 05:29:13 dist-test-slave-h3ft krb5kdc[10894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253353, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:29:13.398444 11251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:13.372803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:60139 (local address 127.26.185.62:45335)
0809 05:29:13.373435 (+ 632us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:13.373443 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:13.374924 (+ 1481us) server_negotiation.cc:407] Connection header received
0809 05:29:13.378358 (+ 3434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:13.378363 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:13.378456 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:13.378576 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:13.381155 (+ 2579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:13.382081 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:13.384799 (+ 2718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:13.385328 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:13.385464 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:13.390628 (+ 5164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:29:13.390635 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:29:13.390639 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:29:13.390682 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:29:13.394024 (+ 3342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:29:13.395056 (+ 1032us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:29:13.395063 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:29:13.395074 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:29:13.395237 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:29:13.395796 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:29:13.395807 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:29:13.395809 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:29:13.396191 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:29:13.396393 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0809 05:29:13.397737 (+ 1344us) server_negotiation.cc:299] Negotiation successful
0809 05:29:13.398069 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":476,"thread_start_us":303,"threads_started":1}
I20260809 05:29:13.400199 11252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:13.373686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:45335 (local address 127.26.185.1:60139)
0809 05:29:13.374704 (+ 1018us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:13.374778 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0809 05:29:13.377931 (+ 3153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:29:13.378928 (+ 997us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:29:13.378943 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:29:13.379922 (+ 979us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:29:13.380919 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:13.380950 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:13.382272 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:13.382280 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:13.384594 (+ 2314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:13.384613 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:13.385626 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:13.385636 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:13.385998 (+ 362us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:13.386949 (+ 951us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:29:13.386988 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:29:13.390293 (+ 3305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:29:13.394222 (+ 3929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:29:13.394234 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:29:13.394258 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:29:13.394849 (+ 591us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:29:13.395383 (+ 534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:29:13.395389 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:29:13.395394 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:29:13.395647 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:29:13.396366 (+ 719us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:29:13.396378 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:29:13.396996 (+ 618us) client_negotiation.cc:769] Sending connection context
0809 05:29:13.397414 (+ 418us) client_negotiation.cc:240] Negotiation successful
0809 05:29:13.398217 (+ 803us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":654,"thread_start_us":371,"threads_started":1}
I20260809 05:29:13.402336 11249 heartbeater.cc:347] Connected to a master server at 127.26.185.62:45335
I20260809 05:29:13.402751 11249 heartbeater.cc:464] Registering TS with master...
I20260809 05:29:13.403798 11249 heartbeater.cc:511] Master 127.26.185.62:45335 requested a full tablet report, sending...
I20260809 05:29:13.406801 10965 ts_manager.cc:194] Registered new tserver with Master: 08585a05dbb84bf7b72cfadffd78bc15 (127.26.185.1:39771)
I20260809 05:29:13.408672 10965 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.1@KRBTEST.COM'} at 127.26.185.1:60139
WARNING: no policy specified for kudu/127.26.185.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
I20260809 05:29:13.455557 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:0
--local_ip_for_outbound_sockets=127.26.185.2
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:45335
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:46257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:29:13.893659 11259 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:29:13.894075 11259 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:29:13.894281 11259 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:29:13.902974 11259 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:29:13.903235 11259 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:29:13.903460 11259 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:29:13.915141 11259 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:46257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:45335
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:29:13.917110 11259 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:29:13.918923 11259 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:29:13.935810 11269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:29:13.935731 11268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:29:13.936009 11272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:29:13.936910 11259 server_base.cc:1034] running on GCE node
I20260809 05:29:13.937795 11259 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:29:13.939179 11259 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:29:13.940481 11259 hybrid_clock.cc:648] HybridClock initialized: now 1786253353940412 us; error 58 us; skew 500 ppm
I20260809 05:29:13.941020 11259 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:29:13 dist-test-slave-h3ft krb5kdc[10894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253353, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:29:13.945504 11259 init.cc:377] Logged in from keytab as kudu/127.26.185.2@KRBTEST.COM (short username kudu)
I20260809 05:29:13.947584 11259 webserver.cc:460] Webserver started at http://127.26.185.2:34263/ using document root <none> and password file <none>
I20260809 05:29:13.948580 11259 fs_manager.cc:359] Metadata directory not provided
I20260809 05:29:13.948767 11259 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:29:13.949193 11259 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:29:13.953523 11259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/data/instance:
uuid: "6b8507f816464834a3385805722e1efb"
format_stamp: "Formatted at 2026-08-09 05:29:13 on dist-test-slave-h3ft"
server_key: "7e3773ef81713f2d15150a369f44ad5d"
server_key_iv: "747aa4cd32496d7441608c63d561f5b1"
server_key_version: "encryptionkey@0"
I20260809 05:29:13.954643 11259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance:
uuid: "6b8507f816464834a3385805722e1efb"
format_stamp: "Formatted at 2026-08-09 05:29:13 on dist-test-slave-h3ft"
server_key: "7e3773ef81713f2d15150a369f44ad5d"
server_key_iv: "747aa4cd32496d7441608c63d561f5b1"
server_key_version: "encryptionkey@0"
I20260809 05:29:13.962355 11259 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
I20260809 05:29:13.967180 11283 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:29:13.969014 11259 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.001s
I20260809 05:29:13.969280 11259 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "6b8507f816464834a3385805722e1efb"
format_stamp: "Formatted at 2026-08-09 05:29:13 on dist-test-slave-h3ft"
server_key: "7e3773ef81713f2d15150a369f44ad5d"
server_key_iv: "747aa4cd32496d7441608c63d561f5b1"
server_key_version: "encryptionkey@0"
I20260809 05:29:13.969553 11259 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:29:13.993448 11259 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:29:13.999387 11259 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:29:13.999771 11259 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:29:14.001077 11259 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:29:14.002931 11259 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:29:14.003073 11259 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260809 05:29:14.003254 11259 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:29:14.003333 11259 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:29:14.044476 11259 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:39037
I20260809 05:29:14.044534 11455 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:39037 every 8 connection(s)
I20260809 05:29:14.046234 11259 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:29:14.056720 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 11259
I20260809 05:29:14.057039 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance
I20260809 05:29:14.057747 27364 external_mini_cluster.cc:1428] Setting key 541d59c5ab5b15073f3f201cb56e8777
Aug 09 05:29:14 dist-test-slave-h3ft krb5kdc[10894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253353, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:29:14.075136 11459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:14.049729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:43709 (local address 127.26.185.62:45335)
0809 05:29:14.050333 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:14.050341 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:14.051637 (+ 1296us) server_negotiation.cc:407] Connection header received
0809 05:29:14.053726 (+ 2089us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:14.053731 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:14.053827 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:14.053955 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:14.055888 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:14.056876 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:14.059352 (+ 2476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:14.059928 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:14.060112 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:14.065248 (+ 5136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:29:14.065260 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:29:14.065268 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:29:14.065333 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:29:14.069806 (+ 4473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:29:14.071135 (+ 1329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:29:14.071144 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:29:14.071151 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:29:14.071394 (+ 243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:29:14.072137 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:29:14.072145 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:29:14.072151 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:29:14.072638 (+ 487us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:29:14.072823 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0809 05:29:14.074063 (+ 1240us) server_negotiation.cc:299] Negotiation successful
0809 05:29:14.074431 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":281,"threads_started":1}
I20260809 05:29:14.076321 11460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:14.050522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:45335 (local address 127.26.185.2:43709)
0809 05:29:14.051420 (+ 898us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:14.051467 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 05:29:14.053376 (+ 1909us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:29:14.054219 (+ 843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:29:14.054229 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:29:14.054892 (+ 663us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:29:14.055680 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:14.055702 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:14.057108 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:14.057115 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:14.059182 (+ 2067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:14.059203 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:14.060360 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:14.060371 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:14.060728 (+ 357us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:14.061711 (+ 983us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:29:14.061749 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:29:14.064905 (+ 3156us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:29:14.070034 (+ 5129us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:29:14.070047 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:29:14.070077 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:29:14.070899 (+ 822us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:29:14.071587 (+ 688us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:29:14.071596 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:29:14.071603 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:29:14.071971 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:29:14.072927 (+ 956us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:29:14.072939 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:29:14.073512 (+ 573us) client_negotiation.cc:769] Sending connection context
0809 05:29:14.073873 (+ 361us) client_negotiation.cc:240] Negotiation successful
0809 05:29:14.074691 (+ 818us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":613,"thread_start_us":394,"threads_started":1}
I20260809 05:29:14.078403 11456 heartbeater.cc:347] Connected to a master server at 127.26.185.62:45335
I20260809 05:29:14.078889 11456 heartbeater.cc:464] Registering TS with master...
I20260809 05:29:14.080236 11456 heartbeater.cc:511] Master 127.26.185.62:45335 requested a full tablet report, sending...
I20260809 05:29:14.082369 10965 ts_manager.cc:194] Registered new tserver with Master: 6b8507f816464834a3385805722e1efb (127.26.185.2:39037)
I20260809 05:29:14.083454 10965 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.2@KRBTEST.COM'} at 127.26.185.2:43709
WARNING: no policy specified for kudu/127.26.185.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
I20260809 05:29:14.147131 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:0
--local_ip_for_outbound_sockets=127.26.185.3
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:45335
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:46257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:29:14.413244 11249 heartbeater.cc:503] Master 127.26.185.62:45335 was elected leader, sending a full tablet report...
W20260809 05:29:14.577972 11464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:29:14.578358 11464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:29:14.578477 11464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:29:14.586623 11464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:29:14.586792 11464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:29:14.586923 11464 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:29:14.598356 11464 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:46257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:45335
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:29:14.600239 11464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:29:14.601982 11464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:29:14.621233 11471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:29:14.621294 11472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:29:14.621311 11476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:29:14.621975 11464 server_base.cc:1034] running on GCE node
I20260809 05:29:14.622895 11464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:29:14.624154 11464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:29:14.625416 11464 hybrid_clock.cc:648] HybridClock initialized: now 1786253354625359 us; error 49 us; skew 500 ppm
I20260809 05:29:14.625828 11464 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:29:14 dist-test-slave-h3ft krb5kdc[10894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253354, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:29:14.629825 11464 init.cc:377] Logged in from keytab as kudu/127.26.185.3@KRBTEST.COM (short username kudu)
I20260809 05:29:14.631717 11464 webserver.cc:460] Webserver started at http://127.26.185.3:45643/ using document root <none> and password file <none>
I20260809 05:29:14.632651 11464 fs_manager.cc:359] Metadata directory not provided
I20260809 05:29:14.632819 11464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:29:14.633201 11464 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:29:14.636906 11464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/data/instance:
uuid: "2721c3f43aa74058b2f7aa621b369062"
format_stamp: "Formatted at 2026-08-09 05:29:14 on dist-test-slave-h3ft"
server_key: "7e30a776f2174dafb9f345de36910b0b"
server_key_iv: "036787c92e9809b9f7fce1403b042f31"
server_key_version: "encryptionkey@0"
I20260809 05:29:14.637812 11464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance:
uuid: "2721c3f43aa74058b2f7aa621b369062"
format_stamp: "Formatted at 2026-08-09 05:29:14 on dist-test-slave-h3ft"
server_key: "7e30a776f2174dafb9f345de36910b0b"
server_key_iv: "036787c92e9809b9f7fce1403b042f31"
server_key_version: "encryptionkey@0"
I20260809 05:29:14.644248 11464 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260809 05:29:14.648594 11487 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:29:14.650362 11464 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260809 05:29:14.650595 11464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "2721c3f43aa74058b2f7aa621b369062"
format_stamp: "Formatted at 2026-08-09 05:29:14 on dist-test-slave-h3ft"
server_key: "7e30a776f2174dafb9f345de36910b0b"
server_key_iv: "036787c92e9809b9f7fce1403b042f31"
server_key_version: "encryptionkey@0"
I20260809 05:29:14.650862 11464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:29:14.669575 11464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:29:14.675625 11464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:29:14.676036 11464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:29:14.677279 11464 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:29:14.679049 11464 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:29:14.679175 11464 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260809 05:29:14.679351 11464 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:29:14.679432 11464 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:29:14.718920 11464 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:38725
I20260809 05:29:14.718935 11653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:38725 every 8 connection(s)
I20260809 05:29:14.720849 11464 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:29:14.722604 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 11464
I20260809 05:29:14.722831 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance
I20260809 05:29:14.723565 27364 external_mini_cluster.cc:1428] Setting key 541a8d5cd83d678593d96ff41cbb2121
Aug 09 05:29:14 dist-test-slave-h3ft krb5kdc[10894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253354, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:29:14.745711 11658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:14.724255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:60555 (local address 127.26.185.62:45335)
0809 05:29:14.727538 (+ 3283us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:14.727552 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:14.727574 (+ 22us) server_negotiation.cc:407] Connection header received
0809 05:29:14.728933 (+ 1359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:14.728940 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:14.729050 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:14.729188 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:14.731627 (+ 2439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:14.732470 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:14.734209 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:14.734636 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:14.734734 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:14.738694 (+ 3960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:29:14.738700 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:29:14.738703 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:29:14.738742 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:29:14.741919 (+ 3177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:29:14.742935 (+ 1016us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:29:14.742942 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:29:14.742947 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:29:14.743167 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:29:14.743711 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:29:14.743716 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:29:14.743718 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:29:14.744086 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:29:14.744235 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 05:29:14.745131 (+ 896us) server_negotiation.cc:299] Negotiation successful
0809 05:29:14.745355 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3122,"thread_start_us":2955,"threads_started":1}
I20260809 05:29:14.747081 11659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:14.725182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:45335 (local address 127.26.185.3:60555)
0809 05:29:14.726335 (+ 1153us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:14.726388 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 05:29:14.728533 (+ 2145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:29:14.729547 (+ 1014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:29:14.729562 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:29:14.730541 (+ 979us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:29:14.731436 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:14.731459 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:14.732632 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:14.732636 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:14.734073 (+ 1437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:14.734086 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:14.734847 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:14.734852 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:14.735156 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:14.735927 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:29:14.735952 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:29:14.738439 (+ 2487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:29:14.742095 (+ 3656us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:29:14.742106 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:29:14.742145 (+ 39us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:29:14.742786 (+ 641us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:29:14.743321 (+ 535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:29:14.743325 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:29:14.743327 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:29:14.743562 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:29:14.744225 (+ 663us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:29:14.744232 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:29:14.744680 (+ 448us) client_negotiation.cc:769] Sending connection context
0809 05:29:14.744954 (+ 274us) client_negotiation.cc:240] Negotiation successful
0809 05:29:14.745491 (+ 537us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":806,"thread_start_us":446,"threads_started":1}
I20260809 05:29:14.748924 11654 heartbeater.cc:347] Connected to a master server at 127.26.185.62:45335
I20260809 05:29:14.749323 11654 heartbeater.cc:464] Registering TS with master...
I20260809 05:29:14.750269 11654 heartbeater.cc:511] Master 127.26.185.62:45335 requested a full tablet report, sending...
I20260809 05:29:14.752085 10965 ts_manager.cc:194] Registered new tserver with Master: 2721c3f43aa74058b2f7aa621b369062 (127.26.185.3:38725)
I20260809 05:29:14.753060 10965 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.3@KRBTEST.COM'} at 127.26.185.3:60555
I20260809 05:29:14.756229 27364 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 05:29:14.775637 11658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:14.761728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36044 (local address 127.26.185.62:45335)
0809 05:29:14.761956 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:14.761962 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:14.762480 (+ 518us) server_negotiation.cc:407] Connection header received
0809 05:29:14.762656 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:14.762660 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:14.762734 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:14.762832 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:14.764470 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:14.765323 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:14.766615 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:14.767085 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:14.767182 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:14.769734 (+ 2552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:29:14.769740 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:29:14.769744 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:29:14.769783 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:29:14.772803 (+ 3020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:29:14.773469 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:29:14.773473 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:29:14.773476 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:29:14.773717 (+ 241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:29:14.774097 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:29:14.774100 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:29:14.774102 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:29:14.774494 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:29:14.774703 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0809 05:29:14.775144 (+ 441us) server_negotiation.cc:299] Negotiation successful
0809 05:29:14.775359 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 05:29:14.781028 10965 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36044:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 05:29:14.789222 10965 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 05:29:14.836539 11680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:14.806527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53882 (local address 127.26.185.3:38725)
0809 05:29:14.824447 (+ 17920us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:14.824459 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:14.826044 (+ 1585us) server_negotiation.cc:407] Connection header received
0809 05:29:14.826421 (+ 377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:14.826431 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:14.826667 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:14.826866 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:29:14.828069 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:14.829196 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:14.833487 (+ 4291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:14.834582 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:14.834748 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:14.835086 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0809 05:29:14.835971 (+ 885us) server_negotiation.cc:299] Negotiation successful
0809 05:29:14.836193 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17669,"thread_start_us":17451,"threads_started":1}
I20260809 05:29:14.836653 11679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:14.805576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:39771 (local address 127.0.0.1:58654)
0809 05:29:14.823216 (+ 17640us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:14.823257 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 05:29:14.823546 (+ 289us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:29:14.826153 (+ 2607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:29:14.826168 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:29:14.826224 (+ 56us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:29:14.827658 (+ 1434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:14.827679 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:14.829968 (+ 2289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:14.829974 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:14.832910 (+ 2936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:14.832925 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:14.835335 (+ 2410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:14.835340 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:14.835680 (+ 340us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:14.835710 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 05:29:14.835839 (+ 129us) client_negotiation.cc:240] Negotiation successful
0809 05:29:14.836091 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17245,"mutex_wait_us":374,"spinlock_wait_cycles":768,"thread_start_us":19980,"threads_started":1}
I20260809 05:29:14.837095 11678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:14.805984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40510 (local address 127.26.185.2:39037)
0809 05:29:14.825219 (+ 19235us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:14.825228 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:14.825260 (+ 32us) server_negotiation.cc:407] Connection header received
0809 05:29:14.825394 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:14.825405 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:14.825796 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:14.826731 (+ 935us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:29:14.827348 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:14.829230 (+ 1882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:14.833449 (+ 4219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:14.834992 (+ 1543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:14.835708 (+ 716us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:14.835935 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0809 05:29:14.836515 (+ 580us) server_negotiation.cc:299] Negotiation successful
0809 05:29:14.836738 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19030,"thread_start_us":19070,"threads_started":1}
I20260809 05:29:14.837503 11677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:14.806058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:38725 (local address 127.0.0.1:53882)
0809 05:29:14.825886 (+ 19828us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:14.825906 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 05:29:14.826178 (+ 272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:29:14.827156 (+ 978us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:29:14.827163 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:29:14.827197 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:29:14.827875 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:14.827893 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:14.829433 (+ 1540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:14.829437 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:14.833258 (+ 3821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:14.833274 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:14.835244 (+ 1970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:14.835252 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:14.835622 (+ 370us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:14.835691 (+ 69us) client_negotiation.cc:769] Sending connection context
0809 05:29:14.836906 (+ 1215us) client_negotiation.cc:240] Negotiation successful
0809 05:29:14.837049 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19686,"mutex_wait_us":554,"thread_start_us":18338,"threads_started":1}
I20260809 05:29:14.837570 11681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:14.806723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58654 (local address 127.26.185.1:39771)
0809 05:29:14.825174 (+ 18451us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:14.825185 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:14.825230 (+ 45us) server_negotiation.cc:407] Connection header received
0809 05:29:14.825394 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:14.825405 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:14.825796 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:14.827315 (+ 1519us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:29:14.827909 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:14.829730 (+ 1821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:14.833093 (+ 3363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:14.834737 (+ 1644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:14.834888 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:14.835188 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0809 05:29:14.836950 (+ 1762us) server_negotiation.cc:299] Negotiation successful
0809 05:29:14.837174 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18234,"thread_start_us":17974,"threads_started":1}
I20260809 05:29:14.837641 11676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:14.805308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:39037 (local address 127.0.0.1:40510)
0809 05:29:14.812944 (+ 7636us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:14.812995 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 05:29:14.814419 (+ 1424us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:29:14.826153 (+ 11734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:29:14.826168 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:29:14.826231 (+ 63us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:29:14.826986 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:14.827041 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:14.829425 (+ 2384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:14.829431 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:14.833258 (+ 3827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:14.833274 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:14.835310 (+ 2036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:14.835322 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:14.835625 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:14.835990 (+ 365us) client_negotiation.cc:769] Sending connection context
0809 05:29:14.836071 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 05:29:14.836190 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7304,"mutex_wait_us":799,"spinlock_wait_cycles":7168,"thread_start_us":7083,"threads_started":1}
I20260809 05:29:14.841737 11351 tablet_service.cc:1467] Processing CreateTablet for tablet c4865675a10c416db5a8d24e157ab55e (DEFAULT_TABLE table=test-table [id=a3a08d1ad23f4396ab533f0345ec1ef4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:29:14.841737 11555 tablet_service.cc:1467] Processing CreateTablet for tablet c4865675a10c416db5a8d24e157ab55e (DEFAULT_TABLE table=test-table [id=a3a08d1ad23f4396ab533f0345ec1ef4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:29:14.843710 11351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4865675a10c416db5a8d24e157ab55e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:29:14.843714 11555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4865675a10c416db5a8d24e157ab55e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:29:14.847645 11145 tablet_service.cc:1467] Processing CreateTablet for tablet c4865675a10c416db5a8d24e157ab55e (DEFAULT_TABLE table=test-table [id=a3a08d1ad23f4396ab533f0345ec1ef4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:29:14.849844 11145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4865675a10c416db5a8d24e157ab55e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:29:14.861848 11682 tablet_bootstrap.cc:492] T c4865675a10c416db5a8d24e157ab55e P 2721c3f43aa74058b2f7aa621b369062: Bootstrap starting.
I20260809 05:29:14.864502 11683 tablet_bootstrap.cc:492] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb: Bootstrap starting.
I20260809 05:29:14.867542 11685 tablet_bootstrap.cc:492] T c4865675a10c416db5a8d24e157ab55e P 08585a05dbb84bf7b72cfadffd78bc15: Bootstrap starting.
I20260809 05:29:14.868563 11682 tablet_bootstrap.cc:654] T c4865675a10c416db5a8d24e157ab55e P 2721c3f43aa74058b2f7aa621b369062: Neither blocks nor log segments found. Creating new log.
I20260809 05:29:14.868930 11683 tablet_bootstrap.cc:654] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb: Neither blocks nor log segments found. Creating new log.
I20260809 05:29:14.870270 11683 log.cc:824] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb: Log is configured to *not* fsync() on all Append() calls
I20260809 05:29:14.870266 11682 log.cc:824] T c4865675a10c416db5a8d24e157ab55e P 2721c3f43aa74058b2f7aa621b369062: Log is configured to *not* fsync() on all Append() calls
I20260809 05:29:14.871276 11685 tablet_bootstrap.cc:654] T c4865675a10c416db5a8d24e157ab55e P 08585a05dbb84bf7b72cfadffd78bc15: Neither blocks nor log segments found. Creating new log.
I20260809 05:29:14.872900 11685 log.cc:824] T c4865675a10c416db5a8d24e157ab55e P 08585a05dbb84bf7b72cfadffd78bc15: Log is configured to *not* fsync() on all Append() calls
I20260809 05:29:14.874508 11682 tablet_bootstrap.cc:492] T c4865675a10c416db5a8d24e157ab55e P 2721c3f43aa74058b2f7aa621b369062: No bootstrap required, opened a new log
I20260809 05:29:14.874567 11683 tablet_bootstrap.cc:492] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb: No bootstrap required, opened a new log
I20260809 05:29:14.874866 11683 ts_tablet_manager.cc:1397] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.009s
I20260809 05:29:14.874876 11682 ts_tablet_manager.cc:1397] T c4865675a10c416db5a8d24e157ab55e P 2721c3f43aa74058b2f7aa621b369062: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.005s
I20260809 05:29:14.881675 11685 tablet_bootstrap.cc:492] T c4865675a10c416db5a8d24e157ab55e P 08585a05dbb84bf7b72cfadffd78bc15: No bootstrap required, opened a new log
I20260809 05:29:14.882010 11685 ts_tablet_manager.cc:1397] T c4865675a10c416db5a8d24e157ab55e P 08585a05dbb84bf7b72cfadffd78bc15: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.009s
I20260809 05:29:14.887388 11683 raft_consensus.cc:348] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b8507f816464834a3385805722e1efb" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39037 } } peers { permanent_uuid: "08585a05dbb84bf7b72cfadffd78bc15" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39771 } } peers { permanent_uuid: "2721c3f43aa74058b2f7aa621b369062" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 38725 } }
I20260809 05:29:14.887382 11682 raft_consensus.cc:348] T c4865675a10c416db5a8d24e157ab55e P 2721c3f43aa74058b2f7aa621b369062 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b8507f816464834a3385805722e1efb" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39037 } } peers { permanent_uuid: "08585a05dbb84bf7b72cfadffd78bc15" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39771 } } peers { permanent_uuid: "2721c3f43aa74058b2f7aa621b369062" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 38725 } }
I20260809 05:29:14.888002 11683 raft_consensus.cc:374] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:29:14.888000 11682 raft_consensus.cc:374] T c4865675a10c416db5a8d24e157ab55e P 2721c3f43aa74058b2f7aa621b369062 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:29:14.888128 11682 raft_consensus.cc:729] T c4865675a10c416db5a8d24e157ab55e P 2721c3f43aa74058b2f7aa621b369062 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2721c3f43aa74058b2f7aa621b369062, State: Initialized, Role: FOLLOWER
I20260809 05:29:14.888191 11683 raft_consensus.cc:729] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b8507f816464834a3385805722e1efb, State: Initialized, Role: FOLLOWER
I20260809 05:29:14.889009 11682 consensus_queue.cc:260] T c4865675a10c416db5a8d24e157ab55e P 2721c3f43aa74058b2f7aa621b369062 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b8507f816464834a3385805722e1efb" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39037 } } peers { permanent_uuid: "08585a05dbb84bf7b72cfadffd78bc15" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39771 } } peers { permanent_uuid: "2721c3f43aa74058b2f7aa621b369062" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 38725 } }
I20260809 05:29:14.889012 11683 consensus_queue.cc:260] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b8507f816464834a3385805722e1efb" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39037 } } peers { permanent_uuid: "08585a05dbb84bf7b72cfadffd78bc15" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39771 } } peers { permanent_uuid: "2721c3f43aa74058b2f7aa621b369062" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 38725 } }
I20260809 05:29:14.890499 11456 heartbeater.cc:503] Master 127.26.185.62:45335 was elected leader, sending a full tablet report...
I20260809 05:29:14.890978 11654 heartbeater.cc:503] Master 127.26.185.62:45335 was elected leader, sending a full tablet report...
I20260809 05:29:14.891929 11683 ts_tablet_manager.cc:1428] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb: Time spent starting tablet: real 0.017s user 0.013s sys 0.003s
I20260809 05:29:14.891954 11682 ts_tablet_manager.cc:1428] T c4865675a10c416db5a8d24e157ab55e P 2721c3f43aa74058b2f7aa621b369062: Time spent starting tablet: real 0.017s user 0.009s sys 0.008s
I20260809 05:29:14.893054 11685 raft_consensus.cc:348] T c4865675a10c416db5a8d24e157ab55e P 08585a05dbb84bf7b72cfadffd78bc15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b8507f816464834a3385805722e1efb" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39037 } } peers { permanent_uuid: "08585a05dbb84bf7b72cfadffd78bc15" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39771 } } peers { permanent_uuid: "2721c3f43aa74058b2f7aa621b369062" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 38725 } }
I20260809 05:29:14.893527 11685 raft_consensus.cc:374] T c4865675a10c416db5a8d24e157ab55e P 08585a05dbb84bf7b72cfadffd78bc15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:29:14.893662 11685 raft_consensus.cc:729] T c4865675a10c416db5a8d24e157ab55e P 08585a05dbb84bf7b72cfadffd78bc15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08585a05dbb84bf7b72cfadffd78bc15, State: Initialized, Role: FOLLOWER
I20260809 05:29:14.894337 11685 consensus_queue.cc:260] T c4865675a10c416db5a8d24e157ab55e P 08585a05dbb84bf7b72cfadffd78bc15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b8507f816464834a3385805722e1efb" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39037 } } peers { permanent_uuid: "08585a05dbb84bf7b72cfadffd78bc15" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39771 } } peers { permanent_uuid: "2721c3f43aa74058b2f7aa621b369062" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 38725 } }
I20260809 05:29:14.896579 11685 ts_tablet_manager.cc:1428] T c4865675a10c416db5a8d24e157ab55e P 08585a05dbb84bf7b72cfadffd78bc15: Time spent starting tablet: real 0.014s user 0.009s sys 0.006s
W20260809 05:29:14.973088 11655 tablet.cc:2369] T c4865675a10c416db5a8d24e157ab55e P 2721c3f43aa74058b2f7aa621b369062: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:29:15.027855 11691 raft_consensus.cc:482] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:29:15.028342 11691 raft_consensus.cc:504] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b8507f816464834a3385805722e1efb" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39037 } } peers { permanent_uuid: "08585a05dbb84bf7b72cfadffd78bc15" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39771 } } peers { permanent_uuid: "2721c3f43aa74058b2f7aa621b369062" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 38725 } }
I20260809 05:29:15.031167 11691 leader_election.cc:288] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08585a05dbb84bf7b72cfadffd78bc15 (127.26.185.1:39771), 2721c3f43aa74058b2f7aa621b369062 (127.26.185.3:38725)
I20260809 05:29:15.041520 11681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:15.031826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:54779 (local address 127.26.185.1:39771)
0809 05:29:15.032408 (+ 582us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:15.032415 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:15.033085 (+ 670us) server_negotiation.cc:407] Connection header received
0809 05:29:15.033312 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:15.033316 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:15.033387 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:15.033488 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:29:15.034184 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:15.034962 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:15.038572 (+ 3610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:15.039958 (+ 1386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:15.040152 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:15.040241 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 05:29:15.041040 (+ 799us) server_negotiation.cc:299] Negotiation successful
0809 05:29:15.041195 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375}
I20260809 05:29:15.041520 11680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:15.031812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:42321 (local address 127.26.185.3:38725)
0809 05:29:15.032168 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:15.032180 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:15.032745 (+ 565us) server_negotiation.cc:407] Connection header received
0809 05:29:15.033046 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:15.033051 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:15.033130 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:15.033241 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:29:15.033931 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:15.034818 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:15.038567 (+ 3749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:15.039957 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:15.040154 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:15.040241 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 05:29:15.041040 (+ 799us) server_negotiation.cc:299] Negotiation successful
0809 05:29:15.041207 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127}
I20260809 05:29:15.041925 11693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:15.031541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:39771 (local address 127.26.185.2:54779)
0809 05:29:15.032947 (+ 1406us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:15.032963 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 05:29:15.033135 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:29:15.033524 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:29:15.033529 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:29:15.033556 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:29:15.033996 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:15.034005 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:15.035152 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:15.035159 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:15.038364 (+ 3205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:15.038383 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:15.040306 (+ 1923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:15.040315 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:15.040695 (+ 380us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:15.040875 (+ 180us) client_negotiation.cc:769] Sending connection context
0809 05:29:15.040997 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 05:29:15.041294 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1281,"mutex_wait_us":369,"thread_start_us":584,"threads_started":1}
I20260809 05:29:15.041963 11694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:15.031475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:38725 (local address 127.26.185.2:42321)
0809 05:29:15.032577 (+ 1102us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:15.032609 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 05:29:15.032847 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:29:15.033276 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:29:15.033281 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:29:15.033311 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:29:15.033755 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:15.033771 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:15.034975 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:15.034983 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:15.038364 (+ 3381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:15.038383 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:15.040309 (+ 1926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:15.040315 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:15.040698 (+ 383us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:15.040875 (+ 177us) client_negotiation.cc:769] Sending connection context
0809 05:29:15.040997 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 05:29:15.041294 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":909,"mutex_wait_us":455,"thread_start_us":1083,"threads_started":1}
I20260809 05:29:15.043481 11595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4865675a10c416db5a8d24e157ab55e" candidate_uuid: "6b8507f816464834a3385805722e1efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2721c3f43aa74058b2f7aa621b369062" is_pre_election: true
I20260809 05:29:15.043546 11179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4865675a10c416db5a8d24e157ab55e" candidate_uuid: "6b8507f816464834a3385805722e1efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08585a05dbb84bf7b72cfadffd78bc15" is_pre_election: true
I20260809 05:29:15.044252 11595 raft_consensus.cc:2454] T c4865675a10c416db5a8d24e157ab55e P 2721c3f43aa74058b2f7aa621b369062 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b8507f816464834a3385805722e1efb in term 0.
I20260809 05:29:15.044348 11179 raft_consensus.cc:2454] T c4865675a10c416db5a8d24e157ab55e P 08585a05dbb84bf7b72cfadffd78bc15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b8507f816464834a3385805722e1efb in term 0.
I20260809 05:29:15.044854 11689 raft_consensus.cc:482] T c4865675a10c416db5a8d24e157ab55e P 2721c3f43aa74058b2f7aa621b369062 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:29:15.045081 11689 raft_consensus.cc:504] T c4865675a10c416db5a8d24e157ab55e P 2721c3f43aa74058b2f7aa621b369062 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b8507f816464834a3385805722e1efb" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39037 } } peers { permanent_uuid: "08585a05dbb84bf7b72cfadffd78bc15" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39771 } } peers { permanent_uuid: "2721c3f43aa74058b2f7aa621b369062" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 38725 } }
I20260809 05:29:15.045243 11288 leader_election.cc:302] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08585a05dbb84bf7b72cfadffd78bc15, 6b8507f816464834a3385805722e1efb; no voters:
I20260809 05:29:15.045789 11691 raft_consensus.cc:2781] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:29:15.046046 11691 raft_consensus.cc:482] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:29:15.046186 11691 raft_consensus.cc:3037] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:29:15.047240 11689 leader_election.cc:288] T c4865675a10c416db5a8d24e157ab55e P 2721c3f43aa74058b2f7aa621b369062 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b8507f816464834a3385805722e1efb (127.26.185.2:39037), 08585a05dbb84bf7b72cfadffd78bc15 (127.26.185.1:39771)
W20260809 05:29:15.049041 11457 tablet.cc:2369] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:29:15.050501 11691 raft_consensus.cc:504] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b8507f816464834a3385805722e1efb" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39037 } } peers { permanent_uuid: "08585a05dbb84bf7b72cfadffd78bc15" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39771 } } peers { permanent_uuid: "2721c3f43aa74058b2f7aa621b369062" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 38725 } }
I20260809 05:29:15.051863 11179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4865675a10c416db5a8d24e157ab55e" candidate_uuid: "6b8507f816464834a3385805722e1efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08585a05dbb84bf7b72cfadffd78bc15"
I20260809 05:29:15.052132 11179 raft_consensus.cc:3037] T c4865675a10c416db5a8d24e157ab55e P 08585a05dbb84bf7b72cfadffd78bc15 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:29:15.056465 11179 raft_consensus.cc:2454] T c4865675a10c416db5a8d24e157ab55e P 08585a05dbb84bf7b72cfadffd78bc15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b8507f816464834a3385805722e1efb in term 1.
I20260809 05:29:15.057060 11288 leader_election.cc:302] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08585a05dbb84bf7b72cfadffd78bc15, 6b8507f816464834a3385805722e1efb; no voters:
I20260809 05:29:15.061441 11659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:15.047594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:39037 (local address 127.26.185.3:56887)
0809 05:29:15.048166 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:15.048197 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 05:29:15.048332 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:29:15.050941 (+ 2609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:29:15.050947 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:29:15.050988 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:29:15.051331 (+ 343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:15.051348 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:15.053688 (+ 2340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:15.053697 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:15.056976 (+ 3279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:15.057005 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:15.060160 (+ 3155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:15.060170 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:15.060497 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:15.060574 (+ 77us) client_negotiation.cc:769] Sending connection context
0809 05:29:15.060703 (+ 129us) client_negotiation.cc:240] Negotiation successful
0809 05:29:15.060951 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411}
I20260809 05:29:15.062505 11678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:15.048637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:56887 (local address 127.26.185.2:39037)
0809 05:29:15.050265 (+ 1628us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:15.050275 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:15.050306 (+ 31us) server_negotiation.cc:407] Connection header received
0809 05:29:15.050404 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:15.050418 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:15.050540 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:15.050681 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:29:15.051767 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:15.053359 (+ 1592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:15.057254 (+ 3895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:15.059668 (+ 2414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:15.059898 (+ 230us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:15.060024 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 05:29:15.061883 (+ 1859us) server_negotiation.cc:299] Negotiation successful
0809 05:29:15.062115 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1405}
I20260809 05:29:15.062412 11595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4865675a10c416db5a8d24e157ab55e" candidate_uuid: "6b8507f816464834a3385805722e1efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2721c3f43aa74058b2f7aa621b369062"
I20260809 05:29:15.062959 11595 raft_consensus.cc:3037] T c4865675a10c416db5a8d24e157ab55e P 2721c3f43aa74058b2f7aa621b369062 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:29:15.068531 11595 raft_consensus.cc:2454] T c4865675a10c416db5a8d24e157ab55e P 2721c3f43aa74058b2f7aa621b369062 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b8507f816464834a3385805722e1efb in term 1.
I20260809 05:29:15.062932 11691 leader_election.cc:288] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb [CANDIDATE]: Term 1 election: Requested vote from peers 08585a05dbb84bf7b72cfadffd78bc15 (127.26.185.1:39771), 2721c3f43aa74058b2f7aa621b369062 (127.26.185.3:38725)
I20260809 05:29:15.067415 11696 raft_consensus.cc:2781] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:29:15.070392 11696 raft_consensus.cc:686] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb [term 1 LEADER]: Becoming Leader. State: Replica: 6b8507f816464834a3385805722e1efb, State: Running, Role: LEADER
I20260809 05:29:15.070896 11387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4865675a10c416db5a8d24e157ab55e" candidate_uuid: "2721c3f43aa74058b2f7aa621b369062" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b8507f816464834a3385805722e1efb" is_pre_election: true
I20260809 05:29:15.071382 11696 consensus_queue.cc:237] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b8507f816464834a3385805722e1efb" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39037 } } peers { permanent_uuid: "08585a05dbb84bf7b72cfadffd78bc15" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39771 } } peers { permanent_uuid: "2721c3f43aa74058b2f7aa621b369062" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 38725 } }
I20260809 05:29:15.079783 11659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:15.047955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:39771 (local address 127.26.185.3:40495)
0809 05:29:15.069239 (+ 21284us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:15.069269 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0809 05:29:15.069464 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:29:15.072636 (+ 3172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:29:15.072645 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:29:15.072695 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:29:15.073043 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:15.073060 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:15.075050 (+ 1990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:15.075056 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:15.077053 (+ 1997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:29:15.077075 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:29:15.078799 (+ 1724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:29:15.078806 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:29:15.079073 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:15.079115 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 05:29:15.079227 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 05:29:15.079363 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21109,"thread_start_us":25595,"threads_started":1}
I20260809 05:29:15.079831 11681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:15.048508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:40495 (local address 127.26.185.1:39771)
0809 05:29:15.049040 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:15.049058 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:15.069407 (+ 20349us) server_negotiation.cc:407] Connection header received
0809 05:29:15.069636 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:15.069641 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:15.069779 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:15.069893 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:29:15.073346 (+ 3453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:15.074841 (+ 1495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:15.077282 (+ 2441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:15.078554 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:15.078777 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:15.078878 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 05:29:15.079338 (+ 460us) server_negotiation.cc:299] Negotiation successful
0809 05:29:15.079536 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382}
I20260809 05:29:15.080659 11179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4865675a10c416db5a8d24e157ab55e" candidate_uuid: "2721c3f43aa74058b2f7aa621b369062" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08585a05dbb84bf7b72cfadffd78bc15" is_pre_election: true
I20260809 05:29:15.081100 11179 raft_consensus.cc:2379] T c4865675a10c416db5a8d24e157ab55e P 08585a05dbb84bf7b72cfadffd78bc15 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2721c3f43aa74058b2f7aa621b369062 in current term 1: Already voted for candidate 6b8507f816464834a3385805722e1efb in this term.
I20260809 05:29:15.080792 10961 catalog_manager.cc:5495] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b8507f816464834a3385805722e1efb (127.26.185.2). New cstate: current_term: 1 leader_uuid: "6b8507f816464834a3385805722e1efb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b8507f816464834a3385805722e1efb" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 39037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08585a05dbb84bf7b72cfadffd78bc15" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2721c3f43aa74058b2f7aa621b369062" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 38725 } health_report { overall_health: UNKNOWN } } }
I20260809 05:29:15.081974 11493 leader_election.cc:302] T c4865675a10c416db5a8d24e157ab55e P 2721c3f43aa74058b2f7aa621b369062 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2721c3f43aa74058b2f7aa621b369062; no voters: 08585a05dbb84bf7b72cfadffd78bc15, 6b8507f816464834a3385805722e1efb
I20260809 05:29:15.082475 11689 raft_consensus.cc:2726] T c4865675a10c416db5a8d24e157ab55e P 2721c3f43aa74058b2f7aa621b369062 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260809 05:29:15.122756 11250 tablet.cc:2369] T c4865675a10c416db5a8d24e157ab55e P 08585a05dbb84bf7b72cfadffd78bc15: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:29:15.151583 11678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:15.145219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40524 (local address 127.26.185.2:39037)
0809 05:29:15.145425 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:15.145430 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:15.145451 (+ 21us) server_negotiation.cc:407] Connection header received
0809 05:29:15.145585 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:15.145590 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:15.145687 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:15.145844 (+ 157us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:29:15.146222 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:15.147185 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:15.148764 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:15.149242 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:15.149365 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:15.149945 (+ 580us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:29:15.150700 (+ 755us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:29:15.150860 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 05:29:15.151177 (+ 317us) server_negotiation.cc:299] Negotiation successful
0809 05:29:15.151273 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 05:29:15.162607 11179 raft_consensus.cc:1261] T c4865675a10c416db5a8d24e157ab55e P 08585a05dbb84bf7b72cfadffd78bc15 [term 1 FOLLOWER]: Refusing update from remote peer 6b8507f816464834a3385805722e1efb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:29:15.162654 11595 raft_consensus.cc:1261] T c4865675a10c416db5a8d24e157ab55e P 2721c3f43aa74058b2f7aa621b369062 [term 1 FOLLOWER]: Refusing update from remote peer 6b8507f816464834a3385805722e1efb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:29:15.163796 11696 consensus_queue.cc:1035] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb [LEADER]: Connected to new peer: Peer: permanent_uuid: "08585a05dbb84bf7b72cfadffd78bc15" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 39771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:29:15.164170 11691 consensus_queue.cc:1035] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb [LEADER]: Connected to new peer: Peer: permanent_uuid: "2721c3f43aa74058b2f7aa621b369062" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 38725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:29:15.194916 10961 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36044:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:29:15.195364 10961 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36044:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:29:15.200471 10961 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b20128baed684b7baee8015634c4bdee: Sending DeleteTablet for 3 replicas of tablet c4865675a10c416db5a8d24e157ab55e
I20260809 05:29:15.202175 11351 tablet_service.cc:1514] Processing DeleteTablet for tablet c4865675a10c416db5a8d24e157ab55e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:29:15 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:40510
I20260809 05:29:15.202205 11555 tablet_service.cc:1514] Processing DeleteTablet for tablet c4865675a10c416db5a8d24e157ab55e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:29:15 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:53882
I20260809 05:29:15.202205 11145 tablet_service.cc:1514] Processing DeleteTablet for tablet c4865675a10c416db5a8d24e157ab55e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:29:15 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:58654
I20260809 05:29:15.211079 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 11054
I20260809 05:29:15.215860 11712 tablet_replica.cc:330] T c4865675a10c416db5a8d24e157ab55e P 2721c3f43aa74058b2f7aa621b369062: stopping tablet replica
I20260809 05:29:15.214957 11715 tablet_replica.cc:330] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb: stopping tablet replica
I20260809 05:29:15.216809 11712 raft_consensus.cc:2229] T c4865675a10c416db5a8d24e157ab55e P 2721c3f43aa74058b2f7aa621b369062 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:29:15.217085 11715 raft_consensus.cc:2229] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb [term 1 LEADER]: Raft consensus shutting down.
I20260809 05:29:15.217674 11712 raft_consensus.cc:2258] T c4865675a10c416db5a8d24e157ab55e P 2721c3f43aa74058b2f7aa621b369062 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:29:15.218170 11715 raft_consensus.cc:2258] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:29:15.220634 11714 tablet_replica.cc:330] T c4865675a10c416db5a8d24e157ab55e P 08585a05dbb84bf7b72cfadffd78bc15: stopping tablet replica
I20260809 05:29:15.221562 11712 ts_tablet_manager.cc:1905] T c4865675a10c416db5a8d24e157ab55e P 2721c3f43aa74058b2f7aa621b369062: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:29:15.222225 11714 raft_consensus.cc:2229] T c4865675a10c416db5a8d24e157ab55e P 08585a05dbb84bf7b72cfadffd78bc15 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:29:15.222488 11715 ts_tablet_manager.cc:1905] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:29:15.222947 11714 raft_consensus.cc:2258] T c4865675a10c416db5a8d24e157ab55e P 08585a05dbb84bf7b72cfadffd78bc15 [term 1 FOLLOWER]: Raft consensus is shut down!
Aug 09 05:29:15 dist-test-slave-h3ft krb5kdc[10894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253351, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.1@KRBTEST.COM
I20260809 05:29:15.231501 11712 ts_tablet_manager.cc:1918] T c4865675a10c416db5a8d24e157ab55e P 2721c3f43aa74058b2f7aa621b369062: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:29:15.231724 11715 ts_tablet_manager.cc:1918] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:29:15.231858 11712 log.cc:1196] T c4865675a10c416db5a8d24e157ab55e P 2721c3f43aa74058b2f7aa621b369062: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-2/wal/wals/c4865675a10c416db5a8d24e157ab55e
I20260809 05:29:15.232038 11715 log.cc:1196] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786253234117492-27364-0/minicluster-data/ts-1/wal/wals/c4865675a10c416db5a8d24e157ab55e
I20260809 05:29:15.232707 11712 ts_tablet_manager.cc:1939] T c4865675a10c416db5a8d24e157ab55e P 2721c3f43aa74058b2f7aa621b369062: Deleting consensus metadata
I20260809 05:29:15.232719 11715 ts_tablet_manager.cc:1939] T c4865675a10c416db5a8d24e157ab55e P 6b8507f816464834a3385805722e1efb: Deleting consensus metadata
I20260809 05:29:15.234745 11714 ts_tablet_manager.cc:1905] T c4865675a10c416db5a8d24e157ab55e P 08585a05dbb84bf7b72cfadffd78bc15: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:29:15.235390 10942 catalog_manager.cc:4841] TS 2721c3f43aa74058b2f7aa621b369062 (127.26.185.3:38725): tablet c4865675a10c416db5a8d24e157ab55e (table test-table [id=a3a08d1ad23f4396ab533f0345ec1ef4]) successfully deleted
I20260809 05:29:15.235347 10943 catalog_manager.cc:4841] TS 6b8507f816464834a3385805722e1efb (127.26.185.2:39037): tablet c4865675a10c416db5a8d24e157ab55e (table test-table [id=a3a08d1ad23f4396ab533f0345ec1ef4]) successfully deleted
I20260809 05:29:15.239929 11681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:15.214728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58664 (local address 127.26.185.1:39771)
0809 05:29:15.215044 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:15.215053 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:15.216192 (+ 1139us) server_negotiation.cc:407] Connection header received
0809 05:29:15.216479 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:15.216485 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:15.216614 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:15.216735 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:15.221089 (+ 4354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:15.222339 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:15.224354 (+ 2015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:15.225096 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:15.225223 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:15.231548 (+ 6325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:29:15.231568 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:29:15.231591 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:29:15.231678 (+ 87us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:29:15.236359 (+ 4681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:29:15.237306 (+ 947us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:29:15.237315 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:29:15.237318 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:29:15.237489 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:29:15.237960 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:29:15.237964 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:29:15.237967 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:29:15.238410 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:29:15.238782 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0809 05:29:15.239165 (+ 383us) server_negotiation.cc:299] Negotiation successful
0809 05:29:15.239472 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260809 05:29:15.240911 11242 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:29:15.344193 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 11054
W20260809 05:29:15.379818 10944 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.185.1:39771 (error 108)
I20260809 05:29:15.380183 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 11259
I20260809 05:29:15.382735 11719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:15.381741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:39771 (local address 127.0.0.1:58666)
0809 05:29:15.382306 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:15.382467 (+ 161us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.1:39771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":300,"threads_started":1}
W20260809 05:29:15.383088 10944 catalog_manager.cc:4584] TS 08585a05dbb84bf7b72cfadffd78bc15 (127.26.185.1:39771): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c4865675a10c416db5a8d24e157ab55e: Network error: Client connection negotiation failed: client connection to 127.26.185.1:39771: connect: Connection refused (error 111)
Aug 09 05:29:15 dist-test-slave-h3ft krb5kdc[10894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253351, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.2@KRBTEST.COM
I20260809 05:29:15.400477 11678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:15.381156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40532 (local address 127.26.185.2:39037)
0809 05:29:15.381422 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:15.381430 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:15.381608 (+ 178us) server_negotiation.cc:407] Connection header received
0809 05:29:15.381842 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:15.381854 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:15.381977 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:15.382106 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:15.384168 (+ 2062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:15.385436 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:15.386835 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:15.387602 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:15.387766 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:15.392745 (+ 4979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:29:15.392775 (+ 30us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:29:15.392809 (+ 34us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:29:15.392864 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:29:15.396881 (+ 4017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:29:15.397802 (+ 921us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:29:15.397812 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:29:15.397815 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:29:15.398001 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:29:15.398464 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:29:15.398469 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:29:15.398471 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:29:15.398994 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:29:15.399431 (+ 437us) server_negotiation.cc:1035] Waiting for connection context
0809 05:29:15.399778 (+ 347us) server_negotiation.cc:299] Negotiation successful
0809 05:29:15.400076 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260809 05:29:15.401458 11450 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:29:15.437497 11719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:15.436884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:39771 (local address 127.0.0.1:58674)
0809 05:29:15.437171 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:15.437304 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.1:39771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
I20260809 05:29:15.438794 11719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:15.438375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:39771 (local address 127.0.0.1:58678)
0809 05:29:15.438540 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:15.438636 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.1:39771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 05:29:15.499742 11719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:15.499139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:39771 (local address 127.0.0.1:58690)
0809 05:29:15.499410 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:15.499528 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.1:39771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260809 05:29:15.501039 11719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:15.500638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:39771 (local address 127.0.0.1:58694)
0809 05:29:15.500784 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:15.500865 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.1:39771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 05:29:15.533944 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 11259
I20260809 05:29:15.563345 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 11464
Aug 09 05:29:15 dist-test-slave-h3ft krb5kdc[10894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253351, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.3@KRBTEST.COM
I20260809 05:29:15.581893 11719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:15.581313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:39771 (local address 127.0.0.1:58708)
0809 05:29:15.581579 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:15.581694 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.1:39771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260809 05:29:15.583454 11719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:15.582752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:39771 (local address 127.0.0.1:58720)
0809 05:29:15.583116 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:15.583228 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.1:39771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197}
I20260809 05:29:15.584312 11722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:15.564389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53896 (local address 127.26.185.3:38725)
0809 05:29:15.564985 (+ 596us) server_negotiation.cc:206] Beginning negotiation
0809 05:29:15.564991 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:29:15.565009 (+ 18us) server_negotiation.cc:407] Connection header received
0809 05:29:15.565083 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:29:15.565088 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:29:15.565161 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:29:15.565277 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:29:15.567336 (+ 2059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:15.568201 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:15.570142 (+ 1941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:29:15.570569 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:29:15.570666 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:29:15.576782 (+ 6116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:29:15.576802 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:29:15.576825 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:29:15.576868 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:29:15.580365 (+ 3497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:29:15.581369 (+ 1004us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:29:15.581378 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:29:15.581380 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:29:15.581550 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:29:15.582011 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:29:15.582017 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:29:15.582022 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:29:15.582711 (+ 689us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:29:15.583124 (+ 413us) server_negotiation.cc:1035] Waiting for connection context
0809 05:29:15.583643 (+ 519us) server_negotiation.cc:299] Negotiation successful
0809 05:29:15.583889 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":482,"thread_start_us":342,"threads_started":1}
I20260809 05:29:15.585096 11649 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:29:15.689163 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 11464
I20260809 05:29:15.718116 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 10916
I20260809 05:29:15.719729 11005 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:29:15.849682 11719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:29:15.849005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:39771 (local address 127.0.0.1:58722)
0809 05:29:15.849340 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0809 05:29:15.849478 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.1:39771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133}
I20260809 05:29:15.849678 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 10916
2026-08-09T05:29:15Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (5656 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:29:16 dist-test-slave-h3ft krb5kdc[11729](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:29:16 dist-test-slave-h3ft krb5kdc[11729](info): set up 2 sockets
Aug 09 05:29:16 dist-test-slave-h3ft krb5kdc[11729](info): commencing operation
krb5kdc: starting...
W20260809 05:29:17.357939 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.447s user 0.010s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:29:17 dist-test-slave-h3ft krb5kdc[11729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253357, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:29:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:29:17Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.26.185.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.26.185.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.26.185.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/rangeradmin_127.26.185.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.26.185.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/rangeradmin_127.26.185.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.26.185.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.26.185.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.26.185.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/rangerlookup_127.26.185.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.26.185.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/rangerlookup_127.26.185.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.185.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.26.185.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.185.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/HTTP_127.26.185.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.185.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/HTTP_127.26.185.20@KRBTEST.COM.keytab.
I20260809 05:29:17.927034 27364 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskaxTOnW/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/postgres -l logfile start
2026-08-09 05:29:20.916 UTC [11773] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 05:29:20.917 UTC [11773] LOG: listening on IPv4 address "127.26.185.20", port 59009
2026-08-09 05:29:20.921 UTC [11773] LOG: listening on Unix socket "/tmp/.s.PGSQL.59009"
2026-08-09 05:29:20.953 UTC [11782] LOG: database system was shut down at 2026-08-09 05:29:19 UTC
2026-08-09 05:29:20.959 UTC [11773] LOG: database system is ready to accept connections
I20260809 05:29:22.186908 27364 mini_postgres.cc:96] Postgres bound to 59009
2026-08-09 05:29:22.220 UTC [11794] FATAL: database "slave" does not exist
127.26.185.20:59009 - accepting connections
I20260809 05:29:22.221755 27364 mini_ranger.cc:161] Starting Ranger...
I20260809 05:29:22.266386 27364 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 05:29:22.848097 27364 mini_ranger.cc:87] Created ranger Postgres database
I20260809 05:29:22.848367 27364 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ranger-admin
2026-08-09 05:29:23,274 [I] DB FLAVOR :POSTGRES
2026-08-09 05:29:23,274 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 05:29:23,275 [I] Checking connection..
2026-08-09 05:29:23,275 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:59009/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 05:29:23,588 [I] Checking connection passed.
2026-08-09 05:29:23,588 [I] --------- Verifying version history table ---------
2026-08-09 05:29:23,588 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:59009/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 05:29:23,895 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 05:29:23,895 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:59009/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 05:29:24,187 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 05:29:24,188 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 05:29:24,188 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:59009/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 05:29:24.447 UTC [11883] WARNING: there is no transaction in progress
2026-08-09 05:29:24,458 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 05:29:24,459 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:59009/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 05:29:24,762 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 05:29:24,763 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 05:29:24,763 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:59009/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 05:29:25,055 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:59009/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 05:29:25,372 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:59009/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-h3ft.c.gcp-upstream.internal','N') ;"
2026-08-09 05:29:25,664 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:59009/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 05:29:25,960 [I] Table x_portal_user does not exist in database ranger
2026-08-09 05:29:25,961 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:59009/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 05:29:26,261 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 05:29:26,261 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:59009/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 05:29:26,563 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:59009/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 05:29:26,846 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 05:29:26,846 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:59009/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 05:29:27.994 UTC [12035] WARNING: there is no transaction in progress
2026-08-09 05:29:28.014 UTC [12035] WARNING: there is no transaction in progress
2026-08-09 05:29:28.034 UTC [12035] WARNING: there is no transaction in progress
2026-08-09 05:29:28.053 UTC [12035] WARNING: there is no transaction in progress
2026-08-09 05:29:28.070 UTC [12035] WARNING: there is no transaction in progress
2026-08-09 05:29:28.095 UTC [12035] WARNING: there is no transaction in progress
2026-08-09 05:29:28.160 UTC [12035] WARNING: there is no transaction in progress
2026-08-09 05:29:28.168 UTC [12035] WARNING: there is no transaction in progress
2026-08-09 05:29:28.185 UTC [12035] WARNING: there is no transaction in progress
2026-08-09 05:29:28.196 UTC [12035] WARNING: there is no transaction in progress
2026-08-09 05:29:28.207 UTC [12035] WARNING: there is no transaction in progress
2026-08-09 05:29:28.222 UTC [12035] WARNING: there is no transaction in progress
2026-08-09 05:29:28.233 UTC [12035] WARNING: there is no transaction in progress
2026-08-09 05:29:28.241 UTC [12035] WARNING: there is no transaction in progress
2026-08-09 05:29:28.248 UTC [12035] WARNING: there is no transaction in progress
2026-08-09 05:29:28.256 UTC [12035] WARNING: there is no transaction in progress
2026-08-09 05:29:29,023 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 05:29:29,023 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:59009/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 05:29:29,326 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 05:29:29,327 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:59009/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 05:29:29,627 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 05:29:29,628 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:59009/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 05:29:29,892 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 05:29:29,893 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:59009/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 05:29:30,190 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:59009/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 05:29:30,487 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:59009/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-h3ft.c.gcp-upstream.internal';"
2026-08-09 05:29:30,772 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 05:29:30,773 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:59009/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 05:29:31,070 [I] DB_PATCHES have already been applied
I20260809 05:29:31.077657 27364 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ranger-admin:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskaxTOnW/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 05:29:31.077816 27364 mini_ranger.cc:193] Using host: 127.26.185.20
I20260809 05:29:31.112731 27364 mini_ranger.cc:227] Ranger admin URL: http://127.26.185.20:57365
Aug 09, 2026 5:29:31 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 5:29:31 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 5:29:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 5:29:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 5:29:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 5:29:32 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 5:29:32 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 05:29:32.617084 27364 mini_ranger.cc:160] Time spent starting Ranger: real 10.395s user 0.003s sys 0.093s
Aug 09, 2026 5:29:56 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 5:29:56 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 09, 2026 5:29:56 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 5:29:56 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 5:29:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 5:29:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 5:29:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 5:29:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 5:29:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 5:29:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 5:29:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 5:29:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 5:29:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 5:29:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 5:29:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 5:29:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 5:29:56 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 5:29:57 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 05:29:58.173727 27364 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.26.185.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.26.185.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.26.185.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/rangerkms_127.26.185.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.26.185.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/rangerkms_127.26.185.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.185.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.26.185.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.185.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/HTTP_127.26.185.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.185.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/HTTP_127.26.185.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 05:29:58 dist-test-slave-h3ft krb5kdc[11729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253398, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 05:29:58.454447 27364 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 05:29:58.493623 27364 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 05:29:59.566262 27364 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 05:29:59.566461 27364 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ranger-kms
I20260809 05:29:59.566681 27364 mini_ranger_kms.cc:227] Using postgres at 127.26.185.20:59009
2026-08-09 05:30:00,341 [I] DB FLAVOR :POSTGRES
2026-08-09 05:30:00,341 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 05:30:00,341 [I] Checking connection
2026-08-09 05:30:00,341 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:59009/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 05:30:00,649 [I] connection success
2026-08-09 05:30:00,650 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 05:30:00,650 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 05:30:00,650 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:59009/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 05:30:00,937 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 05:30:00,937 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 05:30:00,938 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 05:30:00,938 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:59009/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 05:30:01,246 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 05:30:01.918939 27364 mini_ranger_kms.cc:310] Created kms service
I20260809 05:30:02.139236 27364 mini_ranger_kms.cc:326] Created kudu user
I20260809 05:30:02.204048 27364 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 05:30:02 dist-test-slave-h3ft krb5kdc[11729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253398, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.26.185.20@KRBTEST.COM
I20260809 05:30:02.741062 27364 mini_ranger_kms.cc:384] Added ranger policy
I20260809 05:30:02.742774 27364 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ranger-kms:/tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 05:30:02.742874 27364 mini_ranger_kms.cc:240] Using host: 127.26.185.20
I20260809 05:30:02.780774 27364 mini_ranger_kms.cc:276] Ranger KMS PID: 12292
I20260809 05:30:02.781075 27364 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.26.185.20:47975
Aug 09, 2026 5:30:04 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 5:30:04 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 5:30:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 5:30:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 5:30:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 5:30:04 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 05:30:05 dist-test-slave-h3ft krb5kdc[11729](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786253405, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.185.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:30:05.909711 27364 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 7.455s user 0.151s sys 0.568s
I20260809 05:30:05.910197 27364 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 05:30:05.910514 27364 mini_ranger_kms.cc:401] 127.26.185.20:47975/kms/v1/keys
Aug 09 05:30:06 dist-test-slave-h3ft krb5kdc[11729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253405, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.185.20@KRBTEST.COM for HTTP/127.26.185.20@KRBTEST.COM
Aug 09 05:30:06 dist-test-slave-h3ft krb5kdc[11729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253405, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.185.20@KRBTEST.COM for HTTP/127.26.185.20@KRBTEST.COM
Aug 09 05:30:09 dist-test-slave-h3ft krb5kdc[11729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253409, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
W20260809 05:30:09.722564 27364 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.26.185.62: real 0.107s user 0.001s sys 0.040s
I20260809 05:30:09.724330 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:35159
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:37401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:35159
--ranger_config_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.185.20:47975/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:30:10.269883 12364 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:30:10.270362 12364 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:30:10.270533 12364 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:30:10.279714 12364 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:30:10.279985 12364 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:30:10.280175 12364 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:30:10.280315 12364 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:30:10.280426 12364 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:30:10.293939 12364 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:37401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/master-0/wal
--ranger_kms_url=127.26.185.20:47975/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:35159
--ranger_config_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:35159
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:30:10.296092 12364 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:30:10.297915 12364 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:30:10.315801 12375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:30:10.315949 12373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:30:10.316548 12372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:30:10.317601 12364 server_base.cc:1034] running on GCE node
I20260809 05:30:10.318828 12364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:30:10.320953 12364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:30:10.322237 12364 hybrid_clock.cc:648] HybridClock initialized: now 1786253410322161 us; error 77 us; skew 500 ppm
I20260809 05:30:10.322692 12364 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:30:10 dist-test-slave-h3ft krb5kdc[11729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253410, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:30:10.330943 12364 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:30:10.333258 12364 webserver.cc:460] Webserver started at http://127.26.185.62:44365/ using document root <none> and password file <none>
I20260809 05:30:10.334156 12364 fs_manager.cc:359] Metadata directory not provided
I20260809 05:30:10.334357 12364 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:30:10.334762 12364 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 05:30:10 dist-test-slave-h3ft krb5kdc[11729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253410, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for HTTP/127.26.185.20@KRBTEST.COM
I20260809 05:30:10.414903 12364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "bf7b4a454ade44578fafa62d29ec5694"
format_stamp: "Formatted at 2026-08-09 05:30:10 on dist-test-slave-h3ft"
server_key: "402a70f92fda8ef3b078595cc1558da3"
server_key_iv: "cc41d850a9b84b365f3e9bf839dffd47"
server_key_version: "kuduclusterkey@0"
I20260809 05:30:10.416316 12364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "bf7b4a454ade44578fafa62d29ec5694"
format_stamp: "Formatted at 2026-08-09 05:30:10 on dist-test-slave-h3ft"
server_key: "402a70f92fda8ef3b078595cc1558da3"
server_key_iv: "cc41d850a9b84b365f3e9bf839dffd47"
server_key_version: "kuduclusterkey@0"
I20260809 05:30:10.425621 12364 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.005s sys 0.004s
I20260809 05:30:10.453068 12385 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:30:10.455422 12364 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.001s
I20260809 05:30:10.455742 12364 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "bf7b4a454ade44578fafa62d29ec5694"
format_stamp: "Formatted at 2026-08-09 05:30:10 on dist-test-slave-h3ft"
server_key: "402a70f92fda8ef3b078595cc1558da3"
server_key_iv: "cc41d850a9b84b365f3e9bf839dffd47"
server_key_version: "kuduclusterkey@0"
I20260809 05:30:10.456065 12364 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:30:10.489895 12364 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:30:10.496299 12364 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:30:10.496798 12364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:30:10.536080 12364 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:35159
I20260809 05:30:10.536103 12456 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:35159 every 8 connection(s)
I20260809 05:30:10.538239 12364 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:30:10.543190 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 12364
I20260809 05:30:10.543478 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:30:10.544405 27364 external_mini_cluster.cc:1428] Setting key 6a005ad305f0a4d99a527376eb7fa789
I20260809 05:30:10.545118 12457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 05:30:10 dist-test-slave-h3ft krb5kdc[11729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253409, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:30:10.569510 12457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf7b4a454ade44578fafa62d29ec5694: Bootstrap starting.
I20260809 05:30:10.575824 12457 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bf7b4a454ade44578fafa62d29ec5694: Neither blocks nor log segments found. Creating new log.
I20260809 05:30:10.578435 12457 log.cc:824] T 00000000000000000000000000000000 P bf7b4a454ade44578fafa62d29ec5694: Log is configured to *not* fsync() on all Append() calls
I20260809 05:30:10.582485 12460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:30:10.547423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42086 (local address 127.26.185.62:35159)
0809 05:30:10.548666 (+ 1243us) server_negotiation.cc:206] Beginning negotiation
0809 05:30:10.548682 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 05:30:10.548753 (+ 71us) server_negotiation.cc:407] Connection header received
0809 05:30:10.552321 (+ 3568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:30:10.552360 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:30:10.553034 (+ 674us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:30:10.553541 (+ 507us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:30:10.556424 (+ 2883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:30:10.558678 (+ 2254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:30:10.561127 (+ 2449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:30:10.562262 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:30:10.562629 (+ 367us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:30:10.570206 (+ 7577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:30:10.570223 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:30:10.570249 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:30:10.570314 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:30:10.575366 (+ 5052us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:30:10.577082 (+ 1716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:30:10.577093 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:30:10.577103 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:30:10.577380 (+ 277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:30:10.578084 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:30:10.578088 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:30:10.578090 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:30:10.579145 (+ 1055us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:30:10.579608 (+ 463us) server_negotiation.cc:1035] Waiting for connection context
0809 05:30:10.580355 (+ 747us) server_negotiation.cc:299] Negotiation successful
0809 05:30:10.581025 (+ 670us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":934,"thread_start_us":643,"threads_started":1}
I20260809 05:30:10.583616 12457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf7b4a454ade44578fafa62d29ec5694: No bootstrap required, opened a new log
I20260809 05:30:10.596951 12457 raft_consensus.cc:348] T 00000000000000000000000000000000 P bf7b4a454ade44578fafa62d29ec5694 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf7b4a454ade44578fafa62d29ec5694" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 35159 } }
I20260809 05:30:10.597723 12457 raft_consensus.cc:374] T 00000000000000000000000000000000 P bf7b4a454ade44578fafa62d29ec5694 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:30:10.597898 12457 raft_consensus.cc:729] T 00000000000000000000000000000000 P bf7b4a454ade44578fafa62d29ec5694 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf7b4a454ade44578fafa62d29ec5694, State: Initialized, Role: FOLLOWER
I20260809 05:30:10.598918 12457 consensus_queue.cc:260] T 00000000000000000000000000000000 P bf7b4a454ade44578fafa62d29ec5694 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf7b4a454ade44578fafa62d29ec5694" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 35159 } }
I20260809 05:30:10.599388 12457 raft_consensus.cc:388] T 00000000000000000000000000000000 P bf7b4a454ade44578fafa62d29ec5694 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:30:10.599635 12457 raft_consensus.cc:482] T 00000000000000000000000000000000 P bf7b4a454ade44578fafa62d29ec5694 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:30:10.599941 12457 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bf7b4a454ade44578fafa62d29ec5694 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:30:10.603507 12457 raft_consensus.cc:504] T 00000000000000000000000000000000 P bf7b4a454ade44578fafa62d29ec5694 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf7b4a454ade44578fafa62d29ec5694" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 35159 } }
I20260809 05:30:10.604326 12457 leader_election.cc:302] T 00000000000000000000000000000000 P bf7b4a454ade44578fafa62d29ec5694 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bf7b4a454ade44578fafa62d29ec5694; no voters:
I20260809 05:30:10.605639 12457 leader_election.cc:288] T 00000000000000000000000000000000 P bf7b4a454ade44578fafa62d29ec5694 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:30:10.605944 12463 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bf7b4a454ade44578fafa62d29ec5694 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:30:10.608546 12463 raft_consensus.cc:686] T 00000000000000000000000000000000 P bf7b4a454ade44578fafa62d29ec5694 [term 1 LEADER]: Becoming Leader. State: Replica: bf7b4a454ade44578fafa62d29ec5694, State: Running, Role: LEADER
I20260809 05:30:10.609437 12463 consensus_queue.cc:237] T 00000000000000000000000000000000 P bf7b4a454ade44578fafa62d29ec5694 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf7b4a454ade44578fafa62d29ec5694" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 35159 } }
I20260809 05:30:10.610513 12457 sys_catalog.cc:564] T 00000000000000000000000000000000 P bf7b4a454ade44578fafa62d29ec5694 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:30:10.614513 12464 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf7b4a454ade44578fafa62d29ec5694 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bf7b4a454ade44578fafa62d29ec5694" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf7b4a454ade44578fafa62d29ec5694" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 35159 } } }
I20260809 05:30:10.614706 12465 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf7b4a454ade44578fafa62d29ec5694 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf7b4a454ade44578fafa62d29ec5694. Latest consensus state: current_term: 1 leader_uuid: "bf7b4a454ade44578fafa62d29ec5694" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf7b4a454ade44578fafa62d29ec5694" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 35159 } } }
I20260809 05:30:10.615718 12464 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf7b4a454ade44578fafa62d29ec5694 [sys.catalog]: This master's current role is: LEADER
I20260809 05:30:10.615748 12465 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf7b4a454ade44578fafa62d29ec5694 [sys.catalog]: This master's current role is: LEADER
I20260809 05:30:10.622073 12473 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:30:10.630296 12473 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:30:10.631669 12457 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 05:30:10.657049 12473 catalog_manager.cc:1347] Generated new cluster ID: 52b87c3342024b51a587402c0c13d619
I20260809 05:30:10.657289 12473 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:30:10.683034 12473 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:30:10.686205 12473 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:30:10.702349 12473 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bf7b4a454ade44578fafa62d29ec5694: Generated new TSK 0
I20260809 05:30:10.704217 12473 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.185.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
I20260809 05:30:11.640455 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.185.20:47975/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:0
--local_ip_for_outbound_sockets=127.26.185.1
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:35159
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:37401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 05:30:11 dist-test-slave-h3ft krb5kdc[11729](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786253411, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 05:30:12.342437 12521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:30:12.342885 12521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:30:12.343102 12521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:30:12.353440 12521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:30:12.353752 12521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:30:12.354053 12521 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:30:12.371868 12521 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:37401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.26.185.20:47975/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:35159
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:30:12.374894 12521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:30:12.376982 12521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:30:12.403388 12536 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:30:12.404192 12535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:30:12.407832 12538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:30:12.409353 12521 server_base.cc:1034] running on GCE node
I20260809 05:30:12.410557 12521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:30:12.412472 12521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:30:12.413966 12521 hybrid_clock.cc:648] HybridClock initialized: now 1786253412413872 us; error 76 us; skew 500 ppm
I20260809 05:30:12.414499 12521 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:30:12 dist-test-slave-h3ft krb5kdc[11729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253412, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:30:12.420418 12521 init.cc:377] Logged in from keytab as kudu/127.26.185.1@KRBTEST.COM (short username kudu)
I20260809 05:30:12.432137 12521 webserver.cc:460] Webserver started at http://127.26.185.1:42053/ using document root <none> and password file <none>
I20260809 05:30:12.433604 12521 fs_manager.cc:359] Metadata directory not provided
I20260809 05:30:12.433867 12521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:30:12.434460 12521 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 05:30:12 dist-test-slave-h3ft krb5kdc[11729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253412, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for HTTP/127.26.185.20@KRBTEST.COM
I20260809 05:30:12.463255 12521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-0/data/instance:
uuid: "fd4bef8103924007aee60ca4ea1011ec"
format_stamp: "Formatted at 2026-08-09 05:30:12 on dist-test-slave-h3ft"
server_key: "fc7f3d52483a35a590de3a237ab034ea"
server_key_iv: "b5c377f14ea816e2c6e734277b4b3b62"
server_key_version: "kuduclusterkey@0"
I20260809 05:30:12.465194 12521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance:
uuid: "fd4bef8103924007aee60ca4ea1011ec"
format_stamp: "Formatted at 2026-08-09 05:30:12 on dist-test-slave-h3ft"
server_key: "fc7f3d52483a35a590de3a237ab034ea"
server_key_iv: "b5c377f14ea816e2c6e734277b4b3b62"
server_key_version: "kuduclusterkey@0"
I20260809 05:30:12.495326 12521 fs_manager.cc:691] Time spent creating directory manager: real 0.029s user 0.007s sys 0.018s
I20260809 05:30:12.542017 12546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:30:12.549278 12521 fs_manager.cc:725] Time spent opening block manager: real 0.019s user 0.003s sys 0.002s
I20260809 05:30:12.549793 12521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "fd4bef8103924007aee60ca4ea1011ec"
format_stamp: "Formatted at 2026-08-09 05:30:12 on dist-test-slave-h3ft"
server_key: "fc7f3d52483a35a590de3a237ab034ea"
server_key_iv: "b5c377f14ea816e2c6e734277b4b3b62"
server_key_version: "kuduclusterkey@0"
I20260809 05:30:12.550372 12521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 09 05:30:12 dist-test-slave-h3ft krb5kdc[11729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253411, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for HTTP/127.26.185.20@KRBTEST.COM
I20260809 05:30:12.635140 12521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:30:12.642972 12521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:30:12.643616 12521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:30:12.662963 12521 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:30:12.677963 12521 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:30:12.678267 12521 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260809 05:30:12.678598 12521 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:30:12.678792 12521 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:30:12.819263 12521 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:41339
I20260809 05:30:12.819326 12716 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:41339 every 8 connection(s)
I20260809 05:30:12.822008 12521 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:30:12.824646 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 12521
I20260809 05:30:12.824975 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance
I20260809 05:30:12.826025 27364 external_mini_cluster.cc:1428] Setting key d655177862101f8fbaf41009509a1ec0
Aug 09 05:30:12 dist-test-slave-h3ft krb5kdc[11729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253412, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.185.2@KRBTEST.COM; defaulting to no policy
I20260809 05:30:12.906036 12722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:30:12.832820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:36047 (local address 127.26.185.62:35159)
0809 05:30:12.867645 (+ 34825us) server_negotiation.cc:206] Beginning negotiation
0809 05:30:12.867653 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:30:12.870322 (+ 2669us) server_negotiation.cc:407] Connection header received
0809 05:30:12.875309 (+ 4987us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:30:12.875319 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:30:12.875469 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:30:12.875603 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:30:12.879628 (+ 4025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:30:12.881313 (+ 1685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:30:12.885210 (+ 3897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:30:12.886216 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:30:12.886372 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:30:12.893802 (+ 7430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:30:12.893815 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:30:12.893822 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:30:12.893892 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:30:12.899812 (+ 5920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:30:12.901498 (+ 1686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:30:12.901508 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:30:12.901512 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:30:12.901822 (+ 310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:30:12.902755 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:30:12.902762 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:30:12.902765 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:30:12.903367 (+ 602us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:30:12.903542 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0809 05:30:12.905019 (+ 1477us) server_negotiation.cc:299] Negotiation successful
0809 05:30:12.905369 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34652,"thread_start_us":36223,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.2@KRBTEST.COM" created.
I20260809 05:30:12.909650 12721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:30:12.831127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:35159 (local address 127.26.185.1:36047)
0809 05:30:12.866870 (+ 35743us) negotiation.cc:107] Waiting for socket to connect
0809 05:30:12.866968 (+ 98us) client_negotiation.cc:174] Beginning negotiation
0809 05:30:12.873292 (+ 6324us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:30:12.876565 (+ 3273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:30:12.876583 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:30:12.877657 (+ 1074us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:30:12.879284 (+ 1627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:30:12.879326 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:30:12.881700 (+ 2374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:30:12.881707 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:30:12.884904 (+ 3197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:30:12.884930 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:30:12.887084 (+ 2154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:30:12.887099 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:30:12.887614 (+ 515us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:30:12.888876 (+ 1262us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:30:12.888937 (+ 61us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:30:12.893222 (+ 4285us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:30:12.900208 (+ 6986us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:30:12.900223 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:30:12.900255 (+ 32us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:30:12.901263 (+ 1008us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:30:12.902095 (+ 832us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:30:12.902101 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:30:12.902105 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:30:12.902575 (+ 470us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:30:12.903673 (+ 1098us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:30:12.903685 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:30:12.904420 (+ 735us) client_negotiation.cc:769] Sending connection context
0809 05:30:12.906387 (+ 1967us) client_negotiation.cc:240] Negotiation successful
0809 05:30:12.907367 (+ 980us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35169,"thread_start_us":36348,"threads_started":1}
I20260809 05:30:12.921891 12719 heartbeater.cc:347] Connected to a master server at 127.26.185.62:35159
I20260809 05:30:12.922430 12719 heartbeater.cc:464] Registering TS with master...
I20260809 05:30:12.923717 12719 heartbeater.cc:511] Master 127.26.185.62:35159 requested a full tablet report, sending...
I20260809 05:30:12.927438 12409 ts_manager.cc:194] Registered new tserver with Master: fd4bef8103924007aee60ca4ea1011ec (127.26.185.1:41339)
I20260809 05:30:12.930061 12409 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.1@KRBTEST.COM'} at 127.26.185.1:36047
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
W20260809 05:30:12.966655 27364 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.26.185.2: real 0.133s user 0.000s sys 0.034s
I20260809 05:30:12.968075 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.185.20:47975/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:0
--local_ip_for_outbound_sockets=127.26.185.2
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:35159
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:37401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 05:30:13 dist-test-slave-h3ft krb5kdc[11729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253411, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for HTTP/127.26.185.20@KRBTEST.COM
W20260809 05:30:13.663092 12726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:30:13.663669 12726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:30:13.663923 12726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:30:13.673111 12726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:30:13.673316 12726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:30:13.673571 12726 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:30:13.687215 12726 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:37401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.26.185.20:47975/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:35159
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:30:13.689168 12726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:30:13.691147 12726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:30:13.711223 12745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:30:13.711223 12746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:30:13.712643 12726 server_base.cc:1034] running on GCE node
W20260809 05:30:13.715807 12749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:30:13.717110 12726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:30:13.718658 12726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:30:13.720000 12726 hybrid_clock.cc:648] HybridClock initialized: now 1786253413719910 us; error 83 us; skew 500 ppm
I20260809 05:30:13.720552 12726 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:30:13 dist-test-slave-h3ft krb5kdc[11729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253413, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:30:13.725562 12726 init.cc:377] Logged in from keytab as kudu/127.26.185.2@KRBTEST.COM (short username kudu)
I20260809 05:30:13.728158 12726 webserver.cc:460] Webserver started at http://127.26.185.2:39281/ using document root <none> and password file <none>
I20260809 05:30:13.729245 12726 fs_manager.cc:359] Metadata directory not provided
I20260809 05:30:13.729485 12726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:30:13.730014 12726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 05:30:13 dist-test-slave-h3ft krb5kdc[11729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253413, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for HTTP/127.26.185.20@KRBTEST.COM
I20260809 05:30:13.757117 12726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-1/data/instance:
uuid: "838ffd66b4014b9998e328028c97a616"
format_stamp: "Formatted at 2026-08-09 05:30:13 on dist-test-slave-h3ft"
server_key: "c0880fd9c963604287db9bd98495e8c7"
server_key_iv: "674b72f7371dc429f9d59693237053e4"
server_key_version: "kuduclusterkey@0"
I20260809 05:30:13.760191 12726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance:
uuid: "838ffd66b4014b9998e328028c97a616"
format_stamp: "Formatted at 2026-08-09 05:30:13 on dist-test-slave-h3ft"
server_key: "c0880fd9c963604287db9bd98495e8c7"
server_key_iv: "674b72f7371dc429f9d59693237053e4"
server_key_version: "kuduclusterkey@0"
I20260809 05:30:13.770911 12726 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.008s sys 0.000s
I20260809 05:30:13.798457 12757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:30:13.801311 12726 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.001s
I20260809 05:30:13.801630 12726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "838ffd66b4014b9998e328028c97a616"
format_stamp: "Formatted at 2026-08-09 05:30:13 on dist-test-slave-h3ft"
server_key: "c0880fd9c963604287db9bd98495e8c7"
server_key_iv: "674b72f7371dc429f9d59693237053e4"
server_key_version: "kuduclusterkey@0"
I20260809 05:30:13.802022 12726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:30:13.838528 12726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:30:13.845551 12726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:30:13.846153 12726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:30:13.848261 12726 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:30:13.850839 12726 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:30:13.851078 12726 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:30:13.851305 12726 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:30:13.851435 12726 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:30:13.932425 12726 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:44685
I20260809 05:30:13.932446 12920 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:44685 every 8 connection(s)
I20260809 05:30:13.934839 12726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:30:13.935520 12719 heartbeater.cc:503] Master 127.26.185.62:35159 was elected leader, sending a full tablet report...
I20260809 05:30:13.940989 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 12726
I20260809 05:30:13.941229 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance
I20260809 05:30:13.941932 27364 external_mini_cluster.cc:1428] Setting key eaa225f3e3494a68adf1b1f3aebfc2ed
Aug 09 05:30:13 dist-test-slave-h3ft krb5kdc[11729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253413, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:30:13.973862 12925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:30:13.939895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:50221 (local address 127.26.185.62:35159)
0809 05:30:13.940839 (+ 944us) server_negotiation.cc:206] Beginning negotiation
0809 05:30:13.940847 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:30:13.942813 (+ 1966us) server_negotiation.cc:407] Connection header received
0809 05:30:13.946472 (+ 3659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:30:13.946480 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:30:13.946596 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:30:13.946741 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:30:13.949964 (+ 3223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:30:13.951589 (+ 1625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:30:13.955281 (+ 3692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:30:13.956109 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:30:13.956273 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:30:13.963535 (+ 7262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:30:13.963543 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:30:13.963547 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:30:13.963633 (+ 86us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:30:13.968175 (+ 4542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:30:13.969660 (+ 1485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:30:13.969668 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:30:13.969671 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:30:13.969967 (+ 296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:30:13.970809 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:30:13.970817 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:30:13.970824 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:30:13.971451 (+ 627us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:30:13.971698 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0809 05:30:13.972859 (+ 1161us) server_negotiation.cc:299] Negotiation successful
0809 05:30:13.973231 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":777,"thread_start_us":4377,"threads_started":1}
I20260809 05:30:13.975811 12927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:30:13.940995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:35159 (local address 127.26.185.2:50221)
0809 05:30:13.942583 (+ 1588us) negotiation.cc:107] Waiting for socket to connect
0809 05:30:13.942659 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0809 05:30:13.945952 (+ 3293us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:30:13.947234 (+ 1282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:30:13.947256 (+ 22us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:30:13.948265 (+ 1009us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:30:13.949632 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:30:13.949687 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:30:13.951874 (+ 2187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:30:13.951882 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:30:13.955078 (+ 3196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:30:13.955105 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:30:13.956562 (+ 1457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:30:13.956574 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:30:13.957118 (+ 544us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:30:13.958591 (+ 1473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:30:13.958641 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:30:13.963092 (+ 4451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:30:13.968469 (+ 5377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:30:13.968482 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:30:13.968508 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:30:13.969307 (+ 799us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:30:13.970134 (+ 827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:30:13.970141 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:30:13.970145 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:30:13.970624 (+ 479us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:30:13.971636 (+ 1012us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:30:13.971650 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:30:13.972194 (+ 544us) client_negotiation.cc:769] Sending connection context
0809 05:30:13.972642 (+ 448us) client_negotiation.cc:240] Negotiation successful
0809 05:30:13.973587 (+ 945us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1203,"thread_start_us":783,"threads_started":1}
I20260809 05:30:13.978626 12921 heartbeater.cc:347] Connected to a master server at 127.26.185.62:35159
I20260809 05:30:13.979151 12921 heartbeater.cc:464] Registering TS with master...
I20260809 05:30:13.980212 12921 heartbeater.cc:511] Master 127.26.185.62:35159 requested a full tablet report, sending...
I20260809 05:30:13.982405 12409 ts_manager.cc:194] Registered new tserver with Master: 838ffd66b4014b9998e328028c97a616 (127.26.185.2:44685)
I20260809 05:30:13.983745 12409 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.2@KRBTEST.COM'} at 127.26.185.2:50221
WARNING: no policy specified for kudu/127.26.185.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
W20260809 05:30:14.046613 27364 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.26.185.3: real 0.101s user 0.003s sys 0.029s
I20260809 05:30:14.048204 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.185.20:47975/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:0
--local_ip_for_outbound_sockets=127.26.185.3
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:35159
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:37401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:30:14.647030 12931 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:30:14.647567 12931 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:30:14.647799 12931 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:30:14.659101 12931 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:30:14.659360 12931 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:30:14.659611 12931 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:30:14.674595 12931 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:37401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.26.185.20:47975/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:35159
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:30:14.676694 12931 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:30:14.678629 12931 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:30:14.699035 12937 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:30:14.698983 12939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:30:14.699260 12941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:30:14.700208 12931 server_base.cc:1034] running on GCE node
I20260809 05:30:14.701118 12931 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:30:14.702420 12931 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:30:14.703713 12931 hybrid_clock.cc:648] HybridClock initialized: now 1786253414703631 us; error 70 us; skew 500 ppm
I20260809 05:30:14.704206 12931 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:30:14 dist-test-slave-h3ft krb5kdc[11729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253414, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:30:14.708801 12931 init.cc:377] Logged in from keytab as kudu/127.26.185.3@KRBTEST.COM (short username kudu)
I20260809 05:30:14.711472 12931 webserver.cc:460] Webserver started at http://127.26.185.3:33699/ using document root <none> and password file <none>
I20260809 05:30:14.712838 12931 fs_manager.cc:359] Metadata directory not provided
I20260809 05:30:14.713090 12931 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:30:14.713707 12931 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 05:30:14 dist-test-slave-h3ft krb5kdc[11729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253414, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for HTTP/127.26.185.20@KRBTEST.COM
I20260809 05:30:14.740885 12931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-2/data/instance:
uuid: "a610e6ae8b8e4096ac5351a487b1092d"
format_stamp: "Formatted at 2026-08-09 05:30:14 on dist-test-slave-h3ft"
server_key: "4aeba6d3e8c7d38fef2e2aec6ae8b79f"
server_key_iv: "3f09b7eb3d8a830d26a3612ae2dfa1e3"
server_key_version: "kuduclusterkey@0"
I20260809 05:30:14.742101 12931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance:
uuid: "a610e6ae8b8e4096ac5351a487b1092d"
format_stamp: "Formatted at 2026-08-09 05:30:14 on dist-test-slave-h3ft"
server_key: "4aeba6d3e8c7d38fef2e2aec6ae8b79f"
server_key_iv: "3f09b7eb3d8a830d26a3612ae2dfa1e3"
server_key_version: "kuduclusterkey@0"
I20260809 05:30:14.749953 12931 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260809 05:30:14.774102 12952 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:30:14.776312 12931 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260809 05:30:14.776573 12931 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "a610e6ae8b8e4096ac5351a487b1092d"
format_stamp: "Formatted at 2026-08-09 05:30:14 on dist-test-slave-h3ft"
server_key: "4aeba6d3e8c7d38fef2e2aec6ae8b79f"
server_key_iv: "3f09b7eb3d8a830d26a3612ae2dfa1e3"
server_key_version: "kuduclusterkey@0"
I20260809 05:30:14.776988 12931 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:30:14.813524 12931 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:30:14.819810 12931 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:30:14.820339 12931 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:30:14.821909 12931 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:30:14.824213 12931 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:30:14.824354 12931 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:30:14.824555 12931 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:30:14.824608 12931 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:30:14.886206 12931 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:43473
I20260809 05:30:14.886281 13121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:43473 every 8 connection(s)
I20260809 05:30:14.888250 12931 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:30:14.890074 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 12931
I20260809 05:30:14.890352 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance
I20260809 05:30:14.891263 27364 external_mini_cluster.cc:1428] Setting key 60c18cf9c2edf9a5c50400c640c29db5
Aug 09 05:30:14 dist-test-slave-h3ft krb5kdc[11729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253414, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:30:14.920619 13125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:30:14.893585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:59467 (local address 127.26.185.62:35159)
0809 05:30:14.894744 (+ 1159us) server_negotiation.cc:206] Beginning negotiation
0809 05:30:14.894752 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:30:14.896569 (+ 1817us) server_negotiation.cc:407] Connection header received
0809 05:30:14.898798 (+ 2229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:30:14.898803 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:30:14.898897 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:30:14.899103 (+ 206us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:30:14.901341 (+ 2238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:30:14.902389 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:30:14.904647 (+ 2258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:30:14.905186 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:30:14.905304 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:30:14.911184 (+ 5880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:30:14.911192 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:30:14.911198 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:30:14.911260 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:30:14.915873 (+ 4613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:30:14.917164 (+ 1291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:30:14.917170 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:30:14.917173 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:30:14.917409 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:30:14.918090 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:30:14.918094 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:30:14.918096 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:30:14.918520 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:30:14.918654 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 05:30:14.919849 (+ 1195us) server_negotiation.cc:299] Negotiation successful
0809 05:30:14.920125 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":973,"thread_start_us":510,"threads_started":1}
I20260809 05:30:14.922181 13126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:30:14.894800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:35159 (local address 127.26.185.3:59467)
0809 05:30:14.896333 (+ 1533us) negotiation.cc:107] Waiting for socket to connect
0809 05:30:14.896400 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0809 05:30:14.898473 (+ 2073us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:30:14.899465 (+ 992us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:30:14.899477 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:30:14.900192 (+ 715us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:30:14.901091 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:30:14.901117 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:30:14.902606 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:30:14.902611 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:30:14.904424 (+ 1813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:30:14.904442 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:30:14.905468 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:30:14.905474 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:30:14.905748 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:30:14.906806 (+ 1058us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:30:14.906846 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:30:14.910807 (+ 3961us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:30:14.916164 (+ 5357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:30:14.916176 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:30:14.916202 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:30:14.916954 (+ 752us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:30:14.917563 (+ 609us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:30:14.917567 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:30:14.917569 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:30:14.917946 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:30:14.918650 (+ 704us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:30:14.918659 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:30:14.919253 (+ 594us) client_negotiation.cc:769] Sending connection context
0809 05:30:14.919696 (+ 443us) client_negotiation.cc:240] Negotiation successful
0809 05:30:14.920338 (+ 642us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1171,"thread_start_us":670,"threads_started":1}
I20260809 05:30:14.924464 13122 heartbeater.cc:347] Connected to a master server at 127.26.185.62:35159
I20260809 05:30:14.924921 13122 heartbeater.cc:464] Registering TS with master...
I20260809 05:30:14.926024 13122 heartbeater.cc:511] Master 127.26.185.62:35159 requested a full tablet report, sending...
I20260809 05:30:14.928409 12409 ts_manager.cc:194] Registered new tserver with Master: a610e6ae8b8e4096ac5351a487b1092d (127.26.185.3:43473)
I20260809 05:30:14.929466 12409 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.3@KRBTEST.COM'} at 127.26.185.3:59467
I20260809 05:30:14.937970 27364 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 05:30:14.963253 13125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:30:14.944736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42088 (local address 127.26.185.62:35159)
0809 05:30:14.945011 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0809 05:30:14.945021 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:30:14.945713 (+ 692us) server_negotiation.cc:407] Connection header received
0809 05:30:14.945912 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:30:14.945917 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:30:14.946013 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:30:14.946128 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:30:14.948375 (+ 2247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:30:14.949307 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:30:14.951467 (+ 2160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:30:14.952017 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:30:14.952135 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:30:14.955646 (+ 3511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:30:14.955651 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:30:14.955655 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:30:14.955705 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:30:14.959603 (+ 3898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:30:14.960641 (+ 1038us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:30:14.960646 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:30:14.960649 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:30:14.960837 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:30:14.961255 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:30:14.961259 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:30:14.961261 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:30:14.961690 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:30:14.961964 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0809 05:30:14.962420 (+ 456us) server_negotiation.cc:299] Negotiation successful
0809 05:30:14.962720 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260809 05:30:14.969219 12409 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42088:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 05:30:14.980572 12409 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 05:30:14.987895 12921 heartbeater.cc:503] Master 127.26.185.62:35159 was elected leader, sending a full tablet report...
I20260809 05:30:15.034277 13142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:30:15.002048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:43473 (local address 127.0.0.1:33384)
0809 05:30:15.016476 (+ 14428us) negotiation.cc:107] Waiting for socket to connect
0809 05:30:15.016594 (+ 118us) client_negotiation.cc:174] Beginning negotiation
0809 05:30:15.017021 (+ 427us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:30:15.023073 (+ 6052us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:30:15.023085 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:30:15.023143 (+ 58us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:30:15.024039 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:30:15.024062 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:30:15.026595 (+ 2533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:30:15.026602 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:30:15.030098 (+ 3496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:30:15.030112 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:30:15.032490 (+ 2378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:30:15.032500 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:30:15.032832 (+ 332us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:30:15.033071 (+ 239us) client_negotiation.cc:769] Sending connection context
0809 05:30:15.033249 (+ 178us) client_negotiation.cc:240] Negotiation successful
0809 05:30:15.033562 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13818,"mutex_wait_us":234,"thread_start_us":18336,"threads_started":1}
I20260809 05:30:15.034425 13144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:30:15.003663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33384 (local address 127.26.185.3:43473)
0809 05:30:15.021897 (+ 18234us) server_negotiation.cc:206] Beginning negotiation
0809 05:30:15.021912 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 05:30:15.021979 (+ 67us) server_negotiation.cc:407] Connection header received
0809 05:30:15.022161 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:30:15.022175 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:30:15.022656 (+ 481us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:30:15.023027 (+ 371us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:30:15.024358 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:30:15.026391 (+ 2033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:30:15.030292 (+ 3901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:30:15.032163 (+ 1871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:30:15.032339 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:30:15.032689 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0809 05:30:15.033578 (+ 889us) server_negotiation.cc:299] Negotiation successful
0809 05:30:15.033835 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17887,"thread_start_us":17959,"threads_started":1}
I20260809 05:30:15.035943 13141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:30:15.002382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:44685 (local address 127.0.0.1:56472)
0809 05:30:15.021009 (+ 18627us) negotiation.cc:107] Waiting for socket to connect
0809 05:30:15.021060 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 05:30:15.021503 (+ 443us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:30:15.023350 (+ 1847us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:30:15.023357 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:30:15.023392 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:30:15.024073 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:30:15.024084 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:30:15.027112 (+ 3028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:30:15.027120 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:30:15.030952 (+ 3832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:30:15.030972 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:30:15.032884 (+ 1912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:30:15.032892 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:30:15.033286 (+ 394us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:30:15.033325 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 05:30:15.035233 (+ 1908us) client_negotiation.cc:240] Negotiation successful
0809 05:30:15.035411 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18376,"mutex_wait_us":184,"thread_start_us":15041,"threads_started":1}
I20260809 05:30:15.037158 13143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:30:15.003525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56472 (local address 127.26.185.2:44685)
0809 05:30:15.022537 (+ 19012us) server_negotiation.cc:206] Beginning negotiation
0809 05:30:15.022545 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:30:15.022575 (+ 30us) server_negotiation.cc:407] Connection header received
0809 05:30:15.022673 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:30:15.022679 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:30:15.022989 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:30:15.024372 (+ 1383us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:30:15.024776 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:30:15.026842 (+ 2066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:30:15.031193 (+ 4351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:30:15.032499 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:30:15.033101 (+ 602us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:30:15.033406 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0809 05:30:15.036437 (+ 3031us) server_negotiation.cc:299] Negotiation successful
0809 05:30:15.036694 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18802,"thread_start_us":20713,"threads_started":1}
I20260809 05:30:15.037703 13145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:30:15.019085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:41339 (local address 127.0.0.1:43158)
0809 05:30:15.021378 (+ 2293us) negotiation.cc:107] Waiting for socket to connect
0809 05:30:15.021397 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 05:30:15.021526 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:30:15.026362 (+ 4836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:30:15.026368 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:30:15.026399 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:30:15.028102 (+ 1703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:30:15.028120 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:30:15.031117 (+ 2997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:30:15.031126 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:30:15.033479 (+ 2353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:30:15.033492 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:30:15.036598 (+ 3106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:30:15.036605 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:30:15.036826 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:30:15.036866 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 05:30:15.036976 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 05:30:15.037137 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2107,"mutex_wait_us":22,"spinlock_wait_cycles":5376,"thread_start_us":2052,"threads_started":1}
I20260809 05:30:15.038141 13146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:30:15.019913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43158 (local address 127.26.185.1:41339)
0809 05:30:15.025352 (+ 5439us) server_negotiation.cc:206] Beginning negotiation
0809 05:30:15.025379 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0809 05:30:15.025438 (+ 59us) server_negotiation.cc:407] Connection header received
0809 05:30:15.025729 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:30:15.025743 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:30:15.026077 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:30:15.027047 (+ 970us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:30:15.028332 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:30:15.030878 (+ 2546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:30:15.033701 (+ 2823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:30:15.036288 (+ 2587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:30:15.036491 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:30:15.036790 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0809 05:30:15.037072 (+ 282us) server_negotiation.cc:299] Negotiation successful
0809 05:30:15.037479 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5209,"thread_start_us":4913,"threads_started":1}
I20260809 05:30:15.040547 13020 tablet_service.cc:1467] Processing CreateTablet for tablet d3da8c43fa2e46aa9f1c4ad75d9f91f7 (DEFAULT_TABLE table=test-table [id=1a163a6e67784a1480d7fc413614f31a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:30:15.041853 12827 tablet_service.cc:1467] Processing CreateTablet for tablet d3da8c43fa2e46aa9f1c4ad75d9f91f7 (DEFAULT_TABLE table=test-table [id=1a163a6e67784a1480d7fc413614f31a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:30:15.042970 13020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3da8c43fa2e46aa9f1c4ad75d9f91f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:30:15.043592 12827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3da8c43fa2e46aa9f1c4ad75d9f91f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:30:15.043183 12613 tablet_service.cc:1467] Processing CreateTablet for tablet d3da8c43fa2e46aa9f1c4ad75d9f91f7 (DEFAULT_TABLE table=test-table [id=1a163a6e67784a1480d7fc413614f31a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:30:15.045094 12613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3da8c43fa2e46aa9f1c4ad75d9f91f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:30:15.059782 13147 tablet_bootstrap.cc:492] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P 838ffd66b4014b9998e328028c97a616: Bootstrap starting.
I20260809 05:30:15.065779 13148 tablet_bootstrap.cc:492] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec: Bootstrap starting.
I20260809 05:30:15.066243 13147 tablet_bootstrap.cc:654] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P 838ffd66b4014b9998e328028c97a616: Neither blocks nor log segments found. Creating new log.
I20260809 05:30:15.068750 13149 tablet_bootstrap.cc:492] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P a610e6ae8b8e4096ac5351a487b1092d: Bootstrap starting.
I20260809 05:30:15.068879 13147 log.cc:824] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P 838ffd66b4014b9998e328028c97a616: Log is configured to *not* fsync() on all Append() calls
I20260809 05:30:15.074712 13149 tablet_bootstrap.cc:654] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P a610e6ae8b8e4096ac5351a487b1092d: Neither blocks nor log segments found. Creating new log.
I20260809 05:30:15.075647 13148 tablet_bootstrap.cc:654] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec: Neither blocks nor log segments found. Creating new log.
I20260809 05:30:15.077497 13148 log.cc:824] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec: Log is configured to *not* fsync() on all Append() calls
I20260809 05:30:15.077620 13149 log.cc:824] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P a610e6ae8b8e4096ac5351a487b1092d: Log is configured to *not* fsync() on all Append() calls
I20260809 05:30:15.080694 13147 tablet_bootstrap.cc:492] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P 838ffd66b4014b9998e328028c97a616: No bootstrap required, opened a new log
I20260809 05:30:15.081351 13147 ts_tablet_manager.cc:1397] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P 838ffd66b4014b9998e328028c97a616: Time spent bootstrapping tablet: real 0.022s user 0.014s sys 0.004s
I20260809 05:30:15.083269 13149 tablet_bootstrap.cc:492] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P a610e6ae8b8e4096ac5351a487b1092d: No bootstrap required, opened a new log
I20260809 05:30:15.083709 13149 ts_tablet_manager.cc:1397] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P a610e6ae8b8e4096ac5351a487b1092d: Time spent bootstrapping tablet: real 0.015s user 0.011s sys 0.002s
I20260809 05:30:15.083822 13148 tablet_bootstrap.cc:492] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec: No bootstrap required, opened a new log
I20260809 05:30:15.084239 13148 ts_tablet_manager.cc:1397] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec: Time spent bootstrapping tablet: real 0.019s user 0.011s sys 0.003s
I20260809 05:30:15.095500 13149 raft_consensus.cc:348] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P a610e6ae8b8e4096ac5351a487b1092d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a610e6ae8b8e4096ac5351a487b1092d" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43473 } } peers { permanent_uuid: "838ffd66b4014b9998e328028c97a616" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 44685 } } peers { permanent_uuid: "fd4bef8103924007aee60ca4ea1011ec" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41339 } }
I20260809 05:30:15.096159 13149 raft_consensus.cc:374] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P a610e6ae8b8e4096ac5351a487b1092d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:30:15.096282 13149 raft_consensus.cc:729] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P a610e6ae8b8e4096ac5351a487b1092d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a610e6ae8b8e4096ac5351a487b1092d, State: Initialized, Role: FOLLOWER
I20260809 05:30:15.097348 13149 consensus_queue.cc:260] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P a610e6ae8b8e4096ac5351a487b1092d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a610e6ae8b8e4096ac5351a487b1092d" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43473 } } peers { permanent_uuid: "838ffd66b4014b9998e328028c97a616" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 44685 } } peers { permanent_uuid: "fd4bef8103924007aee60ca4ea1011ec" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41339 } }
I20260809 05:30:15.097647 13147 raft_consensus.cc:348] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P 838ffd66b4014b9998e328028c97a616 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a610e6ae8b8e4096ac5351a487b1092d" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43473 } } peers { permanent_uuid: "838ffd66b4014b9998e328028c97a616" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 44685 } } peers { permanent_uuid: "fd4bef8103924007aee60ca4ea1011ec" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41339 } }
I20260809 05:30:15.098476 13147 raft_consensus.cc:374] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P 838ffd66b4014b9998e328028c97a616 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:30:15.098686 13147 raft_consensus.cc:729] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P 838ffd66b4014b9998e328028c97a616 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 838ffd66b4014b9998e328028c97a616, State: Initialized, Role: FOLLOWER
I20260809 05:30:15.099722 13122 heartbeater.cc:503] Master 127.26.185.62:35159 was elected leader, sending a full tablet report...
I20260809 05:30:15.100036 13147 consensus_queue.cc:260] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P 838ffd66b4014b9998e328028c97a616 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a610e6ae8b8e4096ac5351a487b1092d" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43473 } } peers { permanent_uuid: "838ffd66b4014b9998e328028c97a616" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 44685 } } peers { permanent_uuid: "fd4bef8103924007aee60ca4ea1011ec" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41339 } }
I20260809 05:30:15.100960 13148 raft_consensus.cc:348] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a610e6ae8b8e4096ac5351a487b1092d" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43473 } } peers { permanent_uuid: "838ffd66b4014b9998e328028c97a616" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 44685 } } peers { permanent_uuid: "fd4bef8103924007aee60ca4ea1011ec" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41339 } }
I20260809 05:30:15.101488 13149 ts_tablet_manager.cc:1428] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P a610e6ae8b8e4096ac5351a487b1092d: Time spent starting tablet: real 0.018s user 0.015s sys 0.002s
I20260809 05:30:15.101847 13148 raft_consensus.cc:374] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:30:15.102044 13148 raft_consensus.cc:729] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4bef8103924007aee60ca4ea1011ec, State: Initialized, Role: FOLLOWER
I20260809 05:30:15.103127 13148 consensus_queue.cc:260] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a610e6ae8b8e4096ac5351a487b1092d" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43473 } } peers { permanent_uuid: "838ffd66b4014b9998e328028c97a616" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 44685 } } peers { permanent_uuid: "fd4bef8103924007aee60ca4ea1011ec" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41339 } }
I20260809 05:30:15.104400 13147 ts_tablet_manager.cc:1428] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P 838ffd66b4014b9998e328028c97a616: Time spent starting tablet: real 0.023s user 0.017s sys 0.006s
I20260809 05:30:15.107384 13148 ts_tablet_manager.cc:1428] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec: Time spent starting tablet: real 0.023s user 0.015s sys 0.008s
W20260809 05:30:15.127630 12720 tablet.cc:2369] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 05:30:15.142434 13123 tablet.cc:2369] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P a610e6ae8b8e4096ac5351a487b1092d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 05:30:15.195521 12924 tablet.cc:2369] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P 838ffd66b4014b9998e328028c97a616: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:30:15.295547 13157 raft_consensus.cc:482] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:30:15.296209 13157 raft_consensus.cc:504] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a610e6ae8b8e4096ac5351a487b1092d" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43473 } } peers { permanent_uuid: "838ffd66b4014b9998e328028c97a616" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 44685 } } peers { permanent_uuid: "fd4bef8103924007aee60ca4ea1011ec" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41339 } }
I20260809 05:30:15.299194 13157 leader_election.cc:288] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a610e6ae8b8e4096ac5351a487b1092d (127.26.185.3:43473), 838ffd66b4014b9998e328028c97a616 (127.26.185.2:44685)
I20260809 05:30:15.309685 13144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:30:15.299765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:58771 (local address 127.26.185.3:43473)
0809 05:30:15.300131 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0809 05:30:15.300140 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:30:15.301652 (+ 1512us) server_negotiation.cc:407] Connection header received
0809 05:30:15.301986 (+ 334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:30:15.301991 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:30:15.302074 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:30:15.302197 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:30:15.303285 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:30:15.304336 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:30:15.306917 (+ 2581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:30:15.308194 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:30:15.308471 (+ 277us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:30:15.308585 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 05:30:15.309053 (+ 468us) server_negotiation.cc:299] Negotiation successful
0809 05:30:15.309249 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 05:30:15.311141 13160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:30:15.300254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:43473 (local address 127.26.185.1:58771)
0809 05:30:15.301501 (+ 1247us) negotiation.cc:107] Waiting for socket to connect
0809 05:30:15.301519 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 05:30:15.301775 (+ 256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:30:15.302218 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:30:15.302222 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:30:15.302248 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:30:15.302980 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:30:15.302992 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:30:15.304520 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:30:15.304526 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:30:15.306663 (+ 2137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:30:15.306677 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:30:15.308492 (+ 1815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:30:15.308499 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:30:15.308714 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:30:15.308745 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 05:30:15.310052 (+ 1307us) client_negotiation.cc:240] Negotiation successful
0809 05:30:15.310274 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1124,"spinlock_wait_cycles":12160,"thread_start_us":739,"threads_started":1}
I20260809 05:30:15.311415 13143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:30:15.300003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:51445 (local address 127.26.185.2:44685)
0809 05:30:15.300367 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0809 05:30:15.300377 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:30:15.301641 (+ 1264us) server_negotiation.cc:407] Connection header received
0809 05:30:15.302019 (+ 378us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:30:15.302025 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:30:15.302109 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:30:15.302245 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:30:15.303690 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:30:15.304719 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:30:15.307367 (+ 2648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:30:15.309427 (+ 2060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:30:15.309727 (+ 300us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:30:15.309852 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 05:30:15.310745 (+ 893us) server_negotiation.cc:299] Negotiation successful
0809 05:30:15.311039 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139}
I20260809 05:30:15.312013 13159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:30:15.299525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:44685 (local address 127.26.185.1:51445)
0809 05:30:15.301444 (+ 1919us) negotiation.cc:107] Waiting for socket to connect
0809 05:30:15.301470 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 05:30:15.301810 (+ 340us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:30:15.302260 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:30:15.302266 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:30:15.302295 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:30:15.303486 (+ 1191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:30:15.303502 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:30:15.304979 (+ 1477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:30:15.304985 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:30:15.307173 (+ 2188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:30:15.307189 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:30:15.310133 (+ 2944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:30:15.310142 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:30:15.310455 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:30:15.310550 (+ 95us) client_negotiation.cc:769] Sending connection context
0809 05:30:15.310693 (+ 143us) client_negotiation.cc:240] Negotiation successful
0809 05:30:15.311034 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1696,"mutex_wait_us":1,"spinlock_wait_cycles":82176,"thread_start_us":1240,"threads_started":1}
I20260809 05:30:15.312768 13045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3da8c43fa2e46aa9f1c4ad75d9f91f7" candidate_uuid: "fd4bef8103924007aee60ca4ea1011ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a610e6ae8b8e4096ac5351a487b1092d" is_pre_election: true
I20260809 05:30:15.313488 12856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3da8c43fa2e46aa9f1c4ad75d9f91f7" candidate_uuid: "fd4bef8103924007aee60ca4ea1011ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838ffd66b4014b9998e328028c97a616" is_pre_election: true
I20260809 05:30:15.313779 13045 raft_consensus.cc:2454] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P a610e6ae8b8e4096ac5351a487b1092d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4bef8103924007aee60ca4ea1011ec in term 0.
I20260809 05:30:15.314285 12856 raft_consensus.cc:2454] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P 838ffd66b4014b9998e328028c97a616 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4bef8103924007aee60ca4ea1011ec in term 0.
I20260809 05:30:15.315047 12550 leader_election.cc:302] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a610e6ae8b8e4096ac5351a487b1092d, fd4bef8103924007aee60ca4ea1011ec; no voters:
I20260809 05:30:15.315776 13157 raft_consensus.cc:2781] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:30:15.316043 13157 raft_consensus.cc:482] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:30:15.316200 13157 raft_consensus.cc:3037] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:30:15.319947 13157 raft_consensus.cc:504] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a610e6ae8b8e4096ac5351a487b1092d" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43473 } } peers { permanent_uuid: "838ffd66b4014b9998e328028c97a616" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 44685 } } peers { permanent_uuid: "fd4bef8103924007aee60ca4ea1011ec" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41339 } }
I20260809 05:30:15.321179 13157 leader_election.cc:288] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec [CANDIDATE]: Term 1 election: Requested vote from peers a610e6ae8b8e4096ac5351a487b1092d (127.26.185.3:43473), 838ffd66b4014b9998e328028c97a616 (127.26.185.2:44685)
I20260809 05:30:15.321965 12856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3da8c43fa2e46aa9f1c4ad75d9f91f7" candidate_uuid: "fd4bef8103924007aee60ca4ea1011ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838ffd66b4014b9998e328028c97a616"
I20260809 05:30:15.322083 13045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3da8c43fa2e46aa9f1c4ad75d9f91f7" candidate_uuid: "fd4bef8103924007aee60ca4ea1011ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a610e6ae8b8e4096ac5351a487b1092d"
I20260809 05:30:15.322301 12856 raft_consensus.cc:3037] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P 838ffd66b4014b9998e328028c97a616 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:30:15.322443 13045 raft_consensus.cc:3037] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P a610e6ae8b8e4096ac5351a487b1092d [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:30:15.325747 12856 raft_consensus.cc:2454] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P 838ffd66b4014b9998e328028c97a616 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4bef8103924007aee60ca4ea1011ec in term 1.
I20260809 05:30:15.325982 13045 raft_consensus.cc:2454] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P a610e6ae8b8e4096ac5351a487b1092d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4bef8103924007aee60ca4ea1011ec in term 1.
I20260809 05:30:15.326721 12549 leader_election.cc:302] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 838ffd66b4014b9998e328028c97a616, fd4bef8103924007aee60ca4ea1011ec; no voters:
I20260809 05:30:15.327227 13157 raft_consensus.cc:2781] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:30:15.327991 13157 raft_consensus.cc:686] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec [term 1 LEADER]: Becoming Leader. State: Replica: fd4bef8103924007aee60ca4ea1011ec, State: Running, Role: LEADER
I20260809 05:30:15.328649 13157 consensus_queue.cc:237] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a610e6ae8b8e4096ac5351a487b1092d" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43473 } } peers { permanent_uuid: "838ffd66b4014b9998e328028c97a616" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 44685 } } peers { permanent_uuid: "fd4bef8103924007aee60ca4ea1011ec" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41339 } }
I20260809 05:30:15.336705 12406 catalog_manager.cc:5495] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec reported cstate change: term changed from 0 to 1, leader changed from <none> to fd4bef8103924007aee60ca4ea1011ec (127.26.185.1). New cstate: current_term: 1 leader_uuid: "fd4bef8103924007aee60ca4ea1011ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a610e6ae8b8e4096ac5351a487b1092d" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "838ffd66b4014b9998e328028c97a616" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 44685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd4bef8103924007aee60ca4ea1011ec" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41339 } health_report { overall_health: HEALTHY } } }
I20260809 05:30:15.401525 13146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:30:15.393516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43164 (local address 127.26.185.1:41339)
0809 05:30:15.393859 (+ 343us) server_negotiation.cc:206] Beginning negotiation
0809 05:30:15.393868 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:30:15.393895 (+ 27us) server_negotiation.cc:407] Connection header received
0809 05:30:15.394032 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:30:15.394037 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:30:15.394139 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:30:15.394341 (+ 202us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:30:15.394980 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:30:15.396114 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:30:15.398108 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:30:15.398787 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:30:15.398992 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:30:15.399819 (+ 827us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:30:15.400645 (+ 826us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:30:15.400827 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0809 05:30:15.400996 (+ 169us) server_negotiation.cc:299] Negotiation successful
0809 05:30:15.401096 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 05:30:15.415786 13045 raft_consensus.cc:1261] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P a610e6ae8b8e4096ac5351a487b1092d [term 1 FOLLOWER]: Refusing update from remote peer fd4bef8103924007aee60ca4ea1011ec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:30:15.415787 12856 raft_consensus.cc:1261] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P 838ffd66b4014b9998e328028c97a616 [term 1 FOLLOWER]: Refusing update from remote peer fd4bef8103924007aee60ca4ea1011ec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:30:15.417611 13157 consensus_queue.cc:1035] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a610e6ae8b8e4096ac5351a487b1092d" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:30:15.418231 13161 consensus_queue.cc:1035] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "838ffd66b4014b9998e328028c97a616" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 44685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:30:15.438788 13167 mvcc.cc:205] Tried to move back new op lower bound from 7316493989524873216 to 7316493989191782400. Current Snapshot: MvccSnapshot[applied={T|T < 7316493989524873216}]
I20260809 05:30:15.465122 12409 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42088:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:30:15.465564 12409 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42088:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:30:15.471071 12409 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bf7b4a454ade44578fafa62d29ec5694: Sending DeleteTablet for 3 replicas of tablet d3da8c43fa2e46aa9f1c4ad75d9f91f7
I20260809 05:30:15.473024 12827 tablet_service.cc:1514] Processing DeleteTablet for tablet d3da8c43fa2e46aa9f1c4ad75d9f91f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:30:15 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:56472
I20260809 05:30:15.473017 13020 tablet_service.cc:1514] Processing DeleteTablet for tablet d3da8c43fa2e46aa9f1c4ad75d9f91f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:30:15 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:33384
I20260809 05:30:15.473287 12613 tablet_service.cc:1514] Processing DeleteTablet for tablet d3da8c43fa2e46aa9f1c4ad75d9f91f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:30:15 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:43158
I20260809 05:30:15.477568 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 12521
I20260809 05:30:15.488595 13177 tablet_replica.cc:330] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P a610e6ae8b8e4096ac5351a487b1092d: stopping tablet replica
I20260809 05:30:15.489267 13180 tablet_replica.cc:330] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec: stopping tablet replica
I20260809 05:30:15.489396 13177 raft_consensus.cc:2229] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P a610e6ae8b8e4096ac5351a487b1092d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:30:15.490054 13180 raft_consensus.cc:2229] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec [term 1 LEADER]: Raft consensus shutting down.
I20260809 05:30:15.490213 13177 raft_consensus.cc:2258] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P a610e6ae8b8e4096ac5351a487b1092d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:30:15.491285 13180 raft_consensus.cc:2258] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:30:15.491317 13176 tablet_replica.cc:330] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P 838ffd66b4014b9998e328028c97a616: stopping tablet replica
I20260809 05:30:15.492825 13176 raft_consensus.cc:2229] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P 838ffd66b4014b9998e328028c97a616 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:30:15.493579 13176 raft_consensus.cc:2258] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P 838ffd66b4014b9998e328028c97a616 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:30:15.493968 13177 ts_tablet_manager.cc:1905] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P a610e6ae8b8e4096ac5351a487b1092d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:30:15.496587 13176 ts_tablet_manager.cc:1905] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P 838ffd66b4014b9998e328028c97a616: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:30:15.500537 13180 ts_tablet_manager.cc:1905] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:30:15.503923 13177 ts_tablet_manager.cc:1918] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P a610e6ae8b8e4096ac5351a487b1092d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:30:15.504211 13177 log.cc:1196] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P a610e6ae8b8e4096ac5351a487b1092d: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-2/wal/wals/d3da8c43fa2e46aa9f1c4ad75d9f91f7
I20260809 05:30:15.505183 13177 ts_tablet_manager.cc:1939] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P a610e6ae8b8e4096ac5351a487b1092d: Deleting consensus metadata
I20260809 05:30:15.505839 13176 ts_tablet_manager.cc:1918] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P 838ffd66b4014b9998e328028c97a616: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:30:15.506108 13176 log.cc:1196] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P 838ffd66b4014b9998e328028c97a616: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-1/wal/wals/d3da8c43fa2e46aa9f1c4ad75d9f91f7
I20260809 05:30:15.506870 13176 ts_tablet_manager.cc:1939] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P 838ffd66b4014b9998e328028c97a616: Deleting consensus metadata
I20260809 05:30:15.508388 12391 catalog_manager.cc:4841] TS a610e6ae8b8e4096ac5351a487b1092d (127.26.185.3:43473): tablet d3da8c43fa2e46aa9f1c4ad75d9f91f7 (table test-table [id=1a163a6e67784a1480d7fc413614f31a]) successfully deleted
I20260809 05:30:15.509810 12390 catalog_manager.cc:4841] TS 838ffd66b4014b9998e328028c97a616 (127.26.185.2:44685): tablet d3da8c43fa2e46aa9f1c4ad75d9f91f7 (table test-table [id=1a163a6e67784a1480d7fc413614f31a]) successfully deleted
Aug 09 05:30:15 dist-test-slave-h3ft krb5kdc[11729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253409, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.1@KRBTEST.COM
I20260809 05:30:15.518816 13180 ts_tablet_manager.cc:1918] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:30:15.519237 13180 log.cc:1196] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786253234117492-27364-0/minicluster-data/ts-0/wal/wals/d3da8c43fa2e46aa9f1c4ad75d9f91f7
I20260809 05:30:15.520273 13180 ts_tablet_manager.cc:1939] T d3da8c43fa2e46aa9f1c4ad75d9f91f7 P fd4bef8103924007aee60ca4ea1011ec: Deleting consensus metadata
I20260809 05:30:15.523240 13146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:30:15.480018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43168 (local address 127.26.185.1:41339)
0809 05:30:15.480304 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0809 05:30:15.480318 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 05:30:15.487229 (+ 6911us) server_negotiation.cc:407] Connection header received
0809 05:30:15.487568 (+ 339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:30:15.487579 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:30:15.487792 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:30:15.488740 (+ 948us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:30:15.491425 (+ 2685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:30:15.493038 (+ 1613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:30:15.496255 (+ 3217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:30:15.497070 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:30:15.497234 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:30:15.513136 (+ 15902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:30:15.513158 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:30:15.513194 (+ 36us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:30:15.513305 (+ 111us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:30:15.517808 (+ 4503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:30:15.518915 (+ 1107us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:30:15.518948 (+ 33us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:30:15.518951 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:30:15.519424 (+ 473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:30:15.520145 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:30:15.520151 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:30:15.520155 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:30:15.520820 (+ 665us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:30:15.521309 (+ 489us) server_negotiation.cc:1035] Waiting for connection context
0809 05:30:15.522052 (+ 743us) server_negotiation.cc:299] Negotiation successful
0809 05:30:15.522402 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260809 05:30:15.523998 12390 catalog_manager.cc:4841] TS fd4bef8103924007aee60ca4ea1011ec (127.26.185.1:41339): tablet d3da8c43fa2e46aa9f1c4ad75d9f91f7 (table test-table [id=1a163a6e67784a1480d7fc413614f31a]) successfully deleted
I20260809 05:30:15.524696 12712 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:30:15.651995 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 12521
I20260809 05:30:15.688069 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 12726
Aug 09 05:30:15 dist-test-slave-h3ft krb5kdc[11729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253409, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.2@KRBTEST.COM
I20260809 05:30:15.709404 13143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:30:15.689248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56480 (local address 127.26.185.2:44685)
0809 05:30:15.689465 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 05:30:15.689470 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:30:15.689545 (+ 75us) server_negotiation.cc:407] Connection header received
0809 05:30:15.689735 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:30:15.689740 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:30:15.689821 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:30:15.689930 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:30:15.691755 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:30:15.692652 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:30:15.694375 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:30:15.694859 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:30:15.695114 (+ 255us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:30:15.700979 (+ 5865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:30:15.701006 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:30:15.701032 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:30:15.701097 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:30:15.705151 (+ 4054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:30:15.706200 (+ 1049us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:30:15.706210 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:30:15.706213 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:30:15.706420 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:30:15.707136 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:30:15.707140 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:30:15.707143 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:30:15.707689 (+ 546us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:30:15.707997 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0809 05:30:15.708519 (+ 522us) server_negotiation.cc:299] Negotiation successful
0809 05:30:15.708863 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 05:30:15.710500 12915 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:30:15.813841 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 12726
I20260809 05:30:15.849005 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 12931
Aug 09 05:30:15 dist-test-slave-h3ft krb5kdc[11729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253409, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.3@KRBTEST.COM
I20260809 05:30:15.869055 13184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:30:15.850078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33386 (local address 127.26.185.3:43473)
0809 05:30:15.850743 (+ 665us) server_negotiation.cc:206] Beginning negotiation
0809 05:30:15.850748 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:30:15.850770 (+ 22us) server_negotiation.cc:407] Connection header received
0809 05:30:15.850844 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:30:15.850848 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:30:15.850932 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:30:15.851136 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:30:15.852668 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:30:15.853572 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:30:15.855204 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:30:15.855716 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:30:15.855830 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:30:15.861215 (+ 5385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:30:15.861238 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:30:15.861262 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:30:15.861313 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:30:15.865353 (+ 4040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:30:15.866367 (+ 1014us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:30:15.866378 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:30:15.866381 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:30:15.866558 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:30:15.867065 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:30:15.867072 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:30:15.867076 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:30:15.867563 (+ 487us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:30:15.867954 (+ 391us) server_negotiation.cc:1035] Waiting for connection context
0809 05:30:15.868304 (+ 350us) server_negotiation.cc:299] Negotiation successful
0809 05:30:15.868607 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":547,"thread_start_us":391,"threads_started":1}
I20260809 05:30:15.870035 13109 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:30:15.974399 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 12931
I20260809 05:30:16.004281 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 12364
I20260809 05:30:16.005908 12450 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:30:16.140762 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 12364
I20260809 05:30:16.180368 27364 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 05:30:16.531198 27364 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 05:30:16.531638 27364 mini_ranger.cc:66] Stopping Ranger...
I20260809 05:30:16.892102 27364 mini_ranger.cc:68] Stopped Ranger
2026-08-09 05:30:16.892 UTC [11773] LOG: received smart shutdown request
2026-08-09 05:30:16.897 UTC [11773] LOG: background worker "logical replication launcher" (PID 11789) exited with exit code 1
2026-08-09 05:30:16.897 UTC [11783] LOG: shutting down
2026-08-09 05:30:17.104 UTC [11773] LOG: database system is shut down
2026-08-09T05:30:17Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (61395 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:30:17 dist-test-slave-h3ft krb5kdc[13199](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:30:17 dist-test-slave-h3ft krb5kdc[13199](info): set up 2 sockets
Aug 09 05:30:17 dist-test-slave-h3ft krb5kdc[13199](info): commencing operation
krb5kdc: starting...
W20260809 05:30:18.695906 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.388s user 0.003s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:30:18 dist-test-slave-h3ft krb5kdc[13199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253418, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:30:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:30:18Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.26.185.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.26.185.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.26.185.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/rangeradmin_127.26.185.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.26.185.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/rangeradmin_127.26.185.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.26.185.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.26.185.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.26.185.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/rangerlookup_127.26.185.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.26.185.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/rangerlookup_127.26.185.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.185.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.26.185.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.185.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/HTTP_127.26.185.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.185.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/HTTP_127.26.185.20@KRBTEST.COM.keytab.
I20260809 05:30:19.242332 27364 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskaxTOnW/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/postgres -l logfile start
2026-08-09 05:30:22.228 UTC [13248] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 05:30:22.228 UTC [13248] LOG: listening on IPv4 address "127.26.185.20", port 57331
2026-08-09 05:30:22.232 UTC [13248] LOG: listening on Unix socket "/tmp/.s.PGSQL.57331"
2026-08-09 05:30:22.261 UTC [13250] LOG: database system was shut down at 2026-08-09 05:30:20 UTC
2026-08-09 05:30:22.266 UTC [13248] LOG: database system is ready to accept connections
I20260809 05:30:23.490592 27364 mini_postgres.cc:96] Postgres bound to 57331
2026-08-09 05:30:23.520 UTC [13266] FATAL: database "slave" does not exist
127.26.185.20:57331 - accepting connections
I20260809 05:30:23.521579 27364 mini_ranger.cc:161] Starting Ranger...
I20260809 05:30:23.562562 27364 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 05:30:24.160189 27364 mini_ranger.cc:87] Created ranger Postgres database
I20260809 05:30:24.160346 27364 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ranger-admin
2026-08-09 05:30:24,504 [I] DB FLAVOR :POSTGRES
2026-08-09 05:30:24,505 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 05:30:24,505 [I] Checking connection..
2026-08-09 05:30:24,505 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:57331/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 05:30:24,811 [I] Checking connection passed.
2026-08-09 05:30:24,811 [I] --------- Verifying version history table ---------
2026-08-09 05:30:24,811 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:57331/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 05:30:25,126 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 05:30:25,126 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:57331/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 05:30:25,423 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 05:30:25,423 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 05:30:25,423 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:57331/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 05:30:25.703 UTC [13365] WARNING: there is no transaction in progress
2026-08-09 05:30:25,716 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 05:30:25,717 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:57331/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 05:30:26,015 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 05:30:26,015 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 05:30:26,016 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:57331/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 05:30:26,300 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:57331/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 05:30:26,587 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:57331/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-h3ft.c.gcp-upstream.internal','N') ;"
2026-08-09 05:30:26,905 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:57331/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 05:30:27,187 [I] Table x_portal_user does not exist in database ranger
2026-08-09 05:30:27,188 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:57331/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 05:30:27,468 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 05:30:27,468 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:57331/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 05:30:27,765 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:57331/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 05:30:28,050 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 05:30:28,051 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:57331/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 05:30:29.191 UTC [13525] WARNING: there is no transaction in progress
2026-08-09 05:30:29.211 UTC [13525] WARNING: there is no transaction in progress
2026-08-09 05:30:29.231 UTC [13525] WARNING: there is no transaction in progress
2026-08-09 05:30:29.251 UTC [13525] WARNING: there is no transaction in progress
2026-08-09 05:30:29.270 UTC [13525] WARNING: there is no transaction in progress
2026-08-09 05:30:29.293 UTC [13525] WARNING: there is no transaction in progress
2026-08-09 05:30:29.358 UTC [13525] WARNING: there is no transaction in progress
2026-08-09 05:30:29.367 UTC [13525] WARNING: there is no transaction in progress
2026-08-09 05:30:29.383 UTC [13525] WARNING: there is no transaction in progress
2026-08-09 05:30:29.395 UTC [13525] WARNING: there is no transaction in progress
2026-08-09 05:30:29.406 UTC [13525] WARNING: there is no transaction in progress
2026-08-09 05:30:29.422 UTC [13525] WARNING: there is no transaction in progress
2026-08-09 05:30:29.433 UTC [13525] WARNING: there is no transaction in progress
2026-08-09 05:30:29.440 UTC [13525] WARNING: there is no transaction in progress
2026-08-09 05:30:29.449 UTC [13525] WARNING: there is no transaction in progress
2026-08-09 05:30:29.457 UTC [13525] WARNING: there is no transaction in progress
2026-08-09 05:30:30,278 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 05:30:30,279 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:57331/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 05:30:30,560 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 05:30:30,561 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:57331/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 05:30:30,870 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 05:30:30,871 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:57331/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 05:30:31,170 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 05:30:31,171 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:57331/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 05:30:31,475 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:57331/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 05:30:31,780 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:57331/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-h3ft.c.gcp-upstream.internal';"
2026-08-09 05:30:32,060 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 05:30:32,060 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:57331/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 05:30:32,349 [I] DB_PATCHES have already been applied
I20260809 05:30:32.357688 27364 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ranger-admin:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskaxTOnW/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 05:30:32.357816 27364 mini_ranger.cc:193] Using host: 127.26.185.20
I20260809 05:30:32.384958 27364 mini_ranger.cc:227] Ranger admin URL: http://127.26.185.20:45429
Aug 09, 2026 5:30:32 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 5:30:32 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 5:30:32 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 5:30:32 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 5:30:32 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 5:30:33 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 5:30:33 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 05:30:33.857754 27364 mini_ranger.cc:160] Time spent starting Ranger: real 10.336s user 0.000s sys 0.082s
Aug 09, 2026 5:30:57 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 5:30:57 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 09, 2026 5:30:57 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 5:30:57 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 5:30:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 5:30:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 5:30:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 5:30:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 5:30:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 5:30:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 5:30:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 5:30:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 5:30:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 5:30:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 5:30:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 5:30:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 5:30:57 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 5:30:58 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 05:30:59.252457 27364 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.26.185.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.26.185.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.26.185.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/rangerkms_127.26.185.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.26.185.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/rangerkms_127.26.185.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.185.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.26.185.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.185.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/HTTP_127.26.185.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.185.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/HTTP_127.26.185.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 05:30:59 dist-test-slave-h3ft krb5kdc[13199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253459, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 05:30:59.530620 27364 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 05:30:59.569025 27364 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 05:31:00.634094 27364 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 05:31:00.634289 27364 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ranger-kms
I20260809 05:31:00.634351 27364 mini_ranger_kms.cc:227] Using postgres at 127.26.185.20:57331
2026-08-09 05:31:01,101 [I] DB FLAVOR :POSTGRES
2026-08-09 05:31:01,101 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 05:31:01,101 [I] Checking connection
2026-08-09 05:31:01,102 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:57331/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 05:31:01,386 [I] connection success
2026-08-09 05:31:01,387 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 05:31:01,387 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 05:31:01,387 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:57331/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 05:31:01,671 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 05:31:01,672 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 05:31:01,672 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 05:31:01,672 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.185.20:57331/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 05:31:02,004 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 05:31:02.627409 27364 mini_ranger_kms.cc:310] Created kms service
I20260809 05:31:02.857378 27364 mini_ranger_kms.cc:326] Created kudu user
I20260809 05:31:02.913058 27364 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 05:31:02 dist-test-slave-h3ft krb5kdc[13199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253459, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.26.185.20@KRBTEST.COM
I20260809 05:31:03.427271 27364 mini_ranger_kms.cc:384] Added ranger policy
I20260809 05:31:03.427794 27364 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ranger-kms:/tmp/dist-test-taskaxTOnW/build/asan/bin/postgresql.jar:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskaxTOnW/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 05:31:03.427884 27364 mini_ranger_kms.cc:240] Using host: 127.26.185.20
I20260809 05:31:03.459374 27364 mini_ranger_kms.cc:276] Ranger KMS PID: 13777
I20260809 05:31:03.459591 27364 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.26.185.20:48165
Aug 09, 2026 5:31:04 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 5:31:04 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 5:31:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 5:31:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 5:31:05 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 5:31:05 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 05:31:05 dist-test-slave-h3ft krb5kdc[13199](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786253465, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.185.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:31:06.515100 27364 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.984s user 0.066s sys 0.462s
I20260809 05:31:06.515450 27364 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 05:31:06.515651 27364 mini_ranger_kms.cc:401] 127.26.185.20:48165/kms/v1/keys
Aug 09 05:31:06 dist-test-slave-h3ft krb5kdc[13199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253465, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.185.20@KRBTEST.COM for HTTP/127.26.185.20@KRBTEST.COM
Aug 09 05:31:06 dist-test-slave-h3ft krb5kdc[13199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253465, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.185.20@KRBTEST.COM for HTTP/127.26.185.20@KRBTEST.COM
Aug 09 05:31:09 dist-test-slave-h3ft krb5kdc[13199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253469, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
I20260809 05:31:09.868148 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:44613
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:40245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:44613
--ranger_config_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.185.20:48165/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:31:10.310875 13858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:31:10.311373 13858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:31:10.311563 13858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:31:10.319667 13858 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:31:10.319862 13858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:31:10.319989 13858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:31:10.320094 13858 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:31:10.320194 13858 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:31:10.331600 13858 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:40245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/wal
--ranger_kms_url=127.26.185.20:48165/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:44613
--ranger_config_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:44613
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:31:10.333484 13858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:31:10.335338 13858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:31:10.352566 13871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:10.352540 13863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:10.352487 13864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:31:10.352909 13858 server_base.cc:1034] running on GCE node
I20260809 05:31:10.354250 13858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:31:10.356329 13858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:31:10.357569 13858 hybrid_clock.cc:648] HybridClock initialized: now 1786253470357523 us; error 36 us; skew 500 ppm
I20260809 05:31:10.358043 13858 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:31:10 dist-test-slave-h3ft krb5kdc[13199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253470, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:31:10.362211 13858 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:31:10.364194 13858 webserver.cc:460] Webserver started at http://127.26.185.62:37373/ using document root <none> and password file <none>
I20260809 05:31:10.365062 13858 fs_manager.cc:359] Metadata directory not provided
I20260809 05:31:10.365178 13858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:31:10.365584 13858 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 05:31:10 dist-test-slave-h3ft krb5kdc[13199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253470, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for HTTP/127.26.185.20@KRBTEST.COM
I20260809 05:31:10.442950 13858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "64d0703a1e4a4df5b57964b4b991134b"
format_stamp: "Formatted at 2026-08-09 05:31:10 on dist-test-slave-h3ft"
server_key: "67b5c057409c2006c64f68659d77a084"
server_key_iv: "b61355715c37bbe3ce49788f37d01d5c"
server_key_version: "kuduclusterkey@0"
I20260809 05:31:10.444069 13858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "64d0703a1e4a4df5b57964b4b991134b"
format_stamp: "Formatted at 2026-08-09 05:31:10 on dist-test-slave-h3ft"
server_key: "67b5c057409c2006c64f68659d77a084"
server_key_iv: "b61355715c37bbe3ce49788f37d01d5c"
server_key_version: "kuduclusterkey@0"
I20260809 05:31:10.450953 13858 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260809 05:31:10.471552 13881 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:10.473528 13858 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260809 05:31:10.473752 13858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "64d0703a1e4a4df5b57964b4b991134b"
format_stamp: "Formatted at 2026-08-09 05:31:10 on dist-test-slave-h3ft"
server_key: "67b5c057409c2006c64f68659d77a084"
server_key_iv: "b61355715c37bbe3ce49788f37d01d5c"
server_key_version: "kuduclusterkey@0"
I20260809 05:31:10.474046 13858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:31:10.494884 13858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:31:10.500458 13858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:31:10.500874 13858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:31:10.522750 13858 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:44613
I20260809 05:31:10.522771 13952 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:44613 every 8 connection(s)
I20260809 05:31:10.524581 13858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:31:10.529713 13953 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:31:10.530521 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 13858
I20260809 05:31:10.530787 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:31:10.531635 27364 external_mini_cluster.cc:1428] Setting key 4d9fea7d6ab60a2cec65424fb75d8aae
I20260809 05:31:10.546692 13953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b: Bootstrap starting.
Aug 09 05:31:10 dist-test-slave-h3ft krb5kdc[13199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253469, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:31:10.551681 13953 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b: Neither blocks nor log segments found. Creating new log.
I20260809 05:31:10.553128 13953 log.cc:824] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b: Log is configured to *not* fsync() on all Append() calls
I20260809 05:31:10.557776 13953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b: No bootstrap required, opened a new log
I20260809 05:31:10.560058 13957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:10.534137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58256 (local address 127.26.185.62:44613)
0809 05:31:10.535187 (+ 1050us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:10.535202 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:10.535259 (+ 57us) server_negotiation.cc:407] Connection header received
0809 05:31:10.537073 (+ 1814us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:10.537101 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:10.537656 (+ 555us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:10.538064 (+ 408us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:10.540232 (+ 2168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:10.541689 (+ 1457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:10.543885 (+ 2196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:10.544812 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:10.544959 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:10.550677 (+ 5718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:10.550688 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:10.550710 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:10.550759 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:10.554633 (+ 3874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:10.555621 (+ 988us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:10.555632 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:10.555642 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:10.555865 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:10.556300 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:10.556305 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:10.556308 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:10.557135 (+ 827us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:10.557468 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:10.557888 (+ 420us) server_negotiation.cc:299] Negotiation successful
0809 05:31:10.558424 (+ 536us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":741,"thread_start_us":481,"threads_started":1}
I20260809 05:31:10.567572 13953 raft_consensus.cc:348] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d0703a1e4a4df5b57964b4b991134b" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44613 } }
I20260809 05:31:10.568010 13953 raft_consensus.cc:374] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:31:10.568105 13953 raft_consensus.cc:729] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64d0703a1e4a4df5b57964b4b991134b, State: Initialized, Role: FOLLOWER
I20260809 05:31:10.568821 13953 consensus_queue.cc:260] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d0703a1e4a4df5b57964b4b991134b" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44613 } }
I20260809 05:31:10.569155 13953 raft_consensus.cc:388] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:31:10.569324 13953 raft_consensus.cc:482] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:31:10.569523 13953 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:31:10.572198 13953 raft_consensus.cc:504] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d0703a1e4a4df5b57964b4b991134b" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44613 } }
I20260809 05:31:10.572803 13953 leader_election.cc:302] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 64d0703a1e4a4df5b57964b4b991134b; no voters:
I20260809 05:31:10.573529 13953 leader_election.cc:288] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:31:10.573683 13963 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:31:10.574591 13963 raft_consensus.cc:686] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [term 1 LEADER]: Becoming Leader. State: Replica: 64d0703a1e4a4df5b57964b4b991134b, State: Running, Role: LEADER
I20260809 05:31:10.575407 13963 consensus_queue.cc:237] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d0703a1e4a4df5b57964b4b991134b" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44613 } }
I20260809 05:31:10.576242 13953 sys_catalog.cc:564] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:31:10.579469 13964 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "64d0703a1e4a4df5b57964b4b991134b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d0703a1e4a4df5b57964b4b991134b" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44613 } } }
I20260809 05:31:10.579721 13965 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 64d0703a1e4a4df5b57964b4b991134b. Latest consensus state: current_term: 1 leader_uuid: "64d0703a1e4a4df5b57964b4b991134b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d0703a1e4a4df5b57964b4b991134b" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44613 } } }
I20260809 05:31:10.580084 13964 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [sys.catalog]: This master's current role is: LEADER
I20260809 05:31:10.580138 13965 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [sys.catalog]: This master's current role is: LEADER
I20260809 05:31:10.581249 13975 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:31:10.588662 13975 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:31:10.589463 13953 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 05:31:10.614890 13975 catalog_manager.cc:1347] Generated new cluster ID: b4d5caf7643242889c979180e199cdad
I20260809 05:31:10.615119 13975 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:31:10.653236 13975 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:31:10.656203 13975 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:31:10.671926 13975 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b: Generated new TSK 0
I20260809 05:31:10.673589 13975 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.185.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
I20260809 05:31:11.582938 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.185.20:48165/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:0
--local_ip_for_outbound_sockets=127.26.185.1
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:44613
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:40245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 05:31:11 dist-test-slave-h3ft krb5kdc[13199](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786253471, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 05:31:12.111163 14033 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:31:12.111630 14033 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:31:12.111815 14033 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:31:12.120368 14033 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:31:12.120572 14033 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:31:12.120786 14033 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:31:12.132737 14033 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:40245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.26.185.20:48165/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:44613
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:31:12.134886 14033 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:31:12.136678 14033 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:31:12.187397 14047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:12.187446 14051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:12.188130 14045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:31:12.188730 14033 server_base.cc:1034] running on GCE node
I20260809 05:31:12.189580 14033 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:31:12.191169 14033 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:31:12.192694 14033 hybrid_clock.cc:648] HybridClock initialized: now 1786253472192614 us; error 61 us; skew 500 ppm
I20260809 05:31:12.193178 14033 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:31:12 dist-test-slave-h3ft krb5kdc[13199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253472, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:31:12.203540 14033 init.cc:377] Logged in from keytab as kudu/127.26.185.1@KRBTEST.COM (short username kudu)
I20260809 05:31:12.205813 14033 webserver.cc:460] Webserver started at http://127.26.185.1:46767/ using document root <none> and password file <none>
I20260809 05:31:12.206779 14033 fs_manager.cc:359] Metadata directory not provided
I20260809 05:31:12.206934 14033 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:31:12.207386 14033 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 05:31:12 dist-test-slave-h3ft krb5kdc[13199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253472, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for HTTP/127.26.185.20@KRBTEST.COM
I20260809 05:31:12.239291 14033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/data/instance:
uuid: "e58ffd640fc5434b9e31af7a96969a96"
format_stamp: "Formatted at 2026-08-09 05:31:12 on dist-test-slave-h3ft"
server_key: "d27ca41f2705ff9c4bf41bd906d94418"
server_key_iv: "b964ccc1300acb7bc2ebec9677318a37"
server_key_version: "kuduclusterkey@0"
I20260809 05:31:12.240795 14033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance:
uuid: "e58ffd640fc5434b9e31af7a96969a96"
format_stamp: "Formatted at 2026-08-09 05:31:12 on dist-test-slave-h3ft"
server_key: "d27ca41f2705ff9c4bf41bd906d94418"
server_key_iv: "b964ccc1300acb7bc2ebec9677318a37"
server_key_version: "kuduclusterkey@0"
I20260809 05:31:12.253412 14033 fs_manager.cc:691] Time spent creating directory manager: real 0.012s user 0.010s sys 0.001s
I20260809 05:31:12.283865 14061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:12.286592 14033 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.002s
I20260809 05:31:12.287046 14033 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "e58ffd640fc5434b9e31af7a96969a96"
format_stamp: "Formatted at 2026-08-09 05:31:12 on dist-test-slave-h3ft"
server_key: "d27ca41f2705ff9c4bf41bd906d94418"
server_key_iv: "b964ccc1300acb7bc2ebec9677318a37"
server_key_version: "kuduclusterkey@0"
I20260809 05:31:12.287576 14033 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:31:12.314870 14033 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:31:12.321691 14033 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:31:12.322144 14033 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:31:12.324710 14033 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:31:12.327653 14033 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:31:12.327862 14033 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260809 05:31:12.328083 14033 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:31:12.328197 14033 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:12.460031 14033 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:34115
I20260809 05:31:12.460085 14239 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:34115 every 8 connection(s)
Aug 09 05:31:12 dist-test-slave-h3ft krb5kdc[13199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253471, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for HTTP/127.26.185.20@KRBTEST.COM
I20260809 05:31:12.462455 14033 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:31:12.464123 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 14033
I20260809 05:31:12.464360 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance
I20260809 05:31:12.465284 27364 external_mini_cluster.cc:1428] Setting key f8568e350d2fd5b661de31f32cf36e32
Aug 09 05:31:12 dist-test-slave-h3ft krb5kdc[13199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253472, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:31:12.524525 14243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:12.481798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44613 (local address 127.26.185.1:52179)
0809 05:31:12.483096 (+ 1298us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:12.483162 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:12.486562 (+ 3400us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:12.488344 (+ 1782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:12.488363 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:12.489281 (+ 918us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:31:12.490395 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:12.490430 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:12.498123 (+ 7693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:12.498133 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:12.500805 (+ 2672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:12.500836 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:12.502559 (+ 1723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:12.502570 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:12.502988 (+ 418us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:12.504109 (+ 1121us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:31:12.504152 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:31:12.507892 (+ 3740us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:31:12.516525 (+ 8633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:12.516541 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:12.516572 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:12.517393 (+ 821us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:12.519570 (+ 2177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:12.519576 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:12.519580 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:12.519964 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:12.520825 (+ 861us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:31:12.520836 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:31:12.521473 (+ 637us) client_negotiation.cc:769] Sending connection context
0809 05:31:12.521850 (+ 377us) client_negotiation.cc:240] Negotiation successful
0809 05:31:12.522681 (+ 831us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":818,"thread_start_us":943,"threads_started":1}
WARNING: no policy specified for kudu/127.26.185.2@KRBTEST.COM; defaulting to no policy
I20260809 05:31:12.527060 14244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:12.482732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:52179 (local address 127.26.185.62:44613)
0809 05:31:12.487530 (+ 4798us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:12.487537 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:12.487564 (+ 27us) server_negotiation.cc:407] Connection header received
0809 05:31:12.487653 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:12.487659 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:12.487778 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:12.487919 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:12.490702 (+ 2783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:12.497839 (+ 7137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:12.501088 (+ 3249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:12.501956 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:12.502120 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:12.508297 (+ 6177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:12.508308 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:12.508315 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:12.508391 (+ 76us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:12.516236 (+ 7845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:12.519151 (+ 2915us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:12.519159 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:12.519163 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:12.519393 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:12.520130 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:12.520136 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:12.520140 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:12.520573 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:12.520725 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:12.526271 (+ 5546us) server_negotiation.cc:299] Negotiation successful
0809 05:31:12.526589 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4581,"thread_start_us":4434,"threads_started":1}
I20260809 05:31:12.530773 14241 heartbeater.cc:347] Connected to a master server at 127.26.185.62:44613
I20260809 05:31:12.531224 14241 heartbeater.cc:464] Registering TS with master...
I20260809 05:31:12.532374 14241 heartbeater.cc:511] Master 127.26.185.62:44613 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.2@KRBTEST.COM" created.
I20260809 05:31:12.535755 13906 ts_manager.cc:194] Registered new tserver with Master: e58ffd640fc5434b9e31af7a96969a96 (127.26.185.1:34115)
I20260809 05:31:12.538395 13906 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.1@KRBTEST.COM'} at 127.26.185.1:52179
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
W20260809 05:31:12.589960 27364 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.26.185.2: real 0.117s user 0.000s sys 0.034s
I20260809 05:31:12.591179 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.185.20:48165/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:0
--local_ip_for_outbound_sockets=127.26.185.2
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:44613
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:40245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 05:31:12 dist-test-slave-h3ft krb5kdc[13199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253471, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for HTTP/127.26.185.20@KRBTEST.COM
W20260809 05:31:13.195182 14247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:31:13.195858 14247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:31:13.196096 14247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:31:13.209039 14247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:31:13.209407 14247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:31:13.209695 14247 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:31:13.226230 14247 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:40245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.26.185.20:48165/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:44613
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:31:13.229110 14247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:31:13.231482 14247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:31:13.290387 14257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:13.293563 14255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:31:13.302634 14247 server_base.cc:1034] running on GCE node
W20260809 05:31:13.303366 14263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:31:13.304549 14247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:31:13.318451 14247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:31:13.322044 14247 hybrid_clock.cc:648] HybridClock initialized: now 1786253473321865 us; error 173 us; skew 500 ppm
I20260809 05:31:13.322676 14247 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:31:13 dist-test-slave-h3ft krb5kdc[13199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253473, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:31:13.327484 14247 init.cc:377] Logged in from keytab as kudu/127.26.185.2@KRBTEST.COM (short username kudu)
I20260809 05:31:13.335507 14247 webserver.cc:460] Webserver started at http://127.26.185.2:46597/ using document root <none> and password file <none>
I20260809 05:31:13.336587 14247 fs_manager.cc:359] Metadata directory not provided
I20260809 05:31:13.336776 14247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:31:13.337206 14247 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 05:31:13 dist-test-slave-h3ft krb5kdc[13199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253473, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for HTTP/127.26.185.20@KRBTEST.COM
I20260809 05:31:13.364594 14247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/data/instance:
uuid: "8f807825f6f74a0fb0129c39f4140de2"
format_stamp: "Formatted at 2026-08-09 05:31:13 on dist-test-slave-h3ft"
server_key: "189743a1309dc1d438447bbf758082b8"
server_key_iv: "9490b4c836a2e30e619665e8d82574d1"
server_key_version: "kuduclusterkey@0"
I20260809 05:31:13.371028 14247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance:
uuid: "8f807825f6f74a0fb0129c39f4140de2"
format_stamp: "Formatted at 2026-08-09 05:31:13 on dist-test-slave-h3ft"
server_key: "189743a1309dc1d438447bbf758082b8"
server_key_iv: "9490b4c836a2e30e619665e8d82574d1"
server_key_version: "kuduclusterkey@0"
I20260809 05:31:13.381860 14247 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.008s sys 0.000s
I20260809 05:31:13.424933 14282 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:13.428148 14247 fs_manager.cc:725] Time spent opening block manager: real 0.022s user 0.010s sys 0.002s
I20260809 05:31:13.428638 14247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "8f807825f6f74a0fb0129c39f4140de2"
format_stamp: "Formatted at 2026-08-09 05:31:13 on dist-test-slave-h3ft"
server_key: "189743a1309dc1d438447bbf758082b8"
server_key_iv: "9490b4c836a2e30e619665e8d82574d1"
server_key_version: "kuduclusterkey@0"
I20260809 05:31:13.429160 14247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:31:13.488802 14247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:31:13.496094 14247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:31:13.496658 14247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:31:13.504967 14247 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:31:13.514241 14247 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:31:13.514532 14247 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260809 05:31:13.514776 14247 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:31:13.514899 14247 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:13.543913 14241 heartbeater.cc:503] Master 127.26.185.62:44613 was elected leader, sending a full tablet report...
I20260809 05:31:13.754846 14247 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:36439
I20260809 05:31:13.754875 14442 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:36439 every 8 connection(s)
I20260809 05:31:13.756968 14247 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:31:13.760269 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 14247
I20260809 05:31:13.760563 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance
I20260809 05:31:13.761502 27364 external_mini_cluster.cc:1428] Setting key 32bd698b1ab7ebfe126e51955faaa892
Aug 09 05:31:13 dist-test-slave-h3ft krb5kdc[13199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253473, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.185.3@KRBTEST.COM; defaulting to no policy
I20260809 05:31:13.812568 14448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:13.770610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:49887 (local address 127.26.185.62:44613)
0809 05:31:13.783088 (+ 12478us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:13.783097 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:13.786363 (+ 3266us) server_negotiation.cc:407] Connection header received
0809 05:31:13.788068 (+ 1705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:13.788078 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:13.788210 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:13.788317 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:13.791457 (+ 3140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:13.792762 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:13.795736 (+ 2974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:13.796479 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:13.796618 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:13.802719 (+ 6101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:13.802729 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:13.802736 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:13.802806 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:13.807337 (+ 4531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:13.808735 (+ 1398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:13.808744 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:13.808749 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:13.808972 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:13.809688 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:13.809694 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:13.809698 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:13.810180 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:13.810345 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:13.811692 (+ 1347us) server_negotiation.cc:299] Negotiation successful
0809 05:31:13.812048 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12237,"thread_start_us":12006,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.3@KRBTEST.COM" created.
I20260809 05:31:13.816005 14447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:13.769654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44613 (local address 127.26.185.2:49887)
0809 05:31:13.784089 (+ 14435us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:13.784198 (+ 109us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:13.787536 (+ 3338us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:13.789163 (+ 1627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:13.789180 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:13.790032 (+ 852us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:31:13.791160 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:13.791196 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:13.793057 (+ 1861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:13.793062 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:13.795496 (+ 2434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:13.795531 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:13.797122 (+ 1591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:13.797130 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:13.797514 (+ 384us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:13.798648 (+ 1134us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:31:13.798697 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:31:13.802286 (+ 3589us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:31:13.807683 (+ 5397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:13.807696 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:13.807725 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:13.808538 (+ 813us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:13.809167 (+ 629us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:13.809172 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:13.809175 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:13.809524 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:13.810466 (+ 942us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:31:13.810477 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:31:13.811134 (+ 657us) client_negotiation.cc:769] Sending connection context
0809 05:31:13.813047 (+ 1913us) client_negotiation.cc:240] Negotiation successful
0809 05:31:13.813897 (+ 850us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13902,"thread_start_us":13534,"threads_started":1}
I20260809 05:31:13.822171 14443 heartbeater.cc:347] Connected to a master server at 127.26.185.62:44613
I20260809 05:31:13.822713 14443 heartbeater.cc:464] Registering TS with master...
I20260809 05:31:13.824236 14443 heartbeater.cc:511] Master 127.26.185.62:44613 requested a full tablet report, sending...
I20260809 05:31:13.826963 13906 ts_manager.cc:194] Registered new tserver with Master: 8f807825f6f74a0fb0129c39f4140de2 (127.26.185.2:36439)
I20260809 05:31:13.828341 13906 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.2@KRBTEST.COM'} at 127.26.185.2:49887
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
W20260809 05:31:13.870539 27364 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.26.185.3: real 0.104s user 0.000s sys 0.033s
I20260809 05:31:13.871814 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.185.20:48165/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:0
--local_ip_for_outbound_sockets=127.26.185.3
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:44613
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:40245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:31:14.312966 14451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:31:14.313349 14451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:31:14.313536 14451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:31:14.321520 14451 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:31:14.321704 14451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:31:14.321959 14451 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:31:14.333140 14451 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:40245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.26.185.20:48165/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:44613
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:31:14.335096 14451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:31:14.336980 14451 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:31:14.352501 14462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:14.352540 14464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:14.352587 14468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:31:14.353438 14451 server_base.cc:1034] running on GCE node
I20260809 05:31:14.354261 14451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:31:14.355634 14451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:31:14.356880 14451 hybrid_clock.cc:648] HybridClock initialized: now 1786253474356822 us; error 60 us; skew 500 ppm
I20260809 05:31:14.357317 14451 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:31:14 dist-test-slave-h3ft krb5kdc[13199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253474, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:31:14.361537 14451 init.cc:377] Logged in from keytab as kudu/127.26.185.3@KRBTEST.COM (short username kudu)
I20260809 05:31:14.363453 14451 webserver.cc:460] Webserver started at http://127.26.185.3:35961/ using document root <none> and password file <none>
I20260809 05:31:14.364471 14451 fs_manager.cc:359] Metadata directory not provided
I20260809 05:31:14.364631 14451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:31:14.365036 14451 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 05:31:14 dist-test-slave-h3ft krb5kdc[13199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253474, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for HTTP/127.26.185.20@KRBTEST.COM
I20260809 05:31:14.387701 14451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/data/instance:
uuid: "415cf69726d741deb3c5585982fdf334"
format_stamp: "Formatted at 2026-08-09 05:31:14 on dist-test-slave-h3ft"
server_key: "942c9d70a561cd1bf39f3eb8b7ab3e1c"
server_key_iv: "1c412338a2a46ad1e74ffdb1bb1784a8"
server_key_version: "kuduclusterkey@0"
I20260809 05:31:14.388979 14451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance:
uuid: "415cf69726d741deb3c5585982fdf334"
format_stamp: "Formatted at 2026-08-09 05:31:14 on dist-test-slave-h3ft"
server_key: "942c9d70a561cd1bf39f3eb8b7ab3e1c"
server_key_iv: "1c412338a2a46ad1e74ffdb1bb1784a8"
server_key_version: "kuduclusterkey@0"
I20260809 05:31:14.397486 14451 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.008s sys 0.000s
I20260809 05:31:14.418864 14477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:14.420846 14451 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260809 05:31:14.421108 14451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "415cf69726d741deb3c5585982fdf334"
format_stamp: "Formatted at 2026-08-09 05:31:14 on dist-test-slave-h3ft"
server_key: "942c9d70a561cd1bf39f3eb8b7ab3e1c"
server_key_iv: "1c412338a2a46ad1e74ffdb1bb1784a8"
server_key_version: "kuduclusterkey@0"
I20260809 05:31:14.421417 14451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:31:14.447160 14451 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:31:14.452214 14451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:31:14.452675 14451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:31:14.453919 14451 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:31:14.455735 14451 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:31:14.455858 14451 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:14.456029 14451 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:31:14.456108 14451 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:14.496660 14451 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:43439
I20260809 05:31:14.496698 14639 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:43439 every 8 connection(s)
I20260809 05:31:14.498383 14451 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:31:14.508440 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 14451
I20260809 05:31:14.508694 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance
I20260809 05:31:14.509390 27364 external_mini_cluster.cc:1428] Setting key be06b75a8f4be731d9b514929d811436
Aug 09 05:31:14 dist-test-slave-h3ft krb5kdc[13199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253474, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:31:14.523896 14646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:14.501948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:54901 (local address 127.26.185.62:44613)
0809 05:31:14.502596 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:14.502603 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:14.503952 (+ 1349us) server_negotiation.cc:407] Connection header received
0809 05:31:14.505995 (+ 2043us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:14.506000 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:14.506087 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:14.506207 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:14.508088 (+ 1881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:14.509105 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:14.511254 (+ 2149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:14.511779 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:14.511936 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:14.516471 (+ 4535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:14.516478 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:14.516482 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:14.516525 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:14.519843 (+ 3318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:14.520910 (+ 1067us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:14.520922 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:14.520925 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:14.521100 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:14.521622 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:14.521626 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:14.521628 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:14.521981 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:14.522123 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:14.523185 (+ 1062us) server_negotiation.cc:299] Negotiation successful
0809 05:31:14.523506 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":496,"thread_start_us":276,"threads_started":1}
I20260809 05:31:14.525472 14647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:14.502826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44613 (local address 127.26.185.3:54901)
0809 05:31:14.503749 (+ 923us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:14.503796 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:14.505679 (+ 1883us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:14.506488 (+ 809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:14.506500 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:14.507120 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:31:14.507852 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:14.507871 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:14.509288 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:14.509294 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:14.511083 (+ 1789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:14.511109 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:14.512074 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:14.512082 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:14.512364 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:14.513229 (+ 865us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:31:14.513263 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:31:14.516160 (+ 2897us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:31:14.520028 (+ 3868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:14.520039 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:14.520060 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:14.520664 (+ 604us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:14.521215 (+ 551us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:14.521219 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:14.521221 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:14.521479 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:14.522108 (+ 629us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:31:14.522116 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:31:14.522684 (+ 568us) client_negotiation.cc:769] Sending connection context
0809 05:31:14.523075 (+ 391us) client_negotiation.cc:240] Negotiation successful
0809 05:31:14.523618 (+ 543us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":638,"thread_start_us":397,"threads_started":1}
I20260809 05:31:14.527527 14641 heartbeater.cc:347] Connected to a master server at 127.26.185.62:44613
I20260809 05:31:14.527921 14641 heartbeater.cc:464] Registering TS with master...
I20260809 05:31:14.528846 14641 heartbeater.cc:511] Master 127.26.185.62:44613 requested a full tablet report, sending...
I20260809 05:31:14.530754 13905 ts_manager.cc:194] Registered new tserver with Master: 415cf69726d741deb3c5585982fdf334 (127.26.185.3:43439)
I20260809 05:31:14.532068 13905 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.3@KRBTEST.COM'} at 127.26.185.3:54901
I20260809 05:31:14.539788 27364 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 05:31:14.541772 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 14033
Aug 09 05:31:14 dist-test-slave-h3ft krb5kdc[13199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253469, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.1@KRBTEST.COM
I20260809 05:31:14.562151 14650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:14.542968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50530 (local address 127.26.185.1:34115)
0809 05:31:14.543692 (+ 724us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:14.543700 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:14.543734 (+ 34us) server_negotiation.cc:407] Connection header received
0809 05:31:14.543816 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:14.543825 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:14.544152 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:14.544329 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:14.546128 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:14.547350 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:14.549141 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:14.549932 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:14.550093 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:14.555261 (+ 5168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:14.555275 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:14.555297 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:14.555341 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:14.558691 (+ 3350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:14.559619 (+ 928us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:14.559628 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:14.559631 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:14.559805 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:14.560246 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:14.560251 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:14.560253 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:14.560679 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:14.561067 (+ 388us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:14.561398 (+ 331us) server_negotiation.cc:299] Negotiation successful
0809 05:31:14.561729 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":349,"threads_started":1}
I20260809 05:31:14.563947 14231 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:31:14.656859 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 14033
I20260809 05:31:14.691521 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 14247
Aug 09 05:31:14 dist-test-slave-h3ft krb5kdc[13199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253469, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.2@KRBTEST.COM
I20260809 05:31:14.711679 14653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:14.692893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35744 (local address 127.26.185.2:36439)
0809 05:31:14.693671 (+ 778us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:14.693681 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:14.693714 (+ 33us) server_negotiation.cc:407] Connection header received
0809 05:31:14.693799 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:14.693807 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:14.694121 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:14.694336 (+ 215us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:14.695976 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:14.697116 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:14.698662 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:14.699415 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:14.699568 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:14.704866 (+ 5298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:14.704883 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:14.704905 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:14.704951 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:14.708442 (+ 3491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:14.709301 (+ 859us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:14.709311 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:14.709313 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:14.709484 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:14.709878 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:14.709882 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:14.709884 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:14.710372 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:14.710675 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:14.710958 (+ 283us) server_negotiation.cc:299] Negotiation successful
0809 05:31:14.711310 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":587,"thread_start_us":474,"threads_started":1}
I20260809 05:31:14.713410 14432 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:31:14.806501 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 14247
I20260809 05:31:14.833142 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 14451
Aug 09 05:31:14 dist-test-slave-h3ft krb5kdc[13199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253469, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.3@KRBTEST.COM
I20260809 05:31:14.856812 14657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:14.834483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37150 (local address 127.26.185.3:43439)
0809 05:31:14.835355 (+ 872us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:14.835364 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:14.835402 (+ 38us) server_negotiation.cc:407] Connection header received
0809 05:31:14.835504 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:14.835512 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:14.835812 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:14.835977 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:14.837559 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:14.838767 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:14.840483 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:14.841163 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:14.841276 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:14.848412 (+ 7136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:14.848434 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:14.848462 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:14.848537 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:14.853162 (+ 4625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:14.854110 (+ 948us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:14.854121 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:14.854125 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:14.854285 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:14.854710 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:14.854715 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:14.854718 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:14.855252 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:14.855653 (+ 401us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:14.856029 (+ 376us) server_negotiation.cc:299] Negotiation successful
0809 05:31:14.856361 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":690,"thread_start_us":429,"threads_started":1}
I20260809 05:31:14.858501 14634 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:31:14.953622 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 14451
I20260809 05:31:14.985529 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 13858
I20260809 05:31:14.987313 13948 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:31:15.114037 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 13858
I20260809 05:31:15.154762 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:44613
--webserver_interface=127.26.185.62
--webserver_port=37373
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:40245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:44613
--ranger_config_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.185.20:48165/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.185.20:48165/kms with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:31:15.571277 14662 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:31:15.571671 14662 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:31:15.571835 14662 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:31:15.580024 14662 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:31:15.580173 14662 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:31:15.580287 14662 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:31:15.580395 14662 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:31:15.580497 14662 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:31:15.592823 14662 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:40245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.185.20:48165/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:44613
--ranger_config_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:44613
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=37373
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:31:15.594707 14662 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:31:15.596503 14662 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:31:15.611105 14674 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:15.611263 14675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:15.611418 14678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:31:15.612471 14662 server_base.cc:1034] running on GCE node
I20260809 05:31:15.613617 14662 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:31:15.615661 14662 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:31:15.616932 14662 hybrid_clock.cc:648] HybridClock initialized: now 1786253475616872 us; error 88 us; skew 500 ppm
I20260809 05:31:15.617413 14662 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:31:15 dist-test-slave-h3ft krb5kdc[13199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253475, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:31:15.621341 14662 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:31:15.623389 14662 webserver.cc:460] Webserver started at http://127.26.185.62:37373/ using document root <none> and password file <none>
I20260809 05:31:15.624250 14662 fs_manager.cc:359] Metadata directory not provided
I20260809 05:31:15.624428 14662 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 05:31:15 dist-test-slave-h3ft krb5kdc[13199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253475, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for HTTP/127.26.185.20@KRBTEST.COM
I20260809 05:31:15.712842 14662 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.001s
I20260809 05:31:15.717098 14689 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:15.719310 14662 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260809 05:31:15.719609 14662 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "64d0703a1e4a4df5b57964b4b991134b"
format_stamp: "Formatted at 2026-08-09 05:31:10 on dist-test-slave-h3ft"
server_key: "67b5c057409c2006c64f68659d77a084"
server_key_iv: "b61355715c37bbe3ce49788f37d01d5c"
server_key_version: "kuduclusterkey@0"
I20260809 05:31:15.720898 14662 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:31:15.741976 14662 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:31:15.747146 14662 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:31:15.747486 14662 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:31:15.770277 14662 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:44613
I20260809 05:31:15.770318 14755 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:44613 every 8 connection(s)
I20260809 05:31:15.772320 14662 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:31:15.773545 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 14662
I20260809 05:31:15.774595 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.185.20:48165/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:34115
--local_ip_for_outbound_sockets=127.26.185.1
--tserver_master_addrs=127.26.185.62:44613
--webserver_port=46767
--webserver_interface=127.26.185.1
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:40245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.185.20:48165/kms with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:31:15.781448 14758 sys_catalog.cc:263] Verifying existing consensus state
I20260809 05:31:15.785511 14758 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b: Bootstrap starting.
I20260809 05:31:15.808782 14758 log.cc:824] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b: Log is configured to *not* fsync() on all Append() calls
I20260809 05:31:15.820331 14758 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 05:31:15.821039 14758 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b: Bootstrap complete.
I20260809 05:31:15.832111 14758 raft_consensus.cc:348] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d0703a1e4a4df5b57964b4b991134b" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44613 } }
I20260809 05:31:15.833177 14758 raft_consensus.cc:729] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64d0703a1e4a4df5b57964b4b991134b, State: Initialized, Role: FOLLOWER
I20260809 05:31:15.834031 14758 consensus_queue.cc:260] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d0703a1e4a4df5b57964b4b991134b" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44613 } }
I20260809 05:31:15.834301 14758 raft_consensus.cc:388] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:31:15.834445 14758 raft_consensus.cc:482] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:31:15.834664 14758 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [term 1 FOLLOWER]: Advancing to term 2
I20260809 05:31:15.839398 14758 raft_consensus.cc:504] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d0703a1e4a4df5b57964b4b991134b" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44613 } }
I20260809 05:31:15.840009 14758 leader_election.cc:302] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 64d0703a1e4a4df5b57964b4b991134b; no voters:
I20260809 05:31:15.840771 14758 leader_election.cc:288] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 05:31:15.840945 14763 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [term 2 FOLLOWER]: Leader election won for term 2
I20260809 05:31:15.842942 14763 raft_consensus.cc:686] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [term 2 LEADER]: Becoming Leader. State: Replica: 64d0703a1e4a4df5b57964b4b991134b, State: Running, Role: LEADER
I20260809 05:31:15.843611 14758 sys_catalog.cc:564] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:31:15.843708 14763 consensus_queue.cc:237] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d0703a1e4a4df5b57964b4b991134b" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44613 } }
I20260809 05:31:15.848248 14764 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "64d0703a1e4a4df5b57964b4b991134b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d0703a1e4a4df5b57964b4b991134b" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44613 } } }
I20260809 05:31:15.848778 14764 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [sys.catalog]: This master's current role is: LEADER
I20260809 05:31:15.849359 14766 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 64d0703a1e4a4df5b57964b4b991134b. Latest consensus state: current_term: 2 leader_uuid: "64d0703a1e4a4df5b57964b4b991134b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d0703a1e4a4df5b57964b4b991134b" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44613 } } }
I20260809 05:31:15.849721 14766 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b [sys.catalog]: This master's current role is: LEADER
I20260809 05:31:15.861477 14775 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:31:15.868691 14775 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:31:15.869724 14758 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 05:31:15.870550 14775 catalog_manager.cc:1259] Loaded cluster ID: b4d5caf7643242889c979180e199cdad
I20260809 05:31:15.870760 14775 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:31:15.875547 14775 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:31:15.877337 14775 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b: Loaded TSK: 0
I20260809 05:31:15.879293 14775 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 05:31:16.372792 14760 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:31:16.373606 14760 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:31:16.373927 14760 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:31:16.386924 14760 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:31:16.388543 14760 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:31:16.388962 14760 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:31:16.407068 14760 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:40245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.185.20:48165/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:34115
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=46767
--tserver_master_addrs=127.26.185.62:44613
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:31:16.409165 14760 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:31:16.410913 14760 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:31:16.434726 14817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:16.435175 14820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:16.435628 14813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:31:16.436172 14760 server_base.cc:1034] running on GCE node
I20260809 05:31:16.437103 14760 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:31:16.443518 14760 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:31:16.451207 14760 hybrid_clock.cc:648] HybridClock initialized: now 1786253476451081 us; error 114 us; skew 500 ppm
I20260809 05:31:16.451895 14760 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:31:16 dist-test-slave-h3ft krb5kdc[13199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253476, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:31:16.457508 14760 init.cc:377] Logged in from keytab as kudu/127.26.185.1@KRBTEST.COM (short username kudu)
I20260809 05:31:16.472994 14760 webserver.cc:460] Webserver started at http://127.26.185.1:46767/ using document root <none> and password file <none>
I20260809 05:31:16.474040 14760 fs_manager.cc:359] Metadata directory not provided
I20260809 05:31:16.474261 14760 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 05:31:16 dist-test-slave-h3ft krb5kdc[13199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253476, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for HTTP/127.26.185.20@KRBTEST.COM
I20260809 05:31:16.511510 14760 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.006s sys 0.001s
I20260809 05:31:16.515390 14830 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:16.517385 14760 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 05:31:16.517639 14760 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "e58ffd640fc5434b9e31af7a96969a96"
format_stamp: "Formatted at 2026-08-09 05:31:12 on dist-test-slave-h3ft"
server_key: "d27ca41f2705ff9c4bf41bd906d94418"
server_key_iv: "b964ccc1300acb7bc2ebec9677318a37"
server_key_version: "kuduclusterkey@0"
I20260809 05:31:16.519181 14760 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:31:16.537550 14760 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:31:16.544291 14760 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:31:16.544757 14760 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:31:16.555675 14760 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:31:16.558230 14760 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:31:16.558393 14760 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:16.558532 14760 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:31:16.558619 14760 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:16.628368 14760 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:34115
I20260809 05:31:16.628408 14987 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:34115 every 8 connection(s)
I20260809 05:31:16.630442 14760 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:31:16.639385 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 14760
I20260809 05:31:16.640311 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.185.20:48165/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:36439
--local_ip_for_outbound_sockets=127.26.185.2
--tserver_master_addrs=127.26.185.62:44613
--webserver_port=46597
--webserver_interface=127.26.185.2
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:40245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.185.20:48165/kms with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 05:31:16 dist-test-slave-h3ft krb5kdc[13199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253476, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:31:16.668355 14991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:16.635103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44613 (local address 127.26.185.1:48069)
0809 05:31:16.636092 (+ 989us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:16.636161 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:16.638307 (+ 2146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:16.642929 (+ 4622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:16.642944 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:16.643864 (+ 920us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:31:16.644869 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:16.644900 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:16.647656 (+ 2756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:16.647666 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:16.650045 (+ 2379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:16.650069 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:16.652380 (+ 2311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:16.652391 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:16.652750 (+ 359us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:16.653747 (+ 997us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:31:16.653790 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:31:16.657243 (+ 3453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:31:16.662752 (+ 5509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:16.662764 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:16.662793 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:16.663431 (+ 638us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:16.663997 (+ 566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:16.664002 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:16.664006 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:16.664255 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:16.665378 (+ 1123us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:31:16.665385 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:31:16.665777 (+ 392us) client_negotiation.cc:769] Sending connection context
0809 05:31:16.666041 (+ 264us) client_negotiation.cc:240] Negotiation successful
0809 05:31:16.666585 (+ 544us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"thread_start_us":391,"threads_started":1}
I20260809 05:31:16.669561 14995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:16.635035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:48069 (local address 127.26.185.62:44613)
0809 05:31:16.637139 (+ 2104us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:16.637159 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:16.637228 (+ 69us) server_negotiation.cc:407] Connection header received
0809 05:31:16.640731 (+ 3503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:16.640763 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:16.641428 (+ 665us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:16.641999 (+ 571us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:16.645132 (+ 3133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:16.647384 (+ 2252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:16.650297 (+ 2913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:16.651587 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:16.651816 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:16.657690 (+ 5874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:16.657703 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:16.657729 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:16.657791 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:16.662530 (+ 4739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:16.663631 (+ 1101us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:16.663640 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:16.663648 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:16.663826 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:16.664404 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:16.664408 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:16.664410 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:16.665168 (+ 758us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:16.667250 (+ 2082us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:16.667580 (+ 330us) server_negotiation.cc:299] Negotiation successful
0809 05:31:16.668096 (+ 516us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1784,"thread_start_us":1472,"threads_started":1}
I20260809 05:31:16.674358 14989 heartbeater.cc:347] Connected to a master server at 127.26.185.62:44613
I20260809 05:31:16.674804 14989 heartbeater.cc:464] Registering TS with master...
I20260809 05:31:16.675832 14989 heartbeater.cc:511] Master 127.26.185.62:44613 requested a full tablet report, sending...
W20260809 05:31:16.680619 14989 heartbeater.cc:644] Failed to heartbeat to 127.26.185.62:44613 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 05:31:16.681183 14989 heartbeater.cc:464] Registering TS with master...
I20260809 05:31:16.681907 14989 heartbeater.cc:511] Master 127.26.185.62:44613 requested a full tablet report, sending...
I20260809 05:31:16.684048 14989 heartbeater.cc:464] Registering TS with master...
I20260809 05:31:16.684530 14989 heartbeater.cc:511] Master 127.26.185.62:44613 requested a full tablet report, sending...
W20260809 05:31:16.686048 14989 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 05:31:17.151855 14996 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:31:17.152262 14996 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:31:17.152452 14996 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:31:17.161006 14996 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:31:17.161170 14996 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:31:17.161417 14996 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:31:17.178610 14996 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:40245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.185.20:48165/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:36439
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=46597
--tserver_master_addrs=127.26.185.62:44613
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:31:17.181283 14996 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:31:17.183625 14996 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:31:17.214037 15024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:17.219369 15028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:17.227459 15019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:31:17.241575 14996 server_base.cc:1034] running on GCE node
I20260809 05:31:17.242887 14996 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:31:17.251353 14996 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:31:17.252877 14996 hybrid_clock.cc:648] HybridClock initialized: now 1786253477252728 us; error 147 us; skew 500 ppm
I20260809 05:31:17.253455 14996 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:31:17 dist-test-slave-h3ft krb5kdc[13199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253477, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:31:17.264118 14996 init.cc:377] Logged in from keytab as kudu/127.26.185.2@KRBTEST.COM (short username kudu)
I20260809 05:31:17.266863 14996 webserver.cc:460] Webserver started at http://127.26.185.2:46597/ using document root <none> and password file <none>
I20260809 05:31:17.268179 14996 fs_manager.cc:359] Metadata directory not provided
I20260809 05:31:17.268378 14996 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 05:31:17 dist-test-slave-h3ft krb5kdc[13199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253477, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for HTTP/127.26.185.20@KRBTEST.COM
I20260809 05:31:17.302686 14996 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.005s sys 0.000s
I20260809 05:31:17.308482 15042 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:17.311077 14996 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.003s sys 0.002s
Aug 09 05:31:17 dist-test-slave-h3ft krb5kdc[13199](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786253477, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:31:17.311352 14996 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "8f807825f6f74a0fb0129c39f4140de2"
format_stamp: "Formatted at 2026-08-09 05:31:13 on dist-test-slave-h3ft"
server_key: "189743a1309dc1d438447bbf758082b8"
server_key_iv: "9490b4c836a2e30e619665e8d82574d1"
server_key_version: "kuduclusterkey@0"
I20260809 05:31:17.313217 14996 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:31:17.372756 14996 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:31:17.382172 14996 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:31:17.382617 14996 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:31:17.384503 14996 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:31:17.386821 14996 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:31:17.386956 14996 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:17.387126 14996 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:31:17.387233 14996 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:17.474640 14996 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:36439
I20260809 05:31:17.474699 15212 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:36439 every 8 connection(s)
I20260809 05:31:17.477211 14996 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:31:17.480053 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 14996
I20260809 05:31:17.481048 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.185.20:48165/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:43439
--local_ip_for_outbound_sockets=127.26.185.3
--tserver_master_addrs=127.26.185.62:44613
--webserver_port=35961
--webserver_interface=127.26.185.3
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:40245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.185.20:48165/kms with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 05:31:17 dist-test-slave-h3ft krb5kdc[13199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253477, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:31:17.532177 15216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:17.483126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:40841 (local address 127.26.185.62:44613)
0809 05:31:17.500434 (+ 17308us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:17.500445 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:17.500480 (+ 35us) server_negotiation.cc:407] Connection header received
0809 05:31:17.506267 (+ 5787us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:17.506279 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:17.506413 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:17.506531 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:17.509783 (+ 3252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:17.511139 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:17.514196 (+ 3057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:17.514996 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:17.515155 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:17.521567 (+ 6412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:17.521579 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:17.521587 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:17.521656 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:17.526640 (+ 4984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:17.528038 (+ 1398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:17.528048 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:17.528054 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:17.528270 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:17.529018 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:17.529026 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:17.529032 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:17.529511 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:17.529685 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:17.531218 (+ 1533us) server_negotiation.cc:299] Negotiation successful
0809 05:31:17.531573 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15261,"thread_start_us":15085,"threads_started":1}
I20260809 05:31:17.535928 15215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:17.481942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44613 (local address 127.26.185.2:40841)
0809 05:31:17.499561 (+ 17619us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:17.499657 (+ 96us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:17.502817 (+ 3160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:17.507425 (+ 4608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:17.507445 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:17.508312 (+ 867us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:31:17.509515 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:17.509552 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:17.511410 (+ 1858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:17.511417 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:17.513986 (+ 2569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:17.514009 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:17.515656 (+ 1647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:17.515668 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:17.516093 (+ 425us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:17.517272 (+ 1179us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:31:17.517313 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:31:17.521074 (+ 3761us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:31:17.526889 (+ 5815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:17.526904 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:17.526948 (+ 44us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:17.527830 (+ 882us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:17.528459 (+ 629us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:17.528467 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:17.528474 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:17.528839 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:17.529819 (+ 980us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:31:17.529833 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:31:17.530551 (+ 718us) client_negotiation.cc:769] Sending connection context
0809 05:31:17.532944 (+ 2393us) client_negotiation.cc:240] Negotiation successful
0809 05:31:17.533755 (+ 811us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17174,"thread_start_us":16861,"threads_started":1}
I20260809 05:31:17.538781 15213 heartbeater.cc:347] Connected to a master server at 127.26.185.62:44613
I20260809 05:31:17.539296 15213 heartbeater.cc:464] Registering TS with master...
I20260809 05:31:17.540552 15213 heartbeater.cc:511] Master 127.26.185.62:44613 requested a full tablet report, sending...
I20260809 05:31:17.543689 14709 ts_manager.cc:194] Registered new tserver with Master: 8f807825f6f74a0fb0129c39f4140de2 (127.26.185.2:36439)
I20260809 05:31:17.546482 14709 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.2@KRBTEST.COM'} at 127.26.185.2:40841
I20260809 05:31:17.686337 14989 heartbeater.cc:464] Registering TS with master...
I20260809 05:31:17.687173 14989 heartbeater.cc:511] Master 127.26.185.62:44613 requested a full tablet report, sending...
I20260809 05:31:17.689388 14709 ts_manager.cc:194] Registered new tserver with Master: e58ffd640fc5434b9e31af7a96969a96 (127.26.185.1:34115)
I20260809 05:31:17.691131 14709 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.1@KRBTEST.COM'} at 127.26.185.1:48069
Aug 09 05:31:17 dist-test-slave-h3ft krb5kdc[13199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253477, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for HTTP/127.26.185.20@KRBTEST.COM
W20260809 05:31:18.057204 15217 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:31:18.057646 15217 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:31:18.057829 15217 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:31:18.066371 15217 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:31:18.066558 15217 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:31:18.066756 15217 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:31:18.078588 15217 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:40245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.185.20:48165/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:43439
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=35961
--tserver_master_addrs=127.26.185.62:44613
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:31:18.080600 15217 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:31:18.082458 15217 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:31:18.104306 15223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:18.106969 15225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:18.117027 15228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:31:18.117810 15217 server_base.cc:1034] running on GCE node
I20260809 05:31:18.118880 15217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:31:18.120651 15217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:31:18.122018 15217 hybrid_clock.cc:648] HybridClock initialized: now 1786253478121932 us; error 70 us; skew 500 ppm
I20260809 05:31:18.122462 15217 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:31:18 dist-test-slave-h3ft krb5kdc[13199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253478, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:31:18.127923 15217 init.cc:377] Logged in from keytab as kudu/127.26.185.3@KRBTEST.COM (short username kudu)
I20260809 05:31:18.133121 15217 webserver.cc:460] Webserver started at http://127.26.185.3:35961/ using document root <none> and password file <none>
I20260809 05:31:18.134543 15217 fs_manager.cc:359] Metadata directory not provided
I20260809 05:31:18.134764 15217 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 05:31:18 dist-test-slave-h3ft krb5kdc[13199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253478, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for HTTP/127.26.185.20@KRBTEST.COM
I20260809 05:31:18.173884 15217 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 05:31:18.178934 15240 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:18.181317 15217 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260809 05:31:18.181650 15217 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "415cf69726d741deb3c5585982fdf334"
format_stamp: "Formatted at 2026-08-09 05:31:14 on dist-test-slave-h3ft"
server_key: "942c9d70a561cd1bf39f3eb8b7ab3e1c"
server_key_iv: "1c412338a2a46ad1e74ffdb1bb1784a8"
server_key_version: "kuduclusterkey@0"
I20260809 05:31:18.183570 15217 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:31:18.211486 15217 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:31:18.218077 15217 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:31:18.218439 15217 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:31:18.226413 15217 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:31:18.232182 15217 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:31:18.232452 15217 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260809 05:31:18.232692 15217 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:31:18.232823 15217 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 05:31:18 dist-test-slave-h3ft krb5kdc[13199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253477, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for HTTP/127.26.185.20@KRBTEST.COM
I20260809 05:31:18.467350 15217 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:43439
I20260809 05:31:18.467435 15397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:43439 every 8 connection(s)
I20260809 05:31:18.470012 15217 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:31:18.479925 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 15217
Aug 09 05:31:18 dist-test-slave-h3ft krb5kdc[13199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253478, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:31:18.522051 15400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:18.474767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44613 (local address 127.26.185.3:45345)
0809 05:31:18.488032 (+ 13265us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:18.488125 (+ 93us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:18.491150 (+ 3025us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:18.494873 (+ 3723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:18.494893 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:18.495937 (+ 1044us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:31:18.497065 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:18.497100 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:18.500161 (+ 3061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:18.500169 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:18.502471 (+ 2302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:18.502491 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:18.504055 (+ 1564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:18.504064 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:18.504408 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:18.505442 (+ 1034us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:31:18.505480 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:31:18.510131 (+ 4651us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:31:18.515523 (+ 5392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:18.515535 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:18.515563 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:18.516748 (+ 1185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:18.517252 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:18.517257 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:18.517261 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:18.517608 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:18.518461 (+ 853us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:31:18.518471 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:31:18.519108 (+ 637us) client_negotiation.cc:769] Sending connection context
0809 05:31:18.519480 (+ 372us) client_negotiation.cc:240] Negotiation successful
0809 05:31:18.520233 (+ 753us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12813,"thread_start_us":12527,"threads_started":1}
I20260809 05:31:18.523751 15401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:18.481025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:45345 (local address 127.26.185.62:44613)
0809 05:31:18.493934 (+ 12909us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:18.493943 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:18.493974 (+ 31us) server_negotiation.cc:407] Connection header received
0809 05:31:18.494066 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:18.494072 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:18.494205 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:18.497315 (+ 3110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:18.497534 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:18.498924 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:18.502690 (+ 3766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:18.503488 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:18.503629 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:18.510461 (+ 6832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:18.510469 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:18.510474 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:18.510541 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:18.515303 (+ 4762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:18.516926 (+ 1623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:18.516932 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:18.516936 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:18.517106 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:18.517754 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:18.517760 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:18.517763 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:18.518197 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:18.518352 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:18.522986 (+ 4634us) server_negotiation.cc:299] Negotiation successful
0809 05:31:18.523312 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12705,"thread_start_us":15258,"threads_started":1}
I20260809 05:31:18.525096 15407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:18.481627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58258 (local address 127.26.185.62:44613)
0809 05:31:18.503382 (+ 21755us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:18.503392 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:18.503417 (+ 25us) server_negotiation.cc:407] Connection header received
0809 05:31:18.503483 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:18.503488 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:18.503621 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:18.503761 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:18.507792 (+ 4031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:18.509149 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:18.511433 (+ 2284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:18.512230 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:18.512357 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:18.516130 (+ 3773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:18.516138 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:18.516142 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:18.516191 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:18.521150 (+ 4959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:18.522360 (+ 1210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:18.522365 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:18.522368 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:18.522523 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:18.523085 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:18.523091 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:18.523095 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:18.523471 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:18.523819 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:18.524509 (+ 690us) server_negotiation.cc:299] Negotiation successful
0809 05:31:18.524733 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21422,"thread_start_us":21640,"threads_started":1}
I20260809 05:31:18.525418 15398 heartbeater.cc:347] Connected to a master server at 127.26.185.62:44613
I20260809 05:31:18.525842 15398 heartbeater.cc:464] Registering TS with master...
I20260809 05:31:18.526960 15398 heartbeater.cc:511] Master 127.26.185.62:44613 requested a full tablet report, sending...
I20260809 05:31:18.529130 14708 ts_manager.cc:194] Registered new tserver with Master: 415cf69726d741deb3c5585982fdf334 (127.26.185.3:43439)
I20260809 05:31:18.530645 14708 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.3@KRBTEST.COM'} at 127.26.185.3:45345
I20260809 05:31:18.542325 27364 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 05:31:18.553071 15213 heartbeater.cc:503] Master 127.26.185.62:44613 was elected leader, sending a full tablet report...
I20260809 05:31:18.562181 15401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:18.546254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37874 (local address 127.26.185.62:44613)
0809 05:31:18.546457 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:18.546463 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:18.547079 (+ 616us) server_negotiation.cc:407] Connection header received
0809 05:31:18.547355 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:18.547360 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:18.547443 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:18.547564 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:18.549289 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:18.550110 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:18.551751 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:18.552220 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:18.552370 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:18.556225 (+ 3855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:18.556230 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:18.556234 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:18.556271 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:18.559144 (+ 2873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:18.559918 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:18.559926 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:18.559934 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:18.560094 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:18.560515 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:18.560525 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:18.560527 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:18.560851 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:18.561167 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:18.561500 (+ 333us) server_negotiation.cc:299] Negotiation successful
0809 05:31:18.561784 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 05:31:18.568578 14708 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37874:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 05:31:18.577616 14708 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 05:31:18.618834 15435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:18.596356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:36439 (local address 127.0.0.1:38670)
0809 05:31:18.597499 (+ 1143us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:18.597575 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:18.597833 (+ 258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:18.608378 (+ 10545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:18.608387 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:18.608421 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:31:18.609094 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:18.609119 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:18.611657 (+ 2538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:18.611663 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:18.614568 (+ 2905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:18.614592 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:18.617568 (+ 2976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:18.617577 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:18.617800 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:18.617873 (+ 73us) client_negotiation.cc:769] Sending connection context
0809 05:31:18.618023 (+ 150us) client_negotiation.cc:240] Negotiation successful
0809 05:31:18.618297 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":807,"mutex_wait_us":1,"thread_start_us":11083,"threads_started":1}
I20260809 05:31:18.620882 15437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:18.596628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38670 (local address 127.26.185.2:36439)
0809 05:31:18.607338 (+ 10710us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:18.607352 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:18.607462 (+ 110us) server_negotiation.cc:407] Connection header received
0809 05:31:18.607640 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:18.607651 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:18.608048 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:18.609346 (+ 1298us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:31:18.609643 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:18.611462 (+ 1819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:18.615393 (+ 3931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:18.617253 (+ 1860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:18.619867 (+ 2614us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:18.620116 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:18.620228 (+ 112us) server_negotiation.cc:299] Negotiation successful
0809 05:31:18.620454 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10470,"thread_start_us":10229,"threads_started":1}
I20260809 05:31:18.621333 15436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:18.596422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:34115 (local address 127.0.0.1:50584)
0809 05:31:18.607758 (+ 11336us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:18.607781 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:18.607939 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:18.609643 (+ 1704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:18.609648 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:18.609678 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:31:18.610113 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:18.610127 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:18.613672 (+ 3545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:18.613678 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:18.615995 (+ 2317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:18.616024 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:18.620359 (+ 4335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:18.620366 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:18.620546 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:18.620597 (+ 51us) client_negotiation.cc:769] Sending connection context
0809 05:31:18.620763 (+ 166us) client_negotiation.cc:240] Negotiation successful
0809 05:31:18.620927 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11180,"thread_start_us":512,"threads_started":1}
I20260809 05:31:18.622258 15438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:18.597175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50584 (local address 127.26.185.1:34115)
0809 05:31:18.608060 (+ 10885us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:18.608070 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:18.608106 (+ 36us) server_negotiation.cc:407] Connection header received
0809 05:31:18.608236 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:18.608246 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:18.608505 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:18.609306 (+ 801us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:31:18.610354 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:18.613468 (+ 3114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:18.616231 (+ 2763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:18.619643 (+ 3412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:18.619809 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:18.620116 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:18.621637 (+ 1521us) server_negotiation.cc:299] Negotiation successful
0809 05:31:18.621859 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10669,"thread_start_us":9143,"threads_started":1}
I20260809 05:31:18.628680 14895 tablet_service.cc:1467] Processing CreateTablet for tablet b8c9811a44c546d387a5b7741f2e226c (DEFAULT_TABLE table=test-table [id=6b36ea84e5eb4ee5982e7c0298455028]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:31:18.630700 14895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8c9811a44c546d387a5b7741f2e226c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:31:18.631366 15435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:18.608382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:43439 (local address 127.0.0.1:56560)
0809 05:31:18.619545 (+ 11163us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:18.619571 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:18.619695 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:18.622508 (+ 2813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:18.622518 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:18.622575 (+ 57us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:31:18.622859 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:18.622874 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:18.626118 (+ 3244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:18.626127 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:18.628329 (+ 2202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:18.628344 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:18.630427 (+ 2083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:18.630433 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:18.630670 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:18.630716 (+ 46us) client_negotiation.cc:769] Sending connection context
0809 05:31:18.630837 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 05:31:18.631044 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11025,"thread_start_us":18240,"threads_started":1}
I20260809 05:31:18.631572 15442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:18.608496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56560 (local address 127.26.185.3:43439)
0809 05:31:18.621523 (+ 13027us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:18.621545 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:18.621592 (+ 47us) server_negotiation.cc:407] Connection header received
0809 05:31:18.621733 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:18.621747 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:18.622181 (+ 434us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:18.623148 (+ 967us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:31:18.623618 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:18.625909 (+ 2291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:18.628613 (+ 2704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:18.630217 (+ 1604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:18.630385 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:18.630672 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:18.630910 (+ 238us) server_negotiation.cc:299] Negotiation successful
0809 05:31:18.631158 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12780,"thread_start_us":12327,"threads_started":1}
I20260809 05:31:18.631480 15117 tablet_service.cc:1467] Processing CreateTablet for tablet b8c9811a44c546d387a5b7741f2e226c (DEFAULT_TABLE table=test-table [id=6b36ea84e5eb4ee5982e7c0298455028]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:31:18.633307 15117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8c9811a44c546d387a5b7741f2e226c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:31:18.636094 15314 tablet_service.cc:1467] Processing CreateTablet for tablet b8c9811a44c546d387a5b7741f2e226c (DEFAULT_TABLE table=test-table [id=6b36ea84e5eb4ee5982e7c0298455028]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:31:18.637912 15314 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8c9811a44c546d387a5b7741f2e226c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:31:18.650437 15443 tablet_bootstrap.cc:492] T b8c9811a44c546d387a5b7741f2e226c P 8f807825f6f74a0fb0129c39f4140de2: Bootstrap starting.
I20260809 05:31:18.651841 15445 tablet_bootstrap.cc:492] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96: Bootstrap starting.
I20260809 05:31:18.655701 15443 tablet_bootstrap.cc:654] T b8c9811a44c546d387a5b7741f2e226c P 8f807825f6f74a0fb0129c39f4140de2: Neither blocks nor log segments found. Creating new log.
I20260809 05:31:18.656333 15445 tablet_bootstrap.cc:654] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96: Neither blocks nor log segments found. Creating new log.
I20260809 05:31:18.656422 15446 tablet_bootstrap.cc:492] T b8c9811a44c546d387a5b7741f2e226c P 415cf69726d741deb3c5585982fdf334: Bootstrap starting.
I20260809 05:31:18.657846 15445 log.cc:824] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96: Log is configured to *not* fsync() on all Append() calls
I20260809 05:31:18.658215 15443 log.cc:824] T b8c9811a44c546d387a5b7741f2e226c P 8f807825f6f74a0fb0129c39f4140de2: Log is configured to *not* fsync() on all Append() calls
I20260809 05:31:18.660651 15446 tablet_bootstrap.cc:654] T b8c9811a44c546d387a5b7741f2e226c P 415cf69726d741deb3c5585982fdf334: Neither blocks nor log segments found. Creating new log.
I20260809 05:31:18.661634 15445 tablet_bootstrap.cc:492] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96: No bootstrap required, opened a new log
I20260809 05:31:18.661878 15443 tablet_bootstrap.cc:492] T b8c9811a44c546d387a5b7741f2e226c P 8f807825f6f74a0fb0129c39f4140de2: No bootstrap required, opened a new log
I20260809 05:31:18.661989 15445 ts_tablet_manager.cc:1397] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.009s
I20260809 05:31:18.662114 15446 log.cc:824] T b8c9811a44c546d387a5b7741f2e226c P 415cf69726d741deb3c5585982fdf334: Log is configured to *not* fsync() on all Append() calls
I20260809 05:31:18.662298 15443 ts_tablet_manager.cc:1397] T b8c9811a44c546d387a5b7741f2e226c P 8f807825f6f74a0fb0129c39f4140de2: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.002s
I20260809 05:31:18.667281 15446 tablet_bootstrap.cc:492] T b8c9811a44c546d387a5b7741f2e226c P 415cf69726d741deb3c5585982fdf334: No bootstrap required, opened a new log
I20260809 05:31:18.667650 15446 ts_tablet_manager.cc:1397] T b8c9811a44c546d387a5b7741f2e226c P 415cf69726d741deb3c5585982fdf334: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.004s
I20260809 05:31:18.671059 15445 raft_consensus.cc:348] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f807825f6f74a0fb0129c39f4140de2" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36439 } } peers { permanent_uuid: "e58ffd640fc5434b9e31af7a96969a96" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 34115 } } peers { permanent_uuid: "415cf69726d741deb3c5585982fdf334" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43439 } }
I20260809 05:31:18.671590 15445 raft_consensus.cc:374] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:31:18.671705 15445 raft_consensus.cc:729] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e58ffd640fc5434b9e31af7a96969a96, State: Initialized, Role: FOLLOWER
I20260809 05:31:18.672509 15445 consensus_queue.cc:260] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f807825f6f74a0fb0129c39f4140de2" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36439 } } peers { permanent_uuid: "e58ffd640fc5434b9e31af7a96969a96" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 34115 } } peers { permanent_uuid: "415cf69726d741deb3c5585982fdf334" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43439 } }
I20260809 05:31:18.673993 14989 heartbeater.cc:503] Master 127.26.185.62:44613 was elected leader, sending a full tablet report...
I20260809 05:31:18.674167 15443 raft_consensus.cc:348] T b8c9811a44c546d387a5b7741f2e226c P 8f807825f6f74a0fb0129c39f4140de2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f807825f6f74a0fb0129c39f4140de2" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36439 } } peers { permanent_uuid: "e58ffd640fc5434b9e31af7a96969a96" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 34115 } } peers { permanent_uuid: "415cf69726d741deb3c5585982fdf334" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43439 } }
I20260809 05:31:18.674710 15443 raft_consensus.cc:374] T b8c9811a44c546d387a5b7741f2e226c P 8f807825f6f74a0fb0129c39f4140de2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:31:18.674823 15443 raft_consensus.cc:729] T b8c9811a44c546d387a5b7741f2e226c P 8f807825f6f74a0fb0129c39f4140de2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f807825f6f74a0fb0129c39f4140de2, State: Initialized, Role: FOLLOWER
I20260809 05:31:18.674880 15445 ts_tablet_manager.cc:1428] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96: Time spent starting tablet: real 0.013s user 0.011s sys 0.000s
I20260809 05:31:18.675733 15443 consensus_queue.cc:260] T b8c9811a44c546d387a5b7741f2e226c P 8f807825f6f74a0fb0129c39f4140de2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f807825f6f74a0fb0129c39f4140de2" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36439 } } peers { permanent_uuid: "e58ffd640fc5434b9e31af7a96969a96" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 34115 } } peers { permanent_uuid: "415cf69726d741deb3c5585982fdf334" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43439 } }
I20260809 05:31:18.678040 15443 ts_tablet_manager.cc:1428] T b8c9811a44c546d387a5b7741f2e226c P 8f807825f6f74a0fb0129c39f4140de2: Time spent starting tablet: real 0.016s user 0.010s sys 0.003s
I20260809 05:31:18.679962 15446 raft_consensus.cc:348] T b8c9811a44c546d387a5b7741f2e226c P 415cf69726d741deb3c5585982fdf334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f807825f6f74a0fb0129c39f4140de2" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36439 } } peers { permanent_uuid: "e58ffd640fc5434b9e31af7a96969a96" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 34115 } } peers { permanent_uuid: "415cf69726d741deb3c5585982fdf334" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43439 } }
I20260809 05:31:18.680521 15446 raft_consensus.cc:374] T b8c9811a44c546d387a5b7741f2e226c P 415cf69726d741deb3c5585982fdf334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:31:18.680634 15446 raft_consensus.cc:729] T b8c9811a44c546d387a5b7741f2e226c P 415cf69726d741deb3c5585982fdf334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 415cf69726d741deb3c5585982fdf334, State: Initialized, Role: FOLLOWER
I20260809 05:31:18.681420 15446 consensus_queue.cc:260] T b8c9811a44c546d387a5b7741f2e226c P 415cf69726d741deb3c5585982fdf334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f807825f6f74a0fb0129c39f4140de2" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36439 } } peers { permanent_uuid: "e58ffd640fc5434b9e31af7a96969a96" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 34115 } } peers { permanent_uuid: "415cf69726d741deb3c5585982fdf334" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43439 } }
I20260809 05:31:18.682900 15398 heartbeater.cc:503] Master 127.26.185.62:44613 was elected leader, sending a full tablet report...
I20260809 05:31:18.683820 15446 ts_tablet_manager.cc:1428] T b8c9811a44c546d387a5b7741f2e226c P 415cf69726d741deb3c5585982fdf334: Time spent starting tablet: real 0.016s user 0.016s sys 0.000s
W20260809 05:31:18.728152 15399 tablet.cc:2369] T b8c9811a44c546d387a5b7741f2e226c P 415cf69726d741deb3c5585982fdf334: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 05:31:18.736346 15214 tablet.cc:2369] T b8c9811a44c546d387a5b7741f2e226c P 8f807825f6f74a0fb0129c39f4140de2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 05:31:18.884593 14990 tablet.cc:2369] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:31:18.894922 15452 raft_consensus.cc:482] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:31:18.895483 15452 raft_consensus.cc:504] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f807825f6f74a0fb0129c39f4140de2" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36439 } } peers { permanent_uuid: "e58ffd640fc5434b9e31af7a96969a96" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 34115 } } peers { permanent_uuid: "415cf69726d741deb3c5585982fdf334" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43439 } }
I20260809 05:31:18.898008 15452 leader_election.cc:288] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f807825f6f74a0fb0129c39f4140de2 (127.26.185.2:36439), 415cf69726d741deb3c5585982fdf334 (127.26.185.3:43439)
I20260809 05:31:18.905702 15437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:18.898474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:40675 (local address 127.26.185.2:36439)
0809 05:31:18.898815 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:18.898827 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:18.899595 (+ 768us) server_negotiation.cc:407] Connection header received
0809 05:31:18.899878 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:18.899887 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:18.900014 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:18.900122 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:31:18.900810 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:18.901613 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:18.903616 (+ 2003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:18.904526 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:18.904769 (+ 243us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:18.904869 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:18.905226 (+ 357us) server_negotiation.cc:299] Negotiation successful
0809 05:31:18.905395 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260809 05:31:18.905884 15458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:18.898452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:36439 (local address 127.26.185.1:40675)
0809 05:31:18.899453 (+ 1001us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:18.899475 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:18.899680 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:18.900188 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:18.900193 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:18.900220 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:31:18.900626 (+ 406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:18.900635 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:18.901758 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:18.901767 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:18.903438 (+ 1671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:18.903452 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:18.904786 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:18.904792 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:18.905027 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:18.905057 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 05:31:18.905180 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 05:31:18.905345 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":833,"thread_start_us":573,"threads_started":1}
I20260809 05:31:18.906416 15459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:18.899613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:43439 (local address 127.26.185.1:53833)
0809 05:31:18.900365 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:18.900399 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:18.900575 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:18.900935 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:18.900940 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:18.900963 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:31:18.901339 (+ 376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:18.901349 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:18.902453 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:18.902460 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:18.904033 (+ 1573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:18.904055 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:18.905541 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:18.905548 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:18.905720 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:18.905746 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 05:31:18.905869 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 05:31:18.906067 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":596,"thread_start_us":354,"threads_started":1}
I20260809 05:31:18.906724 15442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:18.899799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:53833 (local address 127.26.185.3:43439)
0809 05:31:18.900070 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:18.900076 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:18.900526 (+ 450us) server_negotiation.cc:407] Connection header received
0809 05:31:18.900729 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:18.900734 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:18.900808 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:18.900918 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:31:18.901519 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:18.902286 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:18.904220 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:18.905263 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:18.905464 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:18.905561 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:18.906267 (+ 706us) server_negotiation.cc:299] Negotiation successful
0809 05:31:18.906445 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260809 05:31:18.907462 15149 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8c9811a44c546d387a5b7741f2e226c" candidate_uuid: "e58ffd640fc5434b9e31af7a96969a96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f807825f6f74a0fb0129c39f4140de2" is_pre_election: true
I20260809 05:31:18.907982 15341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8c9811a44c546d387a5b7741f2e226c" candidate_uuid: "e58ffd640fc5434b9e31af7a96969a96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415cf69726d741deb3c5585982fdf334" is_pre_election: true
I20260809 05:31:18.908169 15149 raft_consensus.cc:2454] T b8c9811a44c546d387a5b7741f2e226c P 8f807825f6f74a0fb0129c39f4140de2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e58ffd640fc5434b9e31af7a96969a96 in term 0.
I20260809 05:31:18.908542 15341 raft_consensus.cc:2454] T b8c9811a44c546d387a5b7741f2e226c P 415cf69726d741deb3c5585982fdf334 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e58ffd640fc5434b9e31af7a96969a96 in term 0.
I20260809 05:31:18.909147 14831 leader_election.cc:302] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f807825f6f74a0fb0129c39f4140de2, e58ffd640fc5434b9e31af7a96969a96; no voters:
I20260809 05:31:18.909700 15452 raft_consensus.cc:2781] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:31:18.909904 15452 raft_consensus.cc:482] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:31:18.910051 15452 raft_consensus.cc:3037] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:31:18.913604 15452 raft_consensus.cc:504] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f807825f6f74a0fb0129c39f4140de2" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36439 } } peers { permanent_uuid: "e58ffd640fc5434b9e31af7a96969a96" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 34115 } } peers { permanent_uuid: "415cf69726d741deb3c5585982fdf334" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43439 } }
I20260809 05:31:18.914474 15452 leader_election.cc:288] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96 [CANDIDATE]: Term 1 election: Requested vote from peers 8f807825f6f74a0fb0129c39f4140de2 (127.26.185.2:36439), 415cf69726d741deb3c5585982fdf334 (127.26.185.3:43439)
I20260809 05:31:18.915530 15149 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8c9811a44c546d387a5b7741f2e226c" candidate_uuid: "e58ffd640fc5434b9e31af7a96969a96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f807825f6f74a0fb0129c39f4140de2"
I20260809 05:31:18.915635 15341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8c9811a44c546d387a5b7741f2e226c" candidate_uuid: "e58ffd640fc5434b9e31af7a96969a96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415cf69726d741deb3c5585982fdf334"
I20260809 05:31:18.915879 15149 raft_consensus.cc:3037] T b8c9811a44c546d387a5b7741f2e226c P 8f807825f6f74a0fb0129c39f4140de2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:31:18.916009 15341 raft_consensus.cc:3037] T b8c9811a44c546d387a5b7741f2e226c P 415cf69726d741deb3c5585982fdf334 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:31:18.918869 15149 raft_consensus.cc:2454] T b8c9811a44c546d387a5b7741f2e226c P 8f807825f6f74a0fb0129c39f4140de2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e58ffd640fc5434b9e31af7a96969a96 in term 1.
I20260809 05:31:18.918877 15341 raft_consensus.cc:2454] T b8c9811a44c546d387a5b7741f2e226c P 415cf69726d741deb3c5585982fdf334 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e58ffd640fc5434b9e31af7a96969a96 in term 1.
I20260809 05:31:18.919667 14831 leader_election.cc:302] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 415cf69726d741deb3c5585982fdf334, e58ffd640fc5434b9e31af7a96969a96; no voters:
I20260809 05:31:18.920118 15452 raft_consensus.cc:2781] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:31:18.920809 15452 raft_consensus.cc:686] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96 [term 1 LEADER]: Becoming Leader. State: Replica: e58ffd640fc5434b9e31af7a96969a96, State: Running, Role: LEADER
I20260809 05:31:18.921480 15452 consensus_queue.cc:237] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f807825f6f74a0fb0129c39f4140de2" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36439 } } peers { permanent_uuid: "e58ffd640fc5434b9e31af7a96969a96" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 34115 } } peers { permanent_uuid: "415cf69726d741deb3c5585982fdf334" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43439 } }
I20260809 05:31:18.927968 14708 catalog_manager.cc:5495] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96 reported cstate change: term changed from 0 to 1, leader changed from <none> to e58ffd640fc5434b9e31af7a96969a96 (127.26.185.1). New cstate: current_term: 1 leader_uuid: "e58ffd640fc5434b9e31af7a96969a96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f807825f6f74a0fb0129c39f4140de2" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e58ffd640fc5434b9e31af7a96969a96" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 34115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "415cf69726d741deb3c5585982fdf334" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43439 } health_report { overall_health: UNKNOWN } } }
I20260809 05:31:18.986449 15438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:18.979773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50594 (local address 127.26.185.1:34115)
0809 05:31:18.980063 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:18.980068 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:18.980090 (+ 22us) server_negotiation.cc:407] Connection header received
0809 05:31:18.980348 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:18.980352 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:18.980453 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:18.980608 (+ 155us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:31:18.981074 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:18.982111 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:18.983699 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:18.984242 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:18.984361 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:18.984966 (+ 605us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:31:18.985690 (+ 724us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:31:18.985875 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:18.985922 (+ 47us) server_negotiation.cc:299] Negotiation successful
0809 05:31:18.986039 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260809 05:31:18.998796 15149 raft_consensus.cc:1261] T b8c9811a44c546d387a5b7741f2e226c P 8f807825f6f74a0fb0129c39f4140de2 [term 1 FOLLOWER]: Refusing update from remote peer e58ffd640fc5434b9e31af7a96969a96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:31:18.998797 15341 raft_consensus.cc:1261] T b8c9811a44c546d387a5b7741f2e226c P 415cf69726d741deb3c5585982fdf334 [term 1 FOLLOWER]: Refusing update from remote peer e58ffd640fc5434b9e31af7a96969a96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:31:19.000180 15452 consensus_queue.cc:1035] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f807825f6f74a0fb0129c39f4140de2" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:31:19.000628 15460 consensus_queue.cc:1035] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "415cf69726d741deb3c5585982fdf334" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:31:19.019241 15464 mvcc.cc:205] Tried to move back new op lower bound from 7316494249964847104 to 7316494249667592192. Current Snapshot: MvccSnapshot[applied={T|T < 7316494249964847104}]
I20260809 05:31:19.036700 14709 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37874:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:31:19.037071 14709 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37874:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:31:19.041937 14709 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 64d0703a1e4a4df5b57964b4b991134b: Sending DeleteTablet for 3 replicas of tablet b8c9811a44c546d387a5b7741f2e226c
I20260809 05:31:19.043879 15117 tablet_service.cc:1514] Processing DeleteTablet for tablet b8c9811a44c546d387a5b7741f2e226c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:31:19 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:38670
I20260809 05:31:19.044016 14895 tablet_service.cc:1514] Processing DeleteTablet for tablet b8c9811a44c546d387a5b7741f2e226c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:31:19 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:50584
I20260809 05:31:19.045740 15314 tablet_service.cc:1514] Processing DeleteTablet for tablet b8c9811a44c546d387a5b7741f2e226c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:31:19 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:56560
I20260809 05:31:19.047469 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 14760
I20260809 05:31:19.051920 15478 tablet_replica.cc:330] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96: stopping tablet replica
I20260809 05:31:19.052210 15476 tablet_replica.cc:330] T b8c9811a44c546d387a5b7741f2e226c P 8f807825f6f74a0fb0129c39f4140de2: stopping tablet replica
I20260809 05:31:19.052690 15478 raft_consensus.cc:2229] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96 [term 1 LEADER]: Raft consensus shutting down.
I20260809 05:31:19.052722 15476 raft_consensus.cc:2229] T b8c9811a44c546d387a5b7741f2e226c P 8f807825f6f74a0fb0129c39f4140de2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:31:19.053489 15476 raft_consensus.cc:2258] T b8c9811a44c546d387a5b7741f2e226c P 8f807825f6f74a0fb0129c39f4140de2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:31:19.053668 15478 raft_consensus.cc:2258] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:31:19.054564 15481 tablet_replica.cc:330] T b8c9811a44c546d387a5b7741f2e226c P 415cf69726d741deb3c5585982fdf334: stopping tablet replica
I20260809 05:31:19.055272 15481 raft_consensus.cc:2229] T b8c9811a44c546d387a5b7741f2e226c P 415cf69726d741deb3c5585982fdf334 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:31:19.056008 15481 raft_consensus.cc:2258] T b8c9811a44c546d387a5b7741f2e226c P 415cf69726d741deb3c5585982fdf334 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:31:19.057063 15478 ts_tablet_manager.cc:1905] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:31:19.058952 15481 ts_tablet_manager.cc:1905] T b8c9811a44c546d387a5b7741f2e226c P 415cf69726d741deb3c5585982fdf334: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:31:19.067246 15478 ts_tablet_manager.cc:1918] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:31:19.067546 15478 log.cc:1196] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-0/wal/wals/b8c9811a44c546d387a5b7741f2e226c
I20260809 05:31:19.067848 15476 ts_tablet_manager.cc:1905] T b8c9811a44c546d387a5b7741f2e226c P 8f807825f6f74a0fb0129c39f4140de2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:31:19.068301 15478 ts_tablet_manager.cc:1939] T b8c9811a44c546d387a5b7741f2e226c P e58ffd640fc5434b9e31af7a96969a96: Deleting consensus metadata
I20260809 05:31:19.071635 14692 catalog_manager.cc:4841] TS e58ffd640fc5434b9e31af7a96969a96 (127.26.185.1:34115): tablet b8c9811a44c546d387a5b7741f2e226c (table test-table [id=6b36ea84e5eb4ee5982e7c0298455028]) successfully deleted
I20260809 05:31:19.075084 15481 ts_tablet_manager.cc:1918] T b8c9811a44c546d387a5b7741f2e226c P 415cf69726d741deb3c5585982fdf334: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:31:19.075538 15481 log.cc:1196] T b8c9811a44c546d387a5b7741f2e226c P 415cf69726d741deb3c5585982fdf334: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-2/wal/wals/b8c9811a44c546d387a5b7741f2e226c
I20260809 05:31:19.076341 15481 ts_tablet_manager.cc:1939] T b8c9811a44c546d387a5b7741f2e226c P 415cf69726d741deb3c5585982fdf334: Deleting consensus metadata
I20260809 05:31:19.078256 15476 ts_tablet_manager.cc:1918] T b8c9811a44c546d387a5b7741f2e226c P 8f807825f6f74a0fb0129c39f4140de2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:31:19.078539 15476 log.cc:1196] T b8c9811a44c546d387a5b7741f2e226c P 8f807825f6f74a0fb0129c39f4140de2: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786253234117492-27364-0/minicluster-data/ts-1/wal/wals/b8c9811a44c546d387a5b7741f2e226c
I20260809 05:31:19.079339 15476 ts_tablet_manager.cc:1939] T b8c9811a44c546d387a5b7741f2e226c P 8f807825f6f74a0fb0129c39f4140de2: Deleting consensus metadata
I20260809 05:31:19.079265 14690 catalog_manager.cc:4841] TS 415cf69726d741deb3c5585982fdf334 (127.26.185.3:43439): tablet b8c9811a44c546d387a5b7741f2e226c (table test-table [id=6b36ea84e5eb4ee5982e7c0298455028]) successfully deleted
I20260809 05:31:19.081943 14690 catalog_manager.cc:4841] TS 8f807825f6f74a0fb0129c39f4140de2 (127.26.185.2:36439): tablet b8c9811a44c546d387a5b7741f2e226c (table test-table [id=6b36ea84e5eb4ee5982e7c0298455028]) successfully deleted
I20260809 05:31:19.087088 15438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:19.048758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50602 (local address 127.26.185.1:34115)
0809 05:31:19.049049 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:19.049059 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:19.062059 (+ 13000us) server_negotiation.cc:407] Connection header received
0809 05:31:19.062510 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:19.062516 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:19.062674 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:19.062811 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:19.065364 (+ 2553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:19.066856 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:19.070038 (+ 3182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:19.070836 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:19.071126 (+ 290us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:19.076740 (+ 5614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:19.076769 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:19.076799 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:19.076872 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:19.082681 (+ 5809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:19.083977 (+ 1296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:19.083988 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:19.083991 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:19.084217 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:19.084794 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:19.084798 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:19.084801 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:19.085377 (+ 576us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:19.085657 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:19.086297 (+ 640us) server_negotiation.cc:299] Negotiation successful
0809 05:31:19.086564 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260809 05:31:19.088053 14981 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:31:19.203783 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 14760
I20260809 05:31:19.239357 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 14996
I20260809 05:31:19.256824 15437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:19.240357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38686 (local address 127.26.185.2:36439)
0809 05:31:19.240585 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:19.240592 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:19.240704 (+ 112us) server_negotiation.cc:407] Connection header received
0809 05:31:19.240966 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:19.240971 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:19.241058 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:19.241180 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:19.242849 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:19.243719 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:19.245281 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:19.245742 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:19.245897 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:19.249081 (+ 3184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:19.249104 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:19.249129 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:19.249181 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:19.253126 (+ 3945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:19.254054 (+ 928us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:19.254066 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:19.254070 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:19.254254 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:19.254736 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:19.254741 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:19.254745 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:19.255356 (+ 611us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:19.255764 (+ 408us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:19.256104 (+ 340us) server_negotiation.cc:299] Negotiation successful
0809 05:31:19.256377 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 05:31:19.257642 15205 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:31:19.357705 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 14996
I20260809 05:31:19.395644 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 15217
I20260809 05:31:19.412882 15442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:19.396717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56564 (local address 127.26.185.3:43439)
0809 05:31:19.396951 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:19.396957 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:19.396982 (+ 25us) server_negotiation.cc:407] Connection header received
0809 05:31:19.397231 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:19.397236 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:19.397322 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:19.397446 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:19.399112 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:19.399924 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:19.401373 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:19.401820 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:19.401979 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:19.405324 (+ 3345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:19.405357 (+ 33us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:19.405386 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:19.405434 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:19.409120 (+ 3686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:19.410102 (+ 982us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:19.410113 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:19.410116 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:19.410286 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:19.410765 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:19.410770 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:19.410774 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:19.411382 (+ 608us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:19.411798 (+ 416us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:19.412154 (+ 356us) server_negotiation.cc:299] Negotiation successful
0809 05:31:19.412435 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 05:31:19.413735 15393 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:31:19.513875 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 15217
I20260809 05:31:19.543963 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 14662
I20260809 05:31:19.545552 14750 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:31:19.679288 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 14662
I20260809 05:31:19.720757 27364 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 05:31:20.068415 27364 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 05:31:20.068712 27364 mini_ranger.cc:66] Stopping Ranger...
I20260809 05:31:20.426733 27364 mini_ranger.cc:68] Stopped Ranger
2026-08-09 05:31:20.427 UTC [13248] LOG: received smart shutdown request
2026-08-09 05:31:20.431 UTC [13248] LOG: background worker "logical replication launcher" (PID 13260) exited with exit code 1
2026-08-09 05:31:20.431 UTC [13251] LOG: shutting down
2026-08-09 05:31:20.619 UTC [13248] LOG: database system is shut down
2026-08-09T05:31:20Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (63514 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:31:20 dist-test-slave-h3ft krb5kdc[15500](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:31:20 dist-test-slave-h3ft krb5kdc[15500](info): set up 2 sockets
Aug 09 05:31:20 dist-test-slave-h3ft krb5kdc[15500](info): commencing operation
krb5kdc: starting...
W20260809 05:31:22.176651 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.354s user 0.004s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:31:22 dist-test-slave-h3ft krb5kdc[15500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253482, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:31:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:31:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
I20260809 05:31:22.551743 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:42669
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:36639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:42669,127.26.185.61:39055,127.26.185.60:36953
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:31:22.990902 15518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:31:22.991391 15518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:31:22.991535 15518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:31:22.999863 15518 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:31:23.000015 15518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:31:23.000141 15518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:31:23.000243 15518 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:31:23.000311 15518 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:31:23.011755 15518 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:36639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:42669,127.26.185.61:39055,127.26.185.60:36953
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:42669
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:31:23.013734 15518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:31:23.015715 15518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:31:23.030839 15524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:23.030772 15526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:23.030772 15529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:31:23.032029 15518 server_base.cc:1034] running on GCE node
I20260809 05:31:23.033208 15518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:31:23.035202 15518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:31:23.036473 15518 hybrid_clock.cc:648] HybridClock initialized: now 1786253483036422 us; error 53 us; skew 500 ppm
I20260809 05:31:23.036940 15518 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:31:23 dist-test-slave-h3ft krb5kdc[15500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253483, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:31:23.045224 15518 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:31:23.047638 15518 webserver.cc:460] Webserver started at http://127.26.185.62:42471/ using document root <none> and password file <none>
I20260809 05:31:23.048623 15518 fs_manager.cc:359] Metadata directory not provided
I20260809 05:31:23.048796 15518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:31:23.049206 15518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:31:23.053241 15518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "008d7f1f8ac04a20b7da00c2eb966f3d"
format_stamp: "Formatted at 2026-08-09 05:31:23 on dist-test-slave-h3ft"
server_key: "68beafde80f061b2b2f187129cd3c130"
server_key_iv: "eb2c97e1127db8f084b0059ff541e902"
server_key_version: "encryptionkey@0"
I20260809 05:31:23.054303 15518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "008d7f1f8ac04a20b7da00c2eb966f3d"
format_stamp: "Formatted at 2026-08-09 05:31:23 on dist-test-slave-h3ft"
server_key: "68beafde80f061b2b2f187129cd3c130"
server_key_iv: "eb2c97e1127db8f084b0059ff541e902"
server_key_version: "encryptionkey@0"
I20260809 05:31:23.061214 15518 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260809 05:31:23.065968 15541 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:23.067912 15518 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260809 05:31:23.068198 15518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "008d7f1f8ac04a20b7da00c2eb966f3d"
format_stamp: "Formatted at 2026-08-09 05:31:23 on dist-test-slave-h3ft"
server_key: "68beafde80f061b2b2f187129cd3c130"
server_key_iv: "eb2c97e1127db8f084b0059ff541e902"
server_key_version: "encryptionkey@0"
I20260809 05:31:23.068473 15518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:31:23.087721 15518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:31:23.093417 15518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:31:23.093802 15518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:31:23.117539 15518 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:42669
I20260809 05:31:23.117579 15613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:42669 every 8 connection(s)
I20260809 05:31:23.119561 15518 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:31:23.120551 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 15518
I20260809 05:31:23.120874 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:31:23.121917 27364 external_mini_cluster.cc:1428] Setting key 429485f4aada4b9898dbad38b6f9eb1a
I20260809 05:31:23.125543 15614 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:31:23.135198 15614 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42669 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 05:31:23 dist-test-slave-h3ft krb5kdc[15500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253483, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.185.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.61@KRBTEST.COM" created.
I20260809 05:31:23.164759 15620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:23.139801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47274 (local address 127.26.185.62:42669)
0809 05:31:23.142089 (+ 2288us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:23.142099 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:23.142177 (+ 78us) server_negotiation.cc:407] Connection header received
0809 05:31:23.144285 (+ 2108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:23.144292 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:23.144615 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:23.144873 (+ 258us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:23.146570 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:23.148158 (+ 1588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:23.149940 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:23.150664 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:23.150938 (+ 274us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:23.155967 (+ 5029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:23.155977 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:23.155995 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:23.156027 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:23.159423 (+ 3396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:23.160360 (+ 937us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:23.160369 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:23.160371 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:23.160572 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:23.161116 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:23.161121 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:23.161123 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:23.161801 (+ 678us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:23.162004 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:23.162820 (+ 816us) server_negotiation.cc:299] Negotiation successful
0809 05:31:23.163320 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":2008,"spinlock_wait_cycles":20224,"thread_start_us":1733,"threads_started":1}
I20260809 05:31:23.164799 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:23.139800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:42669 (local address 127.0.0.1:47274)
0809 05:31:23.141019 (+ 1219us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:23.141118 (+ 99us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:23.143796 (+ 2678us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:23.144895 (+ 1099us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:23.144903 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:23.145869 (+ 966us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:31:23.146322 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:23.146343 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:23.148351 (+ 2008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:23.148359 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:23.149765 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:23.149781 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:23.151158 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:23.151178 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:23.151417 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:23.152335 (+ 918us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:31:23.152377 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:31:23.155701 (+ 3324us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:31:23.159562 (+ 3861us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:23.159576 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:23.159595 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:23.160152 (+ 557us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:23.160721 (+ 569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:23.160729 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:23.160735 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:23.160963 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:23.161976 (+ 1013us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:31:23.161990 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:31:23.162350 (+ 360us) client_negotiation.cc:769] Sending connection context
0809 05:31:23.162702 (+ 352us) client_negotiation.cc:240] Negotiation successful
0809 05:31:23.163492 (+ 790us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":868,"mutex_wait_us":153,"thread_start_us":543,"threads_started":1}
I20260809 05:31:23.168857 15614 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.61" port: 39055 } has no permanent_uuid. Determining permanent_uuid...
I20260809 05:31:23.170475 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:23.169862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:39055 (local address 127.0.0.1:58980)
0809 05:31:23.170116 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:23.170268 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.61:39055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
W20260809 05:31:23.170890 15547 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.185.61:39055: connect: Connection refused (error 111)
I20260809 05:31:23.173118 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:23.172594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:39055 (local address 127.0.0.1:58982)
0809 05:31:23.172791 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:23.172896 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.61:39055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 05:31:23.173370 15614 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.61:39055: Network error: Client connection negotiation failed: client connection to 127.26.185.61:39055: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.61.keytab.
Entry for principal kudu/127.26.185.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.61.keytab.
I20260809 05:31:23.203426 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.61:39055
--webserver_interface=127.26.185.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.61.keytab
--principal=kudu/127.26.185.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:36639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:42669,127.26.185.61:39055,127.26.185.60:36953
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:31:23.223194 15614 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.61" port: 39055 } attempt: 1
I20260809 05:31:23.224941 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:23.224361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:39055 (local address 127.0.0.1:58998)
0809 05:31:23.224605 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:23.224769 (+ 164us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.61:39055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260809 05:31:23.226207 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:23.225804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:39055 (local address 127.0.0.1:59010)
0809 05:31:23.225980 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:23.226064 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.61:39055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260809 05:31:23.226411 15614 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.61:39055: Network error: Client connection negotiation failed: client connection to 127.26.185.61:39055: connect: Connection refused (error 111)
I20260809 05:31:23.294714 15614 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.61" port: 39055 } attempt: 2
I20260809 05:31:23.296370 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:23.295708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:39055 (local address 127.0.0.1:59016)
0809 05:31:23.296044 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:23.296174 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.61:39055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260809 05:31:23.298022 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:23.297240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:39055 (local address 127.0.0.1:59032)
0809 05:31:23.297722 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:23.297818 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.61:39055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":319}
W20260809 05:31:23.298272 15614 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.61:39055: Network error: Client connection negotiation failed: client connection to 127.26.185.61:39055: connect: Connection refused (error 111)
I20260809 05:31:23.389649 15614 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.61" port: 39055 } attempt: 3
I20260809 05:31:23.391345 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:23.390637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:39055 (local address 127.0.0.1:59048)
0809 05:31:23.390902 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:23.391117 (+ 215us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.61:39055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260809 05:31:23.392563 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:23.392171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:39055 (local address 127.0.0.1:59054)
0809 05:31:23.392332 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:23.392417 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.61:39055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260809 05:31:23.392774 15614 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.61:39055: Network error: Client connection negotiation failed: client connection to 127.26.185.61:39055: connect: Connection refused (error 111)
I20260809 05:31:23.536084 15614 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.61" port: 39055 } attempt: 4
I20260809 05:31:23.537738 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:23.536998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:39055 (local address 127.0.0.1:59068)
0809 05:31:23.537433 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:23.537547 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.61:39055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213}
I20260809 05:31:23.539057 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:23.538582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:39055 (local address 127.0.0.1:59072)
0809 05:31:23.538754 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:23.538850 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.61:39055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260809 05:31:23.539300 15614 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.61:39055: Network error: Client connection negotiation failed: client connection to 127.26.185.61:39055: connect: Connection refused (error 111)
W20260809 05:31:23.627281 15623 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:31:23.627709 15623 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:31:23.627874 15623 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:31:23.636008 15623 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:31:23.636188 15623 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:31:23.636303 15623 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:31:23.636415 15623 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:31:23.636498 15623 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:31:23.648109 15623 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:36639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:42669,127.26.185.61:39055,127.26.185.60:36953
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.61.keytab
--principal=kudu/127.26.185.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.61:39055
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.185.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:31:23.650115 15623 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:31:23.651882 15623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:31:23.666141 15628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:23.666244 15629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:23.666208 15632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:31:23.667491 15623 server_base.cc:1034] running on GCE node
I20260809 05:31:23.668668 15623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:31:23.670634 15623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:31:23.671875 15623 hybrid_clock.cc:648] HybridClock initialized: now 1786253483671822 us; error 44 us; skew 500 ppm
I20260809 05:31:23.672343 15623 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:31:23 dist-test-slave-h3ft krb5kdc[15500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253483, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:31:23.676525 15623 init.cc:377] Logged in from keytab as kudu/127.26.185.61@KRBTEST.COM (short username kudu)
I20260809 05:31:23.678416 15623 webserver.cc:460] Webserver started at http://127.26.185.61:32821/ using document root <none> and password file <none>
I20260809 05:31:23.679442 15623 fs_manager.cc:359] Metadata directory not provided
I20260809 05:31:23.679620 15623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:31:23.680071 15623 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:31:23.684187 15623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-1/data/instance:
uuid: "72599feb857c443d91ff5d0ee4d49dc8"
format_stamp: "Formatted at 2026-08-09 05:31:23 on dist-test-slave-h3ft"
server_key: "a286310d8cf19a8829ddd959f379473f"
server_key_iv: "8af2b8d1b4b235c1a59ab7f1b4fd0f0b"
server_key_version: "encryptionkey@0"
I20260809 05:31:23.685307 15623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-1/wal/instance:
uuid: "72599feb857c443d91ff5d0ee4d49dc8"
format_stamp: "Formatted at 2026-08-09 05:31:23 on dist-test-slave-h3ft"
server_key: "a286310d8cf19a8829ddd959f379473f"
server_key_iv: "8af2b8d1b4b235c1a59ab7f1b4fd0f0b"
server_key_version: "encryptionkey@0"
I20260809 05:31:23.692622 15623 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.003s sys 0.005s
I20260809 05:31:23.697754 15644 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:23.699925 15623 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260809 05:31:23.700197 15623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-1/wal
uuid: "72599feb857c443d91ff5d0ee4d49dc8"
format_stamp: "Formatted at 2026-08-09 05:31:23 on dist-test-slave-h3ft"
server_key: "a286310d8cf19a8829ddd959f379473f"
server_key_iv: "8af2b8d1b4b235c1a59ab7f1b4fd0f0b"
server_key_version: "encryptionkey@0"
I20260809 05:31:23.700497 15623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:31:23.719731 15623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:31:23.726040 15623 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:31:23.726446 15623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:31:23.750872 15623 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.61:39055
I20260809 05:31:23.750908 15725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.61:39055 every 8 connection(s)
I20260809 05:31:23.752898 15623 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-1/data/info.pb
I20260809 05:31:23.757910 15726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:31:23.762732 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 15623
I20260809 05:31:23.763113 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-1/wal/instance
I20260809 05:31:23.763664 27364 external_mini_cluster.cc:1428] Setting key 88ac1b27a6dbb0a203f7f373d9536d15
I20260809 05:31:23.766388 15726 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42669 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 05:31:23 dist-test-slave-h3ft krb5kdc[15500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253483, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.61@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:31:23.795351 15729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:23.769848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47282 (local address 127.26.185.62:42669)
0809 05:31:23.770569 (+ 721us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:23.770579 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:23.771832 (+ 1253us) server_negotiation.cc:407] Connection header received
0809 05:31:23.774492 (+ 2660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:23.774501 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:23.774636 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:23.774790 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:23.776743 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:23.777970 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:23.780782 (+ 2812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:23.781260 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:23.781391 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:23.786935 (+ 5544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:23.786941 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:23.786944 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:23.787077 (+ 133us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:23.790468 (+ 3391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:23.791809 (+ 1341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:23.791814 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:23.791817 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:23.791982 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:23.792681 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:23.792689 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:23.792695 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:23.793183 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:23.793372 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:23.794419 (+ 1047us) server_negotiation.cc:299] Negotiation successful
0809 05:31:23.794761 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":522,"thread_start_us":338,"threads_started":1}
I20260809 05:31:23.796489 15732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:23.770583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:42669 (local address 127.0.0.1:47282)
0809 05:31:23.771605 (+ 1022us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:23.771662 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:23.774087 (+ 2425us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:23.775091 (+ 1004us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:23.775103 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:23.775771 (+ 668us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:31:23.776522 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:23.776543 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:23.778171 (+ 1628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:23.778178 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:23.780574 (+ 2396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:23.780596 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:23.781560 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:23.781574 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:23.781951 (+ 377us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:23.782935 (+ 984us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:31:23.782984 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:31:23.786579 (+ 3595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:31:23.790706 (+ 4127us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:23.790721 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:23.790752 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:23.791620 (+ 868us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:23.792128 (+ 508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:23.792135 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:23.792141 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:23.792501 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:23.793371 (+ 870us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:31:23.793380 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:31:23.793906 (+ 526us) client_negotiation.cc:769] Sending connection context
0809 05:31:23.794226 (+ 320us) client_negotiation.cc:240] Negotiation successful
0809 05:31:23.794832 (+ 606us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":681,"thread_start_us":444,"threads_started":1}
I20260809 05:31:23.798941 15726 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.61" port: 39055 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.26.185.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.60@KRBTEST.COM" created.
Aug 09 05:31:23 dist-test-slave-h3ft krb5kdc[15500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253483, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.61@KRBTEST.COM for kudu/127.26.185.61@KRBTEST.COM
I20260809 05:31:23.817905 15732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:23.800119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:39055 (local address 127.0.0.1:59076)
0809 05:31:23.800392 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:23.800421 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:23.800556 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:23.801792 (+ 1236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:23.801796 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:23.802235 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:31:23.802405 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:23.802414 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:23.804230 (+ 1816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:23.804236 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:23.805120 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:23.805131 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:23.806605 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:23.806610 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:23.806779 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:23.807510 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:31:23.807531 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:31:23.810013 (+ 2482us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:31:23.815117 (+ 5104us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:23.815122 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:23.815125 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:23.815546 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:23.816021 (+ 475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:23.816025 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:23.816027 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:23.816188 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:23.817076 (+ 888us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:31:23.817080 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:31:23.817212 (+ 132us) client_negotiation.cc:769] Sending connection context
0809 05:31:23.817331 (+ 119us) client_negotiation.cc:240] Negotiation successful
0809 05:31:23.817586 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83}
I20260809 05:31:23.818454 15737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:23.800315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59076 (local address 127.26.185.61:39055)
0809 05:31:23.801231 (+ 916us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:23.801239 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:23.801269 (+ 30us) server_negotiation.cc:407] Connection header received
0809 05:31:23.801361 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:23.801386 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:23.801626 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:23.801773 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:23.802567 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:23.804075 (+ 1508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:23.805258 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:23.806404 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:23.806563 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:23.810301 (+ 3738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:23.810324 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:23.810355 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:23.810416 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:23.814920 (+ 4504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:23.815698 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:23.815712 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:23.815719 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:23.815893 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:23.816295 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:23.816303 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:23.816309 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:23.816924 (+ 615us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:23.817179 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:23.817541 (+ 362us) server_negotiation.cc:299] Negotiation successful
0809 05:31:23.817900 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":727,"thread_start_us":575,"threads_started":1}
I20260809 05:31:23.821950 15726 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } has no permanent_uuid. Determining permanent_uuid...
I20260809 05:31:23.823484 15732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:23.822861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:36953 (local address 127.0.0.1:55510)
0809 05:31:23.823117 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:23.823292 (+ 175us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:36953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260809 05:31:23.823778 15648 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.185.60:36953: connect: Connection refused (error 111)
I20260809 05:31:23.826032 15732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:23.825474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:36953 (local address 127.0.0.1:55516)
0809 05:31:23.825701 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:23.825831 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:36953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260809 05:31:23.826284 15726 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.60:36953: Network error: Client connection negotiation failed: client connection to 127.26.185.60:36953: connect: Connection refused (error 111)
I20260809 05:31:23.838644 15614 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.61" port: 39055 } attempt: 5
Aug 09 05:31:23 dist-test-slave-h3ft krb5kdc[15500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253483, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for kudu/127.26.185.61@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.60.keytab.
Entry for principal kudu/127.26.185.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.60.keytab.
I20260809 05:31:23.852020 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.60:36953
--webserver_interface=127.26.185.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.60.keytab
--principal=kudu/127.26.185.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:36639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:42669,127.26.185.61:39055,127.26.185.60:36953
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:31:23.856091 15737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:23.839911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59084 (local address 127.26.185.61:39055)
0809 05:31:23.840129 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:23.840135 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:23.840158 (+ 23us) server_negotiation.cc:407] Connection header received
0809 05:31:23.840333 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:23.840338 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:23.840438 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:23.840555 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:23.841739 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:23.842650 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:23.844330 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:23.844876 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:23.844983 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:23.849240 (+ 4257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:23.849246 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:23.849250 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:23.849295 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:23.852858 (+ 3563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:23.853893 (+ 1035us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:23.853897 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:23.853900 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:23.854043 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:23.854520 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:23.854523 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:23.854525 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:23.854841 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:23.854965 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:23.855586 (+ 621us) server_negotiation.cc:299] Negotiation successful
0809 05:31:23.855806 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 05:31:23.856353 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:23.839694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:39055 (local address 127.0.0.1:59084)
0809 05:31:23.840004 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:23.840041 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:23.840199 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:23.840664 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:23.840671 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:23.841271 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:31:23.841534 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:23.841545 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:23.842821 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:23.842826 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:23.844172 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:23.844189 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:23.845244 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:23.845254 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:23.845429 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:23.846260 (+ 831us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:31:23.846283 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:31:23.848877 (+ 2594us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:31:23.853039 (+ 4162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:23.853048 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:23.853055 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:23.853751 (+ 696us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:23.854185 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:23.854194 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:23.854200 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:23.854406 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:23.854965 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:31:23.854973 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:31:23.855267 (+ 294us) client_negotiation.cc:769] Sending connection context
0809 05:31:23.855484 (+ 217us) client_negotiation.cc:240] Negotiation successful
0809 05:31:23.855864 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113}
I20260809 05:31:23.857846 15614 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } has no permanent_uuid. Determining permanent_uuid...
I20260809 05:31:23.859412 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:23.858843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:36953 (local address 127.0.0.1:55530)
0809 05:31:23.859136 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:23.859243 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:36953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134}
I20260809 05:31:23.860553 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:23.860183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:36953 (local address 127.0.0.1:55536)
0809 05:31:23.860343 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:23.860443 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:36953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 05:31:23.860809 15614 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.60:36953: Network error: Client connection negotiation failed: client connection to 127.26.185.60:36953: connect: Connection refused (error 111)
I20260809 05:31:23.875725 15726 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } attempt: 1
I20260809 05:31:23.877584 15732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:23.876817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:36953 (local address 127.0.0.1:55550)
0809 05:31:23.877131 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:23.877312 (+ 181us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:36953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260809 05:31:23.878968 15732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:23.878513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:36953 (local address 127.0.0.1:55558)
0809 05:31:23.878749 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:23.878828 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:36953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260809 05:31:23.879302 15726 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.60:36953: Network error: Client connection negotiation failed: client connection to 127.26.185.60:36953: connect: Connection refused (error 111)
I20260809 05:31:23.912180 15614 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } attempt: 1
I20260809 05:31:23.914121 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:23.913318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:36953 (local address 127.0.0.1:55568)
0809 05:31:23.913612 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:23.913782 (+ 170us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:36953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260809 05:31:23.915624 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:23.915158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:36953 (local address 127.0.0.1:55576)
0809 05:31:23.915346 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:23.915461 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:36953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260809 05:31:23.915912 15614 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.60:36953: Network error: Client connection negotiation failed: client connection to 127.26.185.60:36953: connect: Connection refused (error 111)
I20260809 05:31:23.947605 15726 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } attempt: 2
I20260809 05:31:23.949277 15732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:23.948668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:36953 (local address 127.0.0.1:55584)
0809 05:31:23.948914 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:23.949070 (+ 156us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:36953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260809 05:31:23.950690 15732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:23.950289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:36953 (local address 127.0.0.1:55592)
0809 05:31:23.950453 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:23.950538 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:36953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260809 05:31:23.951061 15726 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.60:36953: Network error: Client connection negotiation failed: client connection to 127.26.185.60:36953: connect: Connection refused (error 111)
I20260809 05:31:23.984200 15614 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } attempt: 2
I20260809 05:31:23.985899 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:23.985148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:36953 (local address 127.0.0.1:55606)
0809 05:31:23.985469 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:23.985612 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:36953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260809 05:31:23.987145 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:23.986720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:36953 (local address 127.0.0.1:55616)
0809 05:31:23.986898 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:23.986992 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:36953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260809 05:31:23.987426 15614 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.60:36953: Network error: Client connection negotiation failed: client connection to 127.26.185.60:36953: connect: Connection refused (error 111)
I20260809 05:31:24.042366 15726 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } attempt: 3
I20260809 05:31:24.044018 15732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:24.043423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:36953 (local address 127.0.0.1:55620)
0809 05:31:24.043667 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:24.043797 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:36953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260809 05:31:24.045421 15732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:24.044881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:36953 (local address 127.0.0.1:55624)
0809 05:31:24.045169 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:24.045272 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:36953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170}
W20260809 05:31:24.045675 15726 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.60:36953: Network error: Client connection negotiation failed: client connection to 127.26.185.60:36953: connect: Connection refused (error 111)
I20260809 05:31:24.093734 15614 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } attempt: 3
I20260809 05:31:24.095712 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:24.094809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:36953 (local address 127.0.0.1:55634)
0809 05:31:24.095172 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:24.095346 (+ 174us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:36953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260809 05:31:24.097314 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:24.096749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:36953 (local address 127.0.0.1:55640)
0809 05:31:24.096982 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:24.097104 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:36953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
W20260809 05:31:24.097620 15614 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.60:36953: Network error: Client connection negotiation failed: client connection to 127.26.185.60:36953: connect: Connection refused (error 111)
I20260809 05:31:24.188961 15726 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } attempt: 4
I20260809 05:31:24.190505 15732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:24.189872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:36953 (local address 127.0.0.1:55656)
0809 05:31:24.190183 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:24.190292 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:36953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260809 05:31:24.191807 15732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:24.191448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:36953 (local address 127.0.0.1:55662)
0809 05:31:24.191603 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:24.191686 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:36953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260809 05:31:24.192066 15726 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.60:36953: Network error: Client connection negotiation failed: client connection to 127.26.185.60:36953: connect: Connection refused (error 111)
I20260809 05:31:24.274895 15614 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } attempt: 4
I20260809 05:31:24.276512 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:24.275836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:36953 (local address 127.0.0.1:55674)
0809 05:31:24.276114 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:24.276254 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:36953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260809 05:31:24.277910 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:24.277430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:36953 (local address 127.0.0.1:55688)
0809 05:31:24.277625 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:24.277734 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:36953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260809 05:31:24.278178 15614 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.60:36953: Network error: Client connection negotiation failed: client connection to 127.26.185.60:36953: connect: Connection refused (error 111)
W20260809 05:31:24.294293 15741 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:31:24.294690 15741 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:31:24.294792 15741 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:31:24.302624 15741 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:31:24.302762 15741 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:31:24.302815 15741 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:31:24.302896 15741 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:31:24.302945 15741 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:31:24.314287 15741 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:36639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:42669,127.26.185.61:39055,127.26.185.60:36953
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.60.keytab
--principal=kudu/127.26.185.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.60:36953
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.185.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:31:24.316242 15741 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:31:24.317920 15741 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:31:24.332834 15747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:24.332898 15748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:24.332935 15750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:31:24.337057 15741 server_base.cc:1034] running on GCE node
I20260809 05:31:24.338192 15741 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:31:24.340175 15741 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:31:24.341408 15741 hybrid_clock.cc:648] HybridClock initialized: now 1786253484341321 us; error 71 us; skew 500 ppm
I20260809 05:31:24.341874 15741 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:31:24 dist-test-slave-h3ft krb5kdc[15500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253484, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:31:24.345772 15741 init.cc:377] Logged in from keytab as kudu/127.26.185.60@KRBTEST.COM (short username kudu)
I20260809 05:31:24.347834 15741 webserver.cc:460] Webserver started at http://127.26.185.60:45621/ using document root <none> and password file <none>
I20260809 05:31:24.348783 15741 fs_manager.cc:359] Metadata directory not provided
I20260809 05:31:24.348956 15741 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:31:24.349334 15741 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:31:24.353104 15741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-2/data/instance:
uuid: "f75928c5501c440eb96bc21b5a6a3445"
format_stamp: "Formatted at 2026-08-09 05:31:24 on dist-test-slave-h3ft"
server_key: "da4731f45f607b4b00c8ce9f2d492091"
server_key_iv: "636f6a33f9a7e005df955eeb09c4bada"
server_key_version: "encryptionkey@0"
I20260809 05:31:24.354094 15741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-2/wal/instance:
uuid: "f75928c5501c440eb96bc21b5a6a3445"
format_stamp: "Formatted at 2026-08-09 05:31:24 on dist-test-slave-h3ft"
server_key: "da4731f45f607b4b00c8ce9f2d492091"
server_key_iv: "636f6a33f9a7e005df955eeb09c4bada"
server_key_version: "encryptionkey@0"
I20260809 05:31:24.361282 15741 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260809 05:31:24.365787 15760 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:24.367650 15741 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:31:24.367884 15741 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-2/wal
uuid: "f75928c5501c440eb96bc21b5a6a3445"
format_stamp: "Formatted at 2026-08-09 05:31:24 on dist-test-slave-h3ft"
server_key: "da4731f45f607b4b00c8ce9f2d492091"
server_key_iv: "636f6a33f9a7e005df955eeb09c4bada"
server_key_version: "encryptionkey@0"
I20260809 05:31:24.368156 15741 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:31:24.386744 15741 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:31:24.392047 15741 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:31:24.392429 15741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:31:24.419410 15741 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.60:36953
I20260809 05:31:24.419432 15837 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.60:36953 every 8 connection(s)
I20260809 05:31:24.421389 15741 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-2/data/info.pb
I20260809 05:31:24.424220 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 15741
I20260809 05:31:24.424474 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786253234117492-27364-0/minicluster-data/master-2/wal/instance
I20260809 05:31:24.425156 27364 external_mini_cluster.cc:1428] Setting key f06d1bde754a51612ae2e4b507630abb
I20260809 05:31:24.427424 15838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:31:24.439256 15838 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42669 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 05:31:24 dist-test-slave-h3ft krb5kdc[15500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253482, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.60@KRBTEST.COM
Aug 09 05:31:24 dist-test-slave-h3ft krb5kdc[15500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253484, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.60@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:31:24.456985 15842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:24.427868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55694 (local address 127.26.185.60:36953)
0809 05:31:24.428938 (+ 1070us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:24.428954 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:24.429010 (+ 56us) server_negotiation.cc:407] Connection header received
0809 05:31:24.430943 (+ 1933us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:24.430972 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:24.431558 (+ 586us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:24.432041 (+ 483us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:24.434681 (+ 2640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.436456 (+ 1775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.438905 (+ 2449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.439795 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.439954 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:24.447135 (+ 7181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:24.447145 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:24.447159 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:24.447210 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:24.451276 (+ 4066us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:24.452392 (+ 1116us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:24.452404 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:24.452417 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:24.452660 (+ 243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:24.453122 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:24.453125 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:24.453131 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:24.453761 (+ 630us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:24.454020 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:24.454670 (+ 650us) server_negotiation.cc:299] Negotiation successful
0809 05:31:24.455225 (+ 555us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":761,"thread_start_us":487,"threads_started":1}
I20260809 05:31:24.462515 15845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:24.443322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:42669 (local address 127.0.0.1:47284)
0809 05:31:24.444408 (+ 1086us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:24.444462 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:24.444673 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:24.445766 (+ 1093us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:24.445777 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:24.446873 (+ 1096us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:31:24.447467 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:24.447482 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.449090 (+ 1608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.449094 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:24.450463 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:24.450476 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.451617 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.451625 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:24.451813 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:24.452549 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:31:24.452568 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:31:24.455386 (+ 2818us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:31:24.459181 (+ 3795us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:24.459197 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:24.459209 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:24.459703 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:24.460205 (+ 502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:24.460210 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:24.460213 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:24.460460 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:24.461325 (+ 865us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:31:24.461340 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:31:24.461508 (+ 168us) client_negotiation.cc:769] Sending connection context
0809 05:31:24.461695 (+ 187us) client_negotiation.cc:240] Negotiation successful
0809 05:31:24.462064 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":781,"thread_start_us":530,"threads_started":1}
I20260809 05:31:24.462550 15843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:24.443377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47284 (local address 127.26.185.62:42669)
0809 05:31:24.445179 (+ 1802us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:24.445185 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:24.445204 (+ 19us) server_negotiation.cc:407] Connection header received
0809 05:31:24.445283 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:24.445288 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:24.445367 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:24.445545 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:24.447691 (+ 2146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.448868 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.450649 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.451407 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.451539 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:24.455604 (+ 4065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:24.455610 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:24.455615 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:24.455665 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:24.458984 (+ 3319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:24.459840 (+ 856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:24.459847 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:24.459855 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:24.460051 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:24.460624 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:24.460629 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:24.460632 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:24.461062 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:24.461246 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:24.461826 (+ 580us) server_negotiation.cc:299] Negotiation successful
0809 05:31:24.462077 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1664,"thread_start_us":1509,"threads_started":1}
I20260809 05:31:24.464568 15838 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.61" port: 39055 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 05:31:24 dist-test-slave-h3ft krb5kdc[15500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253482, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
Aug 09 05:31:24 dist-test-slave-h3ft krb5kdc[15500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253484, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.60@KRBTEST.COM for kudu/127.26.185.61@KRBTEST.COM
I20260809 05:31:24.481835 15846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:24.460937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47286 (local address 127.26.185.62:42669)
0809 05:31:24.462419 (+ 1482us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:24.462424 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:24.462451 (+ 27us) server_negotiation.cc:407] Connection header received
0809 05:31:24.462504 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:24.462508 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:24.462578 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:24.463141 (+ 563us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:24.464778 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.466208 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.468012 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.468836 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.469010 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:24.474649 (+ 5639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:24.474655 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:24.474659 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:24.474696 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:24.478449 (+ 3753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:24.479404 (+ 955us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:24.479409 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:24.479411 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:24.479609 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:24.480141 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:24.480146 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:24.480149 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:24.480541 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:24.480825 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:24.481196 (+ 371us) server_negotiation.cc:299] Negotiation successful
0809 05:31:24.481435 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1321,"thread_start_us":1039,"threads_started":1}
I20260809 05:31:24.482460 15845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:24.465440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:39055 (local address 127.0.0.1:59096)
0809 05:31:24.465628 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:24.465652 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:24.465760 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:24.466680 (+ 920us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:24.466687 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:24.467252 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:31:24.467458 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:24.467469 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.469211 (+ 1742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.469217 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:24.470629 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:24.470646 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.471665 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.471673 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:24.471935 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:24.472566 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:31:24.472609 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:31:24.475199 (+ 2590us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:31:24.479347 (+ 4148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:24.479355 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:24.479359 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:24.479896 (+ 537us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:24.480383 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:24.480387 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:24.480390 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:24.480569 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:24.481254 (+ 685us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:31:24.481260 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:31:24.481507 (+ 247us) client_negotiation.cc:769] Sending connection context
0809 05:31:24.481682 (+ 175us) client_negotiation.cc:240] Negotiation successful
0809 05:31:24.482054 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70}
I20260809 05:31:24.482811 15847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:24.465572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59096 (local address 127.26.185.61:39055)
0809 05:31:24.466278 (+ 706us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:24.466288 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:24.466316 (+ 28us) server_negotiation.cc:407] Connection header received
0809 05:31:24.466417 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:24.466422 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:24.466514 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:24.466631 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:24.467659 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.469036 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.470807 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.471479 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.471611 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:24.475432 (+ 3821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:24.475439 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:24.475445 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:24.475502 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:24.479200 (+ 3698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:24.480021 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:24.480025 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:24.480027 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:24.480223 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:24.480745 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:24.480750 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:24.480753 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:24.481108 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:24.481258 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:24.482004 (+ 746us) server_negotiation.cc:299] Negotiation successful
0809 05:31:24.482293 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":539,"thread_start_us":359,"threads_started":1}
I20260809 05:31:24.484083 15838 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } has no permanent_uuid. Determining permanent_uuid...
I20260809 05:31:24.491317 15726 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } attempt: 5
Aug 09 05:31:24 dist-test-slave-h3ft krb5kdc[15500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253484, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.60@KRBTEST.COM for kudu/127.26.185.60@KRBTEST.COM
Aug 09 05:31:24 dist-test-slave-h3ft krb5kdc[15500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253482, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.61@KRBTEST.COM
I20260809 05:31:24.501489 15845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:24.485089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:36953 (local address 127.0.0.1:55706)
0809 05:31:24.485360 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:24.485376 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:24.485463 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:24.485803 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:24.485806 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:24.486216 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:31:24.486364 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:24.486372 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.487701 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.487707 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:24.488670 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:24.488682 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.489750 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.489756 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:24.489954 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:24.490767 (+ 813us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:31:24.490786 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:31:24.493719 (+ 2933us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:31:24.498012 (+ 4293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:24.498020 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:24.498024 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:24.498504 (+ 480us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:24.499087 (+ 583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:24.499095 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:24.499103 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:24.499298 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:24.500035 (+ 737us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:31:24.500041 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:31:24.500243 (+ 202us) client_negotiation.cc:769] Sending connection context
0809 05:31:24.500458 (+ 215us) client_negotiation.cc:240] Negotiation successful
0809 05:31:24.500889 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168}
Aug 09 05:31:24 dist-test-slave-h3ft krb5kdc[15500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253483, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.61@KRBTEST.COM for kudu/127.26.185.60@KRBTEST.COM
I20260809 05:31:24.501547 15842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:24.485066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55706 (local address 127.26.185.60:36953)
0809 05:31:24.485289 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:24.485299 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:24.485452 (+ 153us) server_negotiation.cc:407] Connection header received
0809 05:31:24.485568 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:24.485574 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:24.485664 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:24.485769 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:24.486521 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.487560 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.488835 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.489576 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.489681 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:24.493946 (+ 4265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:24.493953 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:24.493959 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:24.493998 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:24.497842 (+ 3844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:24.498648 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:24.498656 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:24.498660 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:24.498832 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:24.499478 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:24.499487 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:24.499491 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:24.499883 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:24.500056 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:24.500587 (+ 531us) server_negotiation.cc:299] Negotiation successful
0809 05:31:24.501119 (+ 532us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":208,"server-negotiator.queue_time_us":71}
I20260809 05:31:24.504619 15847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:24.484156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59110 (local address 127.26.185.61:39055)
0809 05:31:24.484336 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:24.484343 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:24.484460 (+ 117us) server_negotiation.cc:407] Connection header received
0809 05:31:24.484695 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:24.484700 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:24.484791 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:24.484903 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:24.486859 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.487720 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.489366 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.489918 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.490046 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:24.496640 (+ 6594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:24.496647 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:24.496652 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:24.496690 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:24.500957 (+ 4267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:24.501964 (+ 1007us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:24.501973 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:24.501976 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:24.502156 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:24.502667 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:24.502672 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:24.502678 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:24.503129 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:24.503440 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:24.503912 (+ 472us) server_negotiation.cc:299] Negotiation successful
0809 05:31:24.504191 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 05:31:24.510479 15838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445: Bootstrap starting.
I20260809 05:31:24.511041 27364 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 05:31:24.511245 15732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:24.492014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:36953 (local address 127.0.0.1:55710)
0809 05:31:24.492362 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:24.492388 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:24.492508 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:24.493659 (+ 1151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:24.493664 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:24.494141 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:31:24.494359 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:24.494370 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.495884 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.495891 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:24.497344 (+ 1453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:24.497362 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.498465 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.498472 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:24.498827 (+ 355us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:24.499493 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:31:24.499515 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:31:24.502816 (+ 3301us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:31:24.507416 (+ 4600us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:24.507422 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:24.507426 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:24.508022 (+ 596us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:24.508549 (+ 527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:24.508557 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:24.508564 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:24.509411 (+ 847us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:24.510129 (+ 718us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:31:24.510134 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:31:24.510298 (+ 164us) client_negotiation.cc:769] Sending connection context
0809 05:31:24.510436 (+ 138us) client_negotiation.cc:240] Negotiation successful
0809 05:31:24.510810 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192}
I20260809 05:31:24.512411 15848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:24.492102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55710 (local address 127.26.185.60:36953)
0809 05:31:24.493230 (+ 1128us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:24.493237 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:24.493272 (+ 35us) server_negotiation.cc:407] Connection header received
0809 05:31:24.493343 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:24.493361 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:24.493452 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:24.493597 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:24.494573 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.495747 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.497493 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.498280 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.498408 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:24.503110 (+ 4702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:24.503117 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:24.503122 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:24.503158 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:24.507272 (+ 4114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:24.508164 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:24.508170 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:24.508174 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:24.508397 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:24.509578 (+ 1181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:24.509586 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:24.509592 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:24.509977 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:24.511640 (+ 1663us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:24.511758 (+ 118us) server_negotiation.cc:299] Negotiation successful
0809 05:31:24.511966 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":960,"thread_start_us":646,"threads_started":1}
I20260809 05:31:24.515661 15838 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445: Neither blocks nor log segments found. Creating new log.
I20260809 05:31:24.517284 15838 log.cc:824] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445: Log is configured to *not* fsync() on all Append() calls
I20260809 05:31:24.518941 15726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72599feb857c443d91ff5d0ee4d49dc8: Bootstrap starting.
I20260809 05:31:24.521800 15838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445: No bootstrap required, opened a new log
I20260809 05:31:24.523788 15726 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72599feb857c443d91ff5d0ee4d49dc8: Neither blocks nor log segments found. Creating new log.
I20260809 05:31:24.525281 15726 log.cc:824] T 00000000000000000000000000000000 P 72599feb857c443d91ff5d0ee4d49dc8: Log is configured to *not* fsync() on all Append() calls
I20260809 05:31:24.537738 15838 raft_consensus.cc:348] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "008d7f1f8ac04a20b7da00c2eb966f3d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42669 } } peers { permanent_uuid: "72599feb857c443d91ff5d0ee4d49dc8" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 39055 } } peers { permanent_uuid: "f75928c5501c440eb96bc21b5a6a3445" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } }
I20260809 05:31:24.538564 15838 raft_consensus.cc:374] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:31:24.538776 15838 raft_consensus.cc:729] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75928c5501c440eb96bc21b5a6a3445, State: Initialized, Role: FOLLOWER
I20260809 05:31:24.539906 15838 consensus_queue.cc:260] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "008d7f1f8ac04a20b7da00c2eb966f3d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42669 } } peers { permanent_uuid: "72599feb857c443d91ff5d0ee4d49dc8" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 39055 } } peers { permanent_uuid: "f75928c5501c440eb96bc21b5a6a3445" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } }
I20260809 05:31:24.541988 15726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72599feb857c443d91ff5d0ee4d49dc8: No bootstrap required, opened a new log
I20260809 05:31:24.543843 15863 sys_catalog.cc:455] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "008d7f1f8ac04a20b7da00c2eb966f3d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42669 } } peers { permanent_uuid: "72599feb857c443d91ff5d0ee4d49dc8" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 39055 } } peers { permanent_uuid: "f75928c5501c440eb96bc21b5a6a3445" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } } }
I20260809 05:31:24.544592 15863 sys_catalog.cc:458] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 05:31:24.545585 15838 sys_catalog.cc:564] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:31:24.553735 15846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:24.527159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47296 (local address 127.26.185.62:42669)
0809 05:31:24.527485 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:24.527495 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:24.528128 (+ 633us) server_negotiation.cc:407] Connection header received
0809 05:31:24.528605 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:24.528614 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:24.528736 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:24.528881 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:24.532181 (+ 3300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.533801 (+ 1620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.537950 (+ 4149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.538645 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.538807 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:24.544568 (+ 5761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:24.544579 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:24.544586 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:24.544646 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:24.549179 (+ 4533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:24.550429 (+ 1250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:24.550438 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:24.550444 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:24.550648 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:24.551278 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:24.551286 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:24.551292 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:24.551829 (+ 537us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:24.552138 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:24.552904 (+ 766us) server_negotiation.cc:299] Negotiation successful
0809 05:31:24.553244 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 05:31:24.555789 15614 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } attempt: 5
I20260809 05:31:24.564767 15726 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72599feb857c443d91ff5d0ee4d49dc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "008d7f1f8ac04a20b7da00c2eb966f3d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42669 } } peers { permanent_uuid: "72599feb857c443d91ff5d0ee4d49dc8" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 39055 } } peers { permanent_uuid: "f75928c5501c440eb96bc21b5a6a3445" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } }
I20260809 05:31:24.565470 15726 raft_consensus.cc:374] T 00000000000000000000000000000000 P 72599feb857c443d91ff5d0ee4d49dc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:31:24.565698 15726 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72599feb857c443d91ff5d0ee4d49dc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72599feb857c443d91ff5d0ee4d49dc8, State: Initialized, Role: FOLLOWER
Aug 09 05:31:24 dist-test-slave-h3ft krb5kdc[15500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253483, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for kudu/127.26.185.60@KRBTEST.COM
I20260809 05:31:24.566803 15726 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72599feb857c443d91ff5d0ee4d49dc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "008d7f1f8ac04a20b7da00c2eb966f3d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42669 } } peers { permanent_uuid: "72599feb857c443d91ff5d0ee4d49dc8" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 39055 } } peers { permanent_uuid: "f75928c5501c440eb96bc21b5a6a3445" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } }
I20260809 05:31:24.567874 15847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:24.529118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59116 (local address 127.26.185.61:39055)
0809 05:31:24.529347 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:24.529354 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:24.538522 (+ 9168us) server_negotiation.cc:407] Connection header received
0809 05:31:24.540741 (+ 2219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:24.540750 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:24.540868 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:24.540966 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:24.544959 (+ 3993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.546854 (+ 1895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.549426 (+ 2572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.550217 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.550351 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:24.554749 (+ 4398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:24.554757 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:24.554762 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:24.554815 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:24.561910 (+ 7095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:24.563278 (+ 1368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:24.563288 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:24.563296 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:24.563536 (+ 240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:24.564200 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:24.564209 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:24.564215 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:24.564815 (+ 600us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:24.565257 (+ 442us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:24.566836 (+ 1579us) server_negotiation.cc:299] Negotiation successful
0809 05:31:24.567273 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 05:31:24.571730 15869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72599feb857c443d91ff5d0ee4d49dc8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "008d7f1f8ac04a20b7da00c2eb966f3d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42669 } } peers { permanent_uuid: "72599feb857c443d91ff5d0ee4d49dc8" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 39055 } } peers { permanent_uuid: "f75928c5501c440eb96bc21b5a6a3445" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } } }
I20260809 05:31:24.574915 15869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72599feb857c443d91ff5d0ee4d49dc8 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 05:31:24.574776 15726 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72599feb857c443d91ff5d0ee4d49dc8 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:31:24.582585 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:24.556536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:36953 (local address 127.0.0.1:55734)
0809 05:31:24.557031 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:24.557055 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:24.557184 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:24.557875 (+ 691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:24.557883 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:24.558651 (+ 768us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:31:24.559041 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:24.559059 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.560592 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.560600 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:24.562152 (+ 1552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:24.562168 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.563465 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.563472 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:24.563644 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:24.564305 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:31:24.564340 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:31:24.567360 (+ 3020us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:31:24.577279 (+ 9919us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:24.577289 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:24.577296 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:24.578094 (+ 798us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:24.578713 (+ 619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:24.578722 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:24.578728 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:24.579035 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:24.581126 (+ 2091us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:31:24.581131 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:31:24.581340 (+ 209us) client_negotiation.cc:769] Sending connection context
0809 05:31:24.581495 (+ 155us) client_negotiation.cc:240] Negotiation successful
0809 05:31:24.581876 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337}
I20260809 05:31:24.587967 15848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:24.527874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55722 (local address 127.26.185.60:36953)
0809 05:31:24.528048 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:24.528054 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:24.534723 (+ 6669us) server_negotiation.cc:407] Connection header received
0809 05:31:24.534967 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:24.534973 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:24.535140 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:24.535262 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:24.543815 (+ 8553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.545003 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.555175 (+ 10172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.556210 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.556374 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:24.571406 (+ 15032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:24.571418 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:24.571427 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:24.571495 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:24.576501 (+ 5006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:24.584005 (+ 7504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:24.584014 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:24.584022 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:24.584229 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:24.585004 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:24.585013 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:24.585025 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:24.585622 (+ 597us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:24.586009 (+ 387us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:24.586937 (+ 928us) server_negotiation.cc:299] Negotiation successful
0809 05:31:24.587341 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 05:31:24.589903 15842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:24.556964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55734 (local address 127.26.185.60:36953)
0809 05:31:24.557198 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:24.557204 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:24.557224 (+ 20us) server_negotiation.cc:407] Connection header received
0809 05:31:24.557289 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:24.557294 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:24.557368 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:24.557480 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:24.559248 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.560392 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.562336 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:24.563084 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:24.563208 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:24.570070 (+ 6862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:24.570082 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:24.570091 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:24.570153 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:24.577048 (+ 6895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:24.578317 (+ 1269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:24.578325 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:24.578332 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:24.578537 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:24.579202 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:24.579208 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:24.579213 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:24.579881 (+ 668us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:24.583198 (+ 3317us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:24.583365 (+ 167us) server_negotiation.cc:299] Negotiation successful
0809 05:31:24.583672 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
W20260809 05:31:24.596621 15884 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 05:31:24.596777 15884 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 05:31:24.603953 15614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 008d7f1f8ac04a20b7da00c2eb966f3d: Bootstrap starting.
I20260809 05:31:24.596408 15623 master_runner.cc:186] Error getting master registration for 127.26.185.62:42669: OK, instance_id { permanent_uuid: "008d7f1f8ac04a20b7da00c2eb966f3d" instance_seqno: 1786253483110578 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 05:31:24.608588 15623 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 05:31:24.612262 15896 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 72599feb857c443d91ff5d0ee4d49dc8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 05:31:24.612562 15896 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 05:31:24.613793 15614 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 008d7f1f8ac04a20b7da00c2eb966f3d: Neither blocks nor log segments found. Creating new log.
I20260809 05:31:24.615479 15614 log.cc:824] T 00000000000000000000000000000000 P 008d7f1f8ac04a20b7da00c2eb966f3d: Log is configured to *not* fsync() on all Append() calls
I20260809 05:31:24.583812 15741 master_runner.cc:186] Error getting master registration for 127.26.185.62:42669: OK, instance_id { permanent_uuid: "008d7f1f8ac04a20b7da00c2eb966f3d" instance_seqno: 1786253483110578 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 05:31:24.616021 15741 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 05:31:24.621871 15614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 008d7f1f8ac04a20b7da00c2eb966f3d: No bootstrap required, opened a new log
I20260809 05:31:24.638466 15614 raft_consensus.cc:348] T 00000000000000000000000000000000 P 008d7f1f8ac04a20b7da00c2eb966f3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "008d7f1f8ac04a20b7da00c2eb966f3d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42669 } } peers { permanent_uuid: "72599feb857c443d91ff5d0ee4d49dc8" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 39055 } } peers { permanent_uuid: "f75928c5501c440eb96bc21b5a6a3445" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } }
I20260809 05:31:24.639122 15614 raft_consensus.cc:374] T 00000000000000000000000000000000 P 008d7f1f8ac04a20b7da00c2eb966f3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:31:24.639307 15614 raft_consensus.cc:729] T 00000000000000000000000000000000 P 008d7f1f8ac04a20b7da00c2eb966f3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 008d7f1f8ac04a20b7da00c2eb966f3d, State: Initialized, Role: FOLLOWER
I20260809 05:31:24.640316 15614 consensus_queue.cc:260] T 00000000000000000000000000000000 P 008d7f1f8ac04a20b7da00c2eb966f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "008d7f1f8ac04a20b7da00c2eb966f3d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42669 } } peers { permanent_uuid: "72599feb857c443d91ff5d0ee4d49dc8" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 39055 } } peers { permanent_uuid: "f75928c5501c440eb96bc21b5a6a3445" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } }
I20260809 05:31:24.641690 15899 sys_catalog.cc:455] T 00000000000000000000000000000000 P 008d7f1f8ac04a20b7da00c2eb966f3d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "008d7f1f8ac04a20b7da00c2eb966f3d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42669 } } peers { permanent_uuid: "72599feb857c443d91ff5d0ee4d49dc8" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 39055 } } peers { permanent_uuid: "f75928c5501c440eb96bc21b5a6a3445" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } } }
I20260809 05:31:24.642282 15899 sys_catalog.cc:458] T 00000000000000000000000000000000 P 008d7f1f8ac04a20b7da00c2eb966f3d [sys.catalog]: This master's current role is: FOLLOWER
I20260809 05:31:24.643778 15614 sys_catalog.cc:564] T 00000000000000000000000000000000 P 008d7f1f8ac04a20b7da00c2eb966f3d [sys.catalog]: configured and running, proceeding with master startup.
W20260809 05:31:24.645630 15772 tablet.cc:2369] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:31:24.678296 15518 master_runner.cc:263] No leader master found from master 008d7f1f8ac04a20b7da00c2eb966f3d
I20260809 05:31:24.678514 15518 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 05:31:24.679481 15920 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 008d7f1f8ac04a20b7da00c2eb966f3d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 05:31:24.679793 15920 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260809 05:31:24.730140 15656 tablet.cc:2369] T 00000000000000000000000000000000 P 72599feb857c443d91ff5d0ee4d49dc8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:31:24.812834 15863 raft_consensus.cc:482] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:31:24.813318 15863 raft_consensus.cc:504] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "008d7f1f8ac04a20b7da00c2eb966f3d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42669 } } peers { permanent_uuid: "72599feb857c443d91ff5d0ee4d49dc8" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 39055 } } peers { permanent_uuid: "f75928c5501c440eb96bc21b5a6a3445" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } }
I20260809 05:31:24.815477 15863 leader_election.cc:288] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 008d7f1f8ac04a20b7da00c2eb966f3d (127.26.185.62:42669), 72599feb857c443d91ff5d0ee4d49dc8 (127.26.185.61:39055)
I20260809 05:31:24.817140 15577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f75928c5501c440eb96bc21b5a6a3445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "008d7f1f8ac04a20b7da00c2eb966f3d" is_pre_election: true
I20260809 05:31:24.817965 15577 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 008d7f1f8ac04a20b7da00c2eb966f3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75928c5501c440eb96bc21b5a6a3445 in term 0.
I20260809 05:31:24.819977 15689 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f75928c5501c440eb96bc21b5a6a3445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72599feb857c443d91ff5d0ee4d49dc8" is_pre_election: true
I20260809 05:31:24.818982 15766 leader_election.cc:302] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 008d7f1f8ac04a20b7da00c2eb966f3d, f75928c5501c440eb96bc21b5a6a3445; no voters:
I20260809 05:31:24.821664 15689 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 72599feb857c443d91ff5d0ee4d49dc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75928c5501c440eb96bc21b5a6a3445 in term 0.
I20260809 05:31:24.828094 15863 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:31:24.828369 15863 raft_consensus.cc:482] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:31:24.828565 15863 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:31:24.832680 15863 raft_consensus.cc:504] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "008d7f1f8ac04a20b7da00c2eb966f3d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42669 } } peers { permanent_uuid: "72599feb857c443d91ff5d0ee4d49dc8" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 39055 } } peers { permanent_uuid: "f75928c5501c440eb96bc21b5a6a3445" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } }
I20260809 05:31:24.834229 15577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f75928c5501c440eb96bc21b5a6a3445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "008d7f1f8ac04a20b7da00c2eb966f3d"
I20260809 05:31:24.834542 15577 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 008d7f1f8ac04a20b7da00c2eb966f3d [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:31:24.838747 15577 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 008d7f1f8ac04a20b7da00c2eb966f3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75928c5501c440eb96bc21b5a6a3445 in term 1.
I20260809 05:31:24.839545 15766 leader_election.cc:302] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 008d7f1f8ac04a20b7da00c2eb966f3d, f75928c5501c440eb96bc21b5a6a3445; no voters:
I20260809 05:31:24.844430 15689 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f75928c5501c440eb96bc21b5a6a3445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72599feb857c443d91ff5d0ee4d49dc8"
I20260809 05:31:24.844771 15689 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72599feb857c443d91ff5d0ee4d49dc8 [term 0 FOLLOWER]: Advancing to term 1
W20260809 05:31:24.853600 15549 tablet.cc:2369] T 00000000000000000000000000000000 P 008d7f1f8ac04a20b7da00c2eb966f3d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:31:24.857460 15689 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 72599feb857c443d91ff5d0ee4d49dc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75928c5501c440eb96bc21b5a6a3445 in term 1.
I20260809 05:31:24.861156 15863 leader_election.cc:288] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445 [CANDIDATE]: Term 1 election: Requested vote from peers 008d7f1f8ac04a20b7da00c2eb966f3d (127.26.185.62:42669), 72599feb857c443d91ff5d0ee4d49dc8 (127.26.185.61:39055)
I20260809 05:31:24.861799 15863 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:31:24.862426 15863 raft_consensus.cc:686] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445 [term 1 LEADER]: Becoming Leader. State: Replica: f75928c5501c440eb96bc21b5a6a3445, State: Running, Role: LEADER
I20260809 05:31:24.864378 15863 consensus_queue.cc:237] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "008d7f1f8ac04a20b7da00c2eb966f3d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42669 } } peers { permanent_uuid: "72599feb857c443d91ff5d0ee4d49dc8" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 39055 } } peers { permanent_uuid: "f75928c5501c440eb96bc21b5a6a3445" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } }
I20260809 05:31:24.876971 15924 sys_catalog.cc:455] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f75928c5501c440eb96bc21b5a6a3445. Latest consensus state: current_term: 1 leader_uuid: "f75928c5501c440eb96bc21b5a6a3445" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "008d7f1f8ac04a20b7da00c2eb966f3d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42669 } } peers { permanent_uuid: "72599feb857c443d91ff5d0ee4d49dc8" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 39055 } } peers { permanent_uuid: "f75928c5501c440eb96bc21b5a6a3445" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } } }
I20260809 05:31:24.877645 15924 sys_catalog.cc:458] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445 [sys.catalog]: This master's current role is: LEADER
I20260809 05:31:24.890200 15929 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:31:24.893556 15929 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:31:24.918545 15689 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 72599feb857c443d91ff5d0ee4d49dc8 [term 1 FOLLOWER]: Refusing update from remote peer f75928c5501c440eb96bc21b5a6a3445: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:31:24.920173 15924 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72599feb857c443d91ff5d0ee4d49dc8" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 39055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:31:24.928714 15577 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 008d7f1f8ac04a20b7da00c2eb966f3d [term 1 FOLLOWER]: Refusing update from remote peer f75928c5501c440eb96bc21b5a6a3445: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:31:24.930001 15924 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445 [LEADER]: Connected to new peer: Peer: permanent_uuid: "008d7f1f8ac04a20b7da00c2eb966f3d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:31:24.965890 15899 sys_catalog.cc:455] T 00000000000000000000000000000000 P 008d7f1f8ac04a20b7da00c2eb966f3d [sys.catalog]: SysCatalogTable state changed. Reason: New leader f75928c5501c440eb96bc21b5a6a3445. Latest consensus state: current_term: 1 leader_uuid: "f75928c5501c440eb96bc21b5a6a3445" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "008d7f1f8ac04a20b7da00c2eb966f3d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42669 } } peers { permanent_uuid: "72599feb857c443d91ff5d0ee4d49dc8" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 39055 } } peers { permanent_uuid: "f75928c5501c440eb96bc21b5a6a3445" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } } }
I20260809 05:31:24.966267 15899 sys_catalog.cc:458] T 00000000000000000000000000000000 P 008d7f1f8ac04a20b7da00c2eb966f3d [sys.catalog]: This master's current role is: FOLLOWER
I20260809 05:31:24.969653 15869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72599feb857c443d91ff5d0ee4d49dc8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f75928c5501c440eb96bc21b5a6a3445. Latest consensus state: current_term: 1 leader_uuid: "f75928c5501c440eb96bc21b5a6a3445" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "008d7f1f8ac04a20b7da00c2eb966f3d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42669 } } peers { permanent_uuid: "72599feb857c443d91ff5d0ee4d49dc8" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 39055 } } peers { permanent_uuid: "f75928c5501c440eb96bc21b5a6a3445" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } } }
I20260809 05:31:24.969995 15869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72599feb857c443d91ff5d0ee4d49dc8 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 05:31:24.977581 15934 mvcc.cc:205] Tried to move back new op lower bound from 7316494274208989184 to 7316494274019622912. Current Snapshot: MvccSnapshot[applied={T|T < 7316494274208989184}]
I20260809 05:31:24.983887 15899 sys_catalog.cc:455] T 00000000000000000000000000000000 P 008d7f1f8ac04a20b7da00c2eb966f3d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f75928c5501c440eb96bc21b5a6a3445" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "008d7f1f8ac04a20b7da00c2eb966f3d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42669 } } peers { permanent_uuid: "72599feb857c443d91ff5d0ee4d49dc8" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 39055 } } peers { permanent_uuid: "f75928c5501c440eb96bc21b5a6a3445" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } } }
I20260809 05:31:24.984221 15899 sys_catalog.cc:458] T 00000000000000000000000000000000 P 008d7f1f8ac04a20b7da00c2eb966f3d [sys.catalog]: This master's current role is: FOLLOWER
I20260809 05:31:24.998234 15863 sys_catalog.cc:455] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f75928c5501c440eb96bc21b5a6a3445" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "008d7f1f8ac04a20b7da00c2eb966f3d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42669 } } peers { permanent_uuid: "72599feb857c443d91ff5d0ee4d49dc8" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 39055 } } peers { permanent_uuid: "f75928c5501c440eb96bc21b5a6a3445" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } } }
I20260809 05:31:24.998739 15863 sys_catalog.cc:458] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445 [sys.catalog]: This master's current role is: LEADER
I20260809 05:31:24.999099 15863 sys_catalog.cc:455] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f75928c5501c440eb96bc21b5a6a3445" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "008d7f1f8ac04a20b7da00c2eb966f3d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42669 } } peers { permanent_uuid: "72599feb857c443d91ff5d0ee4d49dc8" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 39055 } } peers { permanent_uuid: "f75928c5501c440eb96bc21b5a6a3445" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } } }
I20260809 05:31:24.999388 15863 sys_catalog.cc:458] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445 [sys.catalog]: This master's current role is: LEADER
I20260809 05:31:25.001094 15929 catalog_manager.cc:1347] Generated new cluster ID: 6b9b4dec741c44da9d7338fd95fae6d8
I20260809 05:31:25.001204 15929 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:31:25.007287 15869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72599feb857c443d91ff5d0ee4d49dc8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f75928c5501c440eb96bc21b5a6a3445" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "008d7f1f8ac04a20b7da00c2eb966f3d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42669 } } peers { permanent_uuid: "72599feb857c443d91ff5d0ee4d49dc8" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 39055 } } peers { permanent_uuid: "f75928c5501c440eb96bc21b5a6a3445" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 36953 } } }
I20260809 05:31:25.007622 15869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72599feb857c443d91ff5d0ee4d49dc8 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 05:31:25.028936 15929 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:31:25.035615 15929 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:31:25.075507 15929 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445: Generated new TSK 0
I20260809 05:31:25.077359 15929 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 05:31:25.615968 15896 catalog_manager.cc:1259] Loaded cluster ID: 6b9b4dec741c44da9d7338fd95fae6d8
I20260809 05:31:25.616154 15896 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 72599feb857c443d91ff5d0ee4d49dc8: loading cluster ID for follower catalog manager: success
I20260809 05:31:25.619253 15896 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 72599feb857c443d91ff5d0ee4d49dc8: acquiring CA information for follower catalog manager: success
I20260809 05:31:25.621465 15896 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 72599feb857c443d91ff5d0ee4d49dc8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 05:31:25.682592 15920 catalog_manager.cc:1259] Loaded cluster ID: 6b9b4dec741c44da9d7338fd95fae6d8
I20260809 05:31:25.682742 15920 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 008d7f1f8ac04a20b7da00c2eb966f3d: loading cluster ID for follower catalog manager: success
I20260809 05:31:25.685825 15920 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 008d7f1f8ac04a20b7da00c2eb966f3d: acquiring CA information for follower catalog manager: success
I20260809 05:31:25.688278 15920 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 008d7f1f8ac04a20b7da00c2eb966f3d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 05:31:25.720558 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 15518
I20260809 05:31:25.722374 15604 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:31:25.855831 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 15518
I20260809 05:31:25.904525 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 15623
I20260809 05:31:25.906319 15721 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:31:26.028509 15947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:26.027042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:42669 (local address 127.0.0.1:47300)
0809 05:31:26.027969 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:26.028179 (+ 210us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:42669: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":729,"thread_start_us":578,"threads_started":1}
W20260809 05:31:26.029021 15766 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.185.62:42669: connect: Connection refused (error 111)
I20260809 05:31:26.031308 15947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:26.030638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:42669 (local address 127.0.0.1:47314)
0809 05:31:26.030874 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:26.031000 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:42669: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260809 05:31:26.031728 15766 consensus_peers.cc:487] T 00000000000000000000000000000000 P f75928c5501c440eb96bc21b5a6a3445 -> Peer 008d7f1f8ac04a20b7da00c2eb966f3d (127.26.185.62:42669): Couldn't send request to peer 008d7f1f8ac04a20b7da00c2eb966f3d. Status: Network error: Client connection negotiation failed: client connection to 127.26.185.62:42669: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 05:31:26.060779 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 15623
I20260809 05:31:26.099597 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 15741
I20260809 05:31:26.101177 15828 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:31:26.229223 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 15741
2026-08-09T05:31:26Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (5468 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:31:26 dist-test-slave-h3ft krb5kdc[15953](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:31:26 dist-test-slave-h3ft krb5kdc[15953](info): set up 2 sockets
Aug 09 05:31:26 dist-test-slave-h3ft krb5kdc[15953](info): commencing operation
krb5kdc: starting...
W20260809 05:31:27.661731 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.371s user 0.000s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:31:27 dist-test-slave-h3ft krb5kdc[15953](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253487, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:31:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:31:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
I20260809 05:31:28.035465 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:32995
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:45121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:32995
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:31:28.464279 15975 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:31:28.464682 15975 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:31:28.464787 15975 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:31:28.473066 15975 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:31:28.473253 15975 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:31:28.473308 15975 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:31:28.473378 15975 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:31:28.473428 15975 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:31:28.485253 15975 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:45121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:32995
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:32995
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:31:28.487087 15975 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:31:28.488761 15975 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:31:28.504405 15982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:28.504455 15983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:28.504359 15986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:31:28.505366 15975 server_base.cc:1034] running on GCE node
I20260809 05:31:28.506394 15975 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:31:28.508430 15975 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:31:28.509663 15975 hybrid_clock.cc:648] HybridClock initialized: now 1786253488509584 us; error 62 us; skew 500 ppm
I20260809 05:31:28.510107 15975 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:31:28 dist-test-slave-h3ft krb5kdc[15953](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253488, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:31:28.519634 15975 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:31:28.521791 15975 webserver.cc:460] Webserver started at http://127.26.185.62:37939/ using document root <none> and password file <none>
I20260809 05:31:28.522780 15975 fs_manager.cc:359] Metadata directory not provided
I20260809 05:31:28.522930 15975 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:31:28.523380 15975 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:31:28.527253 15975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "833eb642bab24e1781044e06e408ff17"
format_stamp: "Formatted at 2026-08-09 05:31:28 on dist-test-slave-h3ft"
server_key: "8bb9628846fab9377ef632e857ebc619"
server_key_iv: "779d98215af1e6f9c228cc1acfee873e"
server_key_version: "encryptionkey@0"
I20260809 05:31:28.528177 15975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "833eb642bab24e1781044e06e408ff17"
format_stamp: "Formatted at 2026-08-09 05:31:28 on dist-test-slave-h3ft"
server_key: "8bb9628846fab9377ef632e857ebc619"
server_key_iv: "779d98215af1e6f9c228cc1acfee873e"
server_key_version: "encryptionkey@0"
I20260809 05:31:28.534933 15975 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260809 05:31:28.539398 15997 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:28.541133 15975 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 05:31:28.541380 15975 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "833eb642bab24e1781044e06e408ff17"
format_stamp: "Formatted at 2026-08-09 05:31:28 on dist-test-slave-h3ft"
server_key: "8bb9628846fab9377ef632e857ebc619"
server_key_iv: "779d98215af1e6f9c228cc1acfee873e"
server_key_version: "encryptionkey@0"
I20260809 05:31:28.541646 15975 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:31:28.573918 15975 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:31:28.579941 15975 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:31:28.580346 15975 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:31:28.603991 15975 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:32995
I20260809 05:31:28.604099 16070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:32995 every 8 connection(s)
I20260809 05:31:28.605844 15975 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:31:28.610870 16071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:31:28.615957 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 15975
I20260809 05:31:28.616271 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:31:28.617019 27364 external_mini_cluster.cc:1428] Setting key a19348a26cd0931d54dc18c27dc1ec33
I20260809 05:31:28.626027 16071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 833eb642bab24e1781044e06e408ff17: Bootstrap starting.
I20260809 05:31:28.630566 16071 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 833eb642bab24e1781044e06e408ff17: Neither blocks nor log segments found. Creating new log.
I20260809 05:31:28.632017 16071 log.cc:824] T 00000000000000000000000000000000 P 833eb642bab24e1781044e06e408ff17: Log is configured to *not* fsync() on all Append() calls
I20260809 05:31:28.635947 16071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 833eb642bab24e1781044e06e408ff17: No bootstrap required, opened a new log
Aug 09 05:31:28 dist-test-slave-h3ft krb5kdc[15953](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253487, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:31:28.645401 16071 raft_consensus.cc:348] T 00000000000000000000000000000000 P 833eb642bab24e1781044e06e408ff17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "833eb642bab24e1781044e06e408ff17" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 32995 } }
I20260809 05:31:28.646135 16071 raft_consensus.cc:374] T 00000000000000000000000000000000 P 833eb642bab24e1781044e06e408ff17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:31:28.646289 16071 raft_consensus.cc:729] T 00000000000000000000000000000000 P 833eb642bab24e1781044e06e408ff17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 833eb642bab24e1781044e06e408ff17, State: Initialized, Role: FOLLOWER
I20260809 05:31:28.647233 16071 consensus_queue.cc:260] T 00000000000000000000000000000000 P 833eb642bab24e1781044e06e408ff17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "833eb642bab24e1781044e06e408ff17" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 32995 } }
I20260809 05:31:28.647579 16071 raft_consensus.cc:388] T 00000000000000000000000000000000 P 833eb642bab24e1781044e06e408ff17 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:31:28.647670 16079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:28.619454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52350 (local address 127.26.185.62:32995)
0809 05:31:28.620451 (+ 997us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:28.620482 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:28.620546 (+ 64us) server_negotiation.cc:407] Connection header received
0809 05:31:28.623883 (+ 3337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:28.623923 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:28.624566 (+ 643us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:28.625099 (+ 533us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:28.627129 (+ 2030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:28.629422 (+ 2293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:28.631372 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:28.632373 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:28.632661 (+ 288us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:28.637942 (+ 5281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:28.637952 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:28.637974 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:28.638029 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:28.641834 (+ 3805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:28.642849 (+ 1015us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:28.642857 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:28.642866 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:28.643169 (+ 303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:28.643637 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:28.643649 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:28.643651 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:28.644404 (+ 753us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:28.644752 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:28.645316 (+ 564us) server_negotiation.cc:299] Negotiation successful
0809 05:31:28.645944 (+ 628us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":687,"thread_start_us":416,"threads_started":1}
I20260809 05:31:28.647776 16071 raft_consensus.cc:482] T 00000000000000000000000000000000 P 833eb642bab24e1781044e06e408ff17 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:31:28.648041 16071 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 833eb642bab24e1781044e06e408ff17 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:31:28.651413 16071 raft_consensus.cc:504] T 00000000000000000000000000000000 P 833eb642bab24e1781044e06e408ff17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "833eb642bab24e1781044e06e408ff17" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 32995 } }
I20260809 05:31:28.652160 16071 leader_election.cc:302] T 00000000000000000000000000000000 P 833eb642bab24e1781044e06e408ff17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 833eb642bab24e1781044e06e408ff17; no voters:
I20260809 05:31:28.652961 16071 leader_election.cc:288] T 00000000000000000000000000000000 P 833eb642bab24e1781044e06e408ff17 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:31:28.653122 16082 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 833eb642bab24e1781044e06e408ff17 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:31:28.653196 27364 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 05:31:28.655366 16082 raft_consensus.cc:686] T 00000000000000000000000000000000 P 833eb642bab24e1781044e06e408ff17 [term 1 LEADER]: Becoming Leader. State: Replica: 833eb642bab24e1781044e06e408ff17, State: Running, Role: LEADER
I20260809 05:31:28.655853 16071 sys_catalog.cc:564] T 00000000000000000000000000000000 P 833eb642bab24e1781044e06e408ff17 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:31:28.656162 16082 consensus_queue.cc:237] T 00000000000000000000000000000000 P 833eb642bab24e1781044e06e408ff17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "833eb642bab24e1781044e06e408ff17" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 32995 } }
I20260809 05:31:28.661159 16083 sys_catalog.cc:455] T 00000000000000000000000000000000 P 833eb642bab24e1781044e06e408ff17 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "833eb642bab24e1781044e06e408ff17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "833eb642bab24e1781044e06e408ff17" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 32995 } } }
I20260809 05:31:28.661123 16084 sys_catalog.cc:455] T 00000000000000000000000000000000 P 833eb642bab24e1781044e06e408ff17 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 833eb642bab24e1781044e06e408ff17. Latest consensus state: current_term: 1 leader_uuid: "833eb642bab24e1781044e06e408ff17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "833eb642bab24e1781044e06e408ff17" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 32995 } } }
I20260809 05:31:28.661677 16084 sys_catalog.cc:458] T 00000000000000000000000000000000 P 833eb642bab24e1781044e06e408ff17 [sys.catalog]: This master's current role is: LEADER
I20260809 05:31:28.661674 16083 sys_catalog.cc:458] T 00000000000000000000000000000000 P 833eb642bab24e1781044e06e408ff17 [sys.catalog]: This master's current role is: LEADER
I20260809 05:31:28.662699 16095 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:31:28.669142 16095 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:31:28.679998 16095 catalog_manager.cc:1347] Generated new cluster ID: d6293debdd2a4aeba70ecbaa8b230e00
I20260809 05:31:28.680190 16095 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:31:28.694269 16095 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:31:28.696045 16095 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:31:28.704478 16095 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 833eb642bab24e1781044e06e408ff17: Generated new TSK 0
I20260809 05:31:28.705668 16095 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 05:31:28.717244 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 15975
I20260809 05:31:28.718761 16064 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:31:28.822285 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 15975
2026-08-09T05:31:28Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2589 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:31:28 dist-test-slave-h3ft krb5kdc[16122](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:31:28 dist-test-slave-h3ft krb5kdc[16122](info): set up 2 sockets
Aug 09 05:31:28 dist-test-slave-h3ft krb5kdc[16122](info): commencing operation
krb5kdc: starting...
W20260809 05:31:30.246013 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.366s user 0.001s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:31:30 dist-test-slave-h3ft krb5kdc[16122](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253490, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:31:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:31:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
I20260809 05:31:30.609067 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:33231
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:40013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:33231
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:31:31.034641 16139 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:31:31.035195 16139 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:31:31.035382 16139 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:31:31.043774 16139 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:31:31.043931 16139 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:31:31.044015 16139 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:31:31.044116 16139 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:31:31.044179 16139 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:31:31.055716 16139 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:40013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:33231
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:33231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:31:31.057644 16139 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:31:31.059445 16139 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:31:31.073742 16149 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:31.073760 16150 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:31.073797 16152 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:31:31.074824 16139 server_base.cc:1034] running on GCE node
I20260809 05:31:31.075829 16139 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:31:31.077633 16139 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:31:31.078891 16139 hybrid_clock.cc:648] HybridClock initialized: now 1786253491078822 us; error 48 us; skew 500 ppm
I20260809 05:31:31.079368 16139 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:31:31 dist-test-slave-h3ft krb5kdc[16122](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253491, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:31:31.083392 16139 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:31:31.085759 16139 webserver.cc:460] Webserver started at http://127.26.185.62:35827/ using document root <none> and password file <none>
I20260809 05:31:31.086673 16139 fs_manager.cc:359] Metadata directory not provided
I20260809 05:31:31.086844 16139 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:31:31.087291 16139 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:31:31.091197 16139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "e32ace97d3124854a30475fb4cb2feb7"
format_stamp: "Formatted at 2026-08-09 05:31:31 on dist-test-slave-h3ft"
server_key: "3447aef745b241fd293d43556db3aee4"
server_key_iv: "fb9667ad3e14e98658d3735394b53537"
server_key_version: "encryptionkey@0"
I20260809 05:31:31.092168 16139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "e32ace97d3124854a30475fb4cb2feb7"
format_stamp: "Formatted at 2026-08-09 05:31:31 on dist-test-slave-h3ft"
server_key: "3447aef745b241fd293d43556db3aee4"
server_key_iv: "fb9667ad3e14e98658d3735394b53537"
server_key_version: "encryptionkey@0"
I20260809 05:31:31.098778 16139 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260809 05:31:31.103163 16160 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:31.104857 16139 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 05:31:31.105099 16139 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "e32ace97d3124854a30475fb4cb2feb7"
format_stamp: "Formatted at 2026-08-09 05:31:31 on dist-test-slave-h3ft"
server_key: "3447aef745b241fd293d43556db3aee4"
server_key_iv: "fb9667ad3e14e98658d3735394b53537"
server_key_version: "encryptionkey@0"
I20260809 05:31:31.105348 16139 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:31:31.139663 16139 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:31:31.145252 16139 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:31:31.145637 16139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:31:31.169059 16139 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:33231
I20260809 05:31:31.169095 16240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:33231 every 8 connection(s)
I20260809 05:31:31.170789 16139 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:31:31.175549 16241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:31:31.177978 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 16139
I20260809 05:31:31.178260 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:31:31.179284 27364 external_mini_cluster.cc:1428] Setting key 1e6d84dd6f986bd70317697f479984ce
I20260809 05:31:31.190613 16241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7: Bootstrap starting.
I20260809 05:31:31.195335 16241 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7: Neither blocks nor log segments found. Creating new log.
Aug 09 05:31:31 dist-test-slave-h3ft krb5kdc[16122](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253490, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:31:31.196746 16241 log.cc:824] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7: Log is configured to *not* fsync() on all Append() calls
I20260809 05:31:31.200441 16241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7: No bootstrap required, opened a new log
I20260809 05:31:31.206319 16244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:31.181967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57210 (local address 127.26.185.62:33231)
0809 05:31:31.183040 (+ 1073us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:31.183061 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:31.183128 (+ 67us) server_negotiation.cc:407] Connection header received
0809 05:31:31.185054 (+ 1926us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:31.185083 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:31.185546 (+ 463us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:31.185945 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:31.188053 (+ 2108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:31.189484 (+ 1431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:31.191508 (+ 2024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:31.192217 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:31.192361 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:31.197971 (+ 5610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:31.197981 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:31.198001 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:31.198045 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:31.201609 (+ 3564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:31.202384 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:31.202391 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:31.202401 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:31.202596 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:31.203052 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:31.203059 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:31.203067 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:31.203721 (+ 654us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:31.204142 (+ 421us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:31.204607 (+ 465us) server_negotiation.cc:299] Negotiation successful
0809 05:31:31.205110 (+ 503us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":737,"thread_start_us":490,"threads_started":1}
I20260809 05:31:31.210028 16241 raft_consensus.cc:348] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e32ace97d3124854a30475fb4cb2feb7" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33231 } }
I20260809 05:31:31.210490 16241 raft_consensus.cc:374] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:31:31.210620 16241 raft_consensus.cc:729] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ace97d3124854a30475fb4cb2feb7, State: Initialized, Role: FOLLOWER
I20260809 05:31:31.211396 16241 consensus_queue.cc:260] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e32ace97d3124854a30475fb4cb2feb7" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33231 } }
I20260809 05:31:31.211678 16241 raft_consensus.cc:388] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:31:31.211839 16241 raft_consensus.cc:482] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:31:31.212033 16241 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:31:31.214497 16241 raft_consensus.cc:504] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e32ace97d3124854a30475fb4cb2feb7" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33231 } }
I20260809 05:31:31.215133 16241 leader_election.cc:302] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e32ace97d3124854a30475fb4cb2feb7; no voters:
I20260809 05:31:31.215894 16241 leader_election.cc:288] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:31:31.216064 16246 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:31:31.218485 16246 raft_consensus.cc:686] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [term 1 LEADER]: Becoming Leader. State: Replica: e32ace97d3124854a30475fb4cb2feb7, State: Running, Role: LEADER
I20260809 05:31:31.218700 16241 sys_catalog.cc:564] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:31:31.219183 16246 consensus_queue.cc:237] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e32ace97d3124854a30475fb4cb2feb7" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33231 } }
I20260809 05:31:31.225194 16247 sys_catalog.cc:455] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e32ace97d3124854a30475fb4cb2feb7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e32ace97d3124854a30475fb4cb2feb7" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33231 } } }
I20260809 05:31:31.225157 16248 sys_catalog.cc:455] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e32ace97d3124854a30475fb4cb2feb7. Latest consensus state: current_term: 1 leader_uuid: "e32ace97d3124854a30475fb4cb2feb7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e32ace97d3124854a30475fb4cb2feb7" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33231 } } }
I20260809 05:31:31.225641 16247 sys_catalog.cc:458] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [sys.catalog]: This master's current role is: LEADER
I20260809 05:31:31.225661 16248 sys_catalog.cc:458] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [sys.catalog]: This master's current role is: LEADER
I20260809 05:31:31.228459 16261 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:31:31.234373 16261 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:31:31.245774 16261 catalog_manager.cc:1347] Generated new cluster ID: 010314fd7bd742748a0c90bbcb34ecf5
I20260809 05:31:31.245972 16261 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:31:31.272982 16261 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:31:31.274700 16261 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:31:31.287640 16261 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7: Generated new TSK 0
I20260809 05:31:31.288898 16261 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.185.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
I20260809 05:31:31.391439 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:0
--local_ip_for_outbound_sockets=127.26.185.1
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:33231
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:40013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:31:31.815801 16270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:31:31.816286 16270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:31:31.816488 16270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:31:31.825202 16270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:31:31.825400 16270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:31:31.825611 16270 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:31:31.836628 16270 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:40013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:33231
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:31:31.838469 16270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:31:31.840274 16270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:31:31.856666 16281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:31.856603 16279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:31.856978 16276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:31:31.857728 16270 server_base.cc:1034] running on GCE node
I20260809 05:31:31.858604 16270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:31:31.859927 16270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:31:31.861253 16270 hybrid_clock.cc:648] HybridClock initialized: now 1786253491861192 us; error 67 us; skew 500 ppm
I20260809 05:31:31.861717 16270 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:31:31 dist-test-slave-h3ft krb5kdc[16122](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253491, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:31:31.865866 16270 init.cc:377] Logged in from keytab as kudu/127.26.185.1@KRBTEST.COM (short username kudu)
I20260809 05:31:31.867820 16270 webserver.cc:460] Webserver started at http://127.26.185.1:35803/ using document root <none> and password file <none>
I20260809 05:31:31.868682 16270 fs_manager.cc:359] Metadata directory not provided
I20260809 05:31:31.868827 16270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:31:31.869218 16270 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:31:31.872929 16270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/data/instance:
uuid: "dbc74c333bd14948bd793098886ccf1d"
format_stamp: "Formatted at 2026-08-09 05:31:31 on dist-test-slave-h3ft"
server_key: "a5bee64724adbd30aedb81de707c72b0"
server_key_iv: "35acc289eecc04a2f69292ef269aa998"
server_key_version: "encryptionkey@0"
I20260809 05:31:31.873844 16270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance:
uuid: "dbc74c333bd14948bd793098886ccf1d"
format_stamp: "Formatted at 2026-08-09 05:31:31 on dist-test-slave-h3ft"
server_key: "a5bee64724adbd30aedb81de707c72b0"
server_key_iv: "35acc289eecc04a2f69292ef269aa998"
server_key_version: "encryptionkey@0"
I20260809 05:31:31.880151 16270 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260809 05:31:31.884497 16288 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:31.886401 16270 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.004s
I20260809 05:31:31.886649 16270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "dbc74c333bd14948bd793098886ccf1d"
format_stamp: "Formatted at 2026-08-09 05:31:31 on dist-test-slave-h3ft"
server_key: "a5bee64724adbd30aedb81de707c72b0"
server_key_iv: "35acc289eecc04a2f69292ef269aa998"
server_key_version: "encryptionkey@0"
I20260809 05:31:31.886981 16270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:31:31.906363 16270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:31:31.912470 16270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:31:31.912866 16270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:31:31.914088 16270 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:31:31.915844 16270 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:31:31.915927 16270 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:31.916108 16270 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:31:31.916172 16270 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:31.955343 16270 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:33909
I20260809 05:31:31.955381 16461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:33909 every 8 connection(s)
I20260809 05:31:31.957067 16270 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:31:31.963598 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 16270
I20260809 05:31:31.963899 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance
I20260809 05:31:31.964812 27364 external_mini_cluster.cc:1428] Setting key 8f94cc6d0e87971a84f1abf45a56589a
Aug 09 05:31:31 dist-test-slave-h3ft krb5kdc[16122](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253491, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:31:31.982657 16464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:31.960450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:36063 (local address 127.26.185.62:33231)
0809 05:31:31.961050 (+ 600us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:31.961060 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:31.962221 (+ 1161us) server_negotiation.cc:407] Connection header received
0809 05:31:31.964486 (+ 2265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:31.964495 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:31.964617 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:31.964769 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:31.967090 (+ 2321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:31.967977 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:31.969837 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:31.970319 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:31.970510 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:31.975585 (+ 5075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:31.975594 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:31.975598 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:31.975647 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:31.978758 (+ 3111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:31.979788 (+ 1030us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:31.979793 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:31.979796 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:31.979943 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:31.980484 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:31.980488 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:31.980490 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:31.980825 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:31.981006 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:31.981902 (+ 896us) server_negotiation.cc:299] Negotiation successful
0809 05:31:31.982206 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":434,"thread_start_us":275,"threads_started":1}
I20260809 05:31:31.984040 16465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:31.961115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.1:36063)
0809 05:31:31.962017 (+ 902us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:31.962064 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:31.964149 (+ 2085us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:31.965206 (+ 1057us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:31.965216 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:31.966068 (+ 852us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:31:31.966846 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:31.966870 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:31.968190 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:31.968196 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:31.969641 (+ 1445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:31.969657 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:31.970619 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:31.970630 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:31.970952 (+ 322us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:31.971988 (+ 1036us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:31:31.972018 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:31:31.975241 (+ 3223us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:31:31.978986 (+ 3745us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:31.979051 (+ 65us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:31.979079 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:31.979623 (+ 544us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:31.980070 (+ 447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:31.980076 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:31.980080 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:31.980333 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:31.980977 (+ 644us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:31:31.980987 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:31:31.981459 (+ 472us) client_negotiation.cc:769] Sending connection context
0809 05:31:31.981779 (+ 320us) client_negotiation.cc:240] Negotiation successful
0809 05:31:31.982516 (+ 737us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":325,"threads_started":1}
I20260809 05:31:31.986219 16462 heartbeater.cc:347] Connected to a master server at 127.26.185.62:33231
I20260809 05:31:31.986630 16462 heartbeater.cc:464] Registering TS with master...
I20260809 05:31:31.987721 16462 heartbeater.cc:511] Master 127.26.185.62:33231 requested a full tablet report, sending...
I20260809 05:31:31.990880 16190 ts_manager.cc:194] Registered new tserver with Master: dbc74c333bd14948bd793098886ccf1d (127.26.185.1:33909)
I20260809 05:31:31.993453 16190 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.1@KRBTEST.COM'} at 127.26.185.1:36063
WARNING: no policy specified for kudu/127.26.185.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
I20260809 05:31:32.047823 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:0
--local_ip_for_outbound_sockets=127.26.185.2
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:33231
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:40013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:31:32.474676 16470 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:31:32.475168 16470 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:31:32.475363 16470 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:31:32.483673 16470 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:31:32.483889 16470 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:31:32.484086 16470 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:31:32.496063 16470 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:40013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:33231
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:31:32.497910 16470 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:31:32.499763 16470 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:31:32.516975 16487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:32.517025 16483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:32.517086 16480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:31:32.523528 16470 server_base.cc:1034] running on GCE node
I20260809 05:31:32.524555 16470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:31:32.525913 16470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:31:32.527199 16470 hybrid_clock.cc:648] HybridClock initialized: now 1786253492527115 us; error 72 us; skew 500 ppm
I20260809 05:31:32.527611 16470 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:31:32 dist-test-slave-h3ft krb5kdc[16122](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253492, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:31:32.531949 16470 init.cc:377] Logged in from keytab as kudu/127.26.185.2@KRBTEST.COM (short username kudu)
I20260809 05:31:32.533962 16470 webserver.cc:460] Webserver started at http://127.26.185.2:34231/ using document root <none> and password file <none>
I20260809 05:31:32.534916 16470 fs_manager.cc:359] Metadata directory not provided
I20260809 05:31:32.535097 16470 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:31:32.535431 16470 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:31:32.539211 16470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/data/instance:
uuid: "13af1af05d3744488ea095a59decebdf"
format_stamp: "Formatted at 2026-08-09 05:31:32 on dist-test-slave-h3ft"
server_key: "82d3be9727785a3ec15dda6e4a7e9cce"
server_key_iv: "34617f1ee9da555a309c05a93c4c5308"
server_key_version: "encryptionkey@0"
I20260809 05:31:32.540124 16470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance:
uuid: "13af1af05d3744488ea095a59decebdf"
format_stamp: "Formatted at 2026-08-09 05:31:32 on dist-test-slave-h3ft"
server_key: "82d3be9727785a3ec15dda6e4a7e9cce"
server_key_iv: "34617f1ee9da555a309c05a93c4c5308"
server_key_version: "encryptionkey@0"
I20260809 05:31:32.546746 16470 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.005s
I20260809 05:31:32.551364 16496 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:32.553179 16470 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 05:31:32.553413 16470 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "13af1af05d3744488ea095a59decebdf"
format_stamp: "Formatted at 2026-08-09 05:31:32 on dist-test-slave-h3ft"
server_key: "82d3be9727785a3ec15dda6e4a7e9cce"
server_key_iv: "34617f1ee9da555a309c05a93c4c5308"
server_key_version: "encryptionkey@0"
I20260809 05:31:32.553697 16470 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:31:32.615640 16470 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:31:32.621086 16470 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:31:32.621501 16470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:31:32.622853 16470 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:31:32.624586 16470 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:31:32.624701 16470 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:32.624868 16470 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:31:32.624944 16470 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:32.665678 16470 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:45545
I20260809 05:31:32.665719 16669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:45545 every 8 connection(s)
I20260809 05:31:32.667493 16470 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:31:32.669718 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 16470
I20260809 05:31:32.669970 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance
I20260809 05:31:32.670673 27364 external_mini_cluster.cc:1428] Setting key a8f994bd0d527014eb77f0446054b6e4
Aug 09 05:31:32 dist-test-slave-h3ft krb5kdc[16122](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253492, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:31:32.698954 16675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:32.671427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:36325 (local address 127.26.185.62:33231)
0809 05:31:32.672100 (+ 673us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:32.672108 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:32.673468 (+ 1360us) server_negotiation.cc:407] Connection header received
0809 05:31:32.677071 (+ 3603us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:32.677076 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:32.677160 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:32.677277 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:32.680167 (+ 2890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:32.681076 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:32.684231 (+ 3155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:32.684721 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:32.684843 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:32.690648 (+ 5805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:32.690660 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:32.690668 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:32.690738 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:32.694546 (+ 3808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:32.695910 (+ 1364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:32.695914 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:32.695917 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:32.696071 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:32.696688 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:32.696692 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:32.696694 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:32.697069 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:32.697211 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:32.698386 (+ 1175us) server_negotiation.cc:299] Negotiation successful
0809 05:31:32.698613 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":492,"thread_start_us":310,"threads_started":1}
I20260809 05:31:32.701169 16676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:32.672154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.2:36325)
0809 05:31:32.673265 (+ 1111us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:32.673329 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:32.676625 (+ 3296us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:32.677670 (+ 1045us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:32.677687 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:32.678716 (+ 1029us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:31:32.679900 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:32.679938 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:32.681275 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:32.681285 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:32.684034 (+ 2749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:32.684056 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:32.685029 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:32.685040 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:32.685449 (+ 409us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:32.686502 (+ 1053us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:31:32.686559 (+ 57us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:31:32.690222 (+ 3663us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:31:32.694749 (+ 4527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:32.694764 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:32.694792 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:32.695746 (+ 954us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:32.696195 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:32.696203 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:32.696209 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:32.696543 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:32.697235 (+ 692us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:31:32.697248 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:31:32.697877 (+ 629us) client_negotiation.cc:769] Sending connection context
0809 05:31:32.698277 (+ 400us) client_negotiation.cc:240] Negotiation successful
0809 05:31:32.699111 (+ 834us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":743,"thread_start_us":419,"threads_started":1}
I20260809 05:31:32.703363 16670 heartbeater.cc:347] Connected to a master server at 127.26.185.62:33231
I20260809 05:31:32.703832 16670 heartbeater.cc:464] Registering TS with master...
I20260809 05:31:32.704903 16670 heartbeater.cc:511] Master 127.26.185.62:33231 requested a full tablet report, sending...
I20260809 05:31:32.707084 16190 ts_manager.cc:194] Registered new tserver with Master: 13af1af05d3744488ea095a59decebdf (127.26.185.2:45545)
I20260809 05:31:32.708166 16190 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.2@KRBTEST.COM'} at 127.26.185.2:36325
WARNING: no policy specified for kudu/127.26.185.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
I20260809 05:31:32.763358 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:0
--local_ip_for_outbound_sockets=127.26.185.3
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:33231
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:40013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:31:32.997802 16462 heartbeater.cc:503] Master 127.26.185.62:33231 was elected leader, sending a full tablet report...
W20260809 05:31:33.189281 16680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:31:33.189816 16680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:31:33.190021 16680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:31:33.198056 16680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:31:33.198235 16680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:31:33.198441 16680 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:31:33.209478 16680 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:40013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:33231
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:31:33.211428 16680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:31:33.213193 16680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:31:33.229542 16688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:33.229640 16692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:33.229543 16690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:31:33.230685 16680 server_base.cc:1034] running on GCE node
I20260809 05:31:33.231527 16680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:31:33.232692 16680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:31:33.233958 16680 hybrid_clock.cc:648] HybridClock initialized: now 1786253493233827 us; error 75 us; skew 500 ppm
I20260809 05:31:33.234351 16680 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:31:33 dist-test-slave-h3ft krb5kdc[16122](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253493, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:31:33.238583 16680 init.cc:377] Logged in from keytab as kudu/127.26.185.3@KRBTEST.COM (short username kudu)
I20260809 05:31:33.240423 16680 webserver.cc:460] Webserver started at http://127.26.185.3:37235/ using document root <none> and password file <none>
I20260809 05:31:33.241436 16680 fs_manager.cc:359] Metadata directory not provided
I20260809 05:31:33.241562 16680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:31:33.241889 16680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:31:33.245770 16680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/data/instance:
uuid: "4e86b85cbc8a45acbc2d45bab4869284"
format_stamp: "Formatted at 2026-08-09 05:31:33 on dist-test-slave-h3ft"
server_key: "97483419748416474696408a8083d121"
server_key_iv: "8bb305ce598b516080817f21008f2afb"
server_key_version: "encryptionkey@0"
I20260809 05:31:33.246693 16680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance:
uuid: "4e86b85cbc8a45acbc2d45bab4869284"
format_stamp: "Formatted at 2026-08-09 05:31:33 on dist-test-slave-h3ft"
server_key: "97483419748416474696408a8083d121"
server_key_iv: "8bb305ce598b516080817f21008f2afb"
server_key_version: "encryptionkey@0"
I20260809 05:31:33.253777 16680 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20260809 05:31:33.258456 16701 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:33.260440 16680 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:31:33.260694 16680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "4e86b85cbc8a45acbc2d45bab4869284"
format_stamp: "Formatted at 2026-08-09 05:31:33 on dist-test-slave-h3ft"
server_key: "97483419748416474696408a8083d121"
server_key_iv: "8bb305ce598b516080817f21008f2afb"
server_key_version: "encryptionkey@0"
I20260809 05:31:33.260963 16680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:31:33.285712 16680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:31:33.291594 16680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:31:33.291983 16680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:31:33.293452 16680 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:31:33.295258 16680 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:31:33.295367 16680 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:33.295526 16680 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:31:33.295603 16680 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:33.334491 16680 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:35673
I20260809 05:31:33.334556 16872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:35673 every 8 connection(s)
I20260809 05:31:33.336158 16680 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:31:33.343180 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 16680
I20260809 05:31:33.343431 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance
I20260809 05:31:33.344026 27364 external_mini_cluster.cc:1428] Setting key bd621e335eae3c6d6cbc6aa0aaa9fb0b
Aug 09 05:31:33 dist-test-slave-h3ft krb5kdc[16122](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253493, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:31:33.362066 16875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:33.339742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:57293 (local address 127.26.185.62:33231)
0809 05:31:33.340493 (+ 751us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:33.340498 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:33.341636 (+ 1138us) server_negotiation.cc:407] Connection header received
0809 05:31:33.344041 (+ 2405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:33.344048 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:33.344187 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:33.344367 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:33.346884 (+ 2517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.348155 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.349878 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.350324 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.350450 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:33.354602 (+ 4152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:33.354607 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:33.354610 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:33.354649 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:33.357556 (+ 2907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:33.358584 (+ 1028us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:33.358590 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:33.358595 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:33.358759 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:33.359403 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:33.359410 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:33.359414 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:33.359913 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:33.360113 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:33.361407 (+ 1294us) server_negotiation.cc:299] Negotiation successful
0809 05:31:33.361711 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":430,"threads_started":1}
I20260809 05:31:33.363555 16877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:33.340494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.3:57293)
0809 05:31:33.341415 (+ 921us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:33.341480 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:33.343694 (+ 2214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:33.344830 (+ 1136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:33.344842 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:33.345737 (+ 895us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:31:33.346694 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:33.346719 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.348311 (+ 1592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.348315 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:33.349726 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:33.349741 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.350557 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.350562 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:33.350792 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:33.351733 (+ 941us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:31:33.351759 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:31:33.354367 (+ 2608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:31:33.357708 (+ 3341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:33.357717 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:33.357734 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:33.358444 (+ 710us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:33.358929 (+ 485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:33.358933 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:33.358936 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:33.359247 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:33.360081 (+ 834us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:31:33.360089 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:31:33.360781 (+ 692us) client_negotiation.cc:769] Sending connection context
0809 05:31:33.361284 (+ 503us) client_negotiation.cc:240] Negotiation successful
0809 05:31:33.361922 (+ 638us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":621,"thread_start_us":363,"threads_started":1}
I20260809 05:31:33.365397 16873 heartbeater.cc:347] Connected to a master server at 127.26.185.62:33231
I20260809 05:31:33.365759 16873 heartbeater.cc:464] Registering TS with master...
I20260809 05:31:33.366811 16873 heartbeater.cc:511] Master 127.26.185.62:33231 requested a full tablet report, sending...
I20260809 05:31:33.368649 16190 ts_manager.cc:194] Registered new tserver with Master: 4e86b85cbc8a45acbc2d45bab4869284 (127.26.185.3:35673)
I20260809 05:31:33.369660 16190 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.3@KRBTEST.COM'} at 127.26.185.3:57293
I20260809 05:31:33.374341 27364 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 05:31:33.395169 16875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:33.379972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57222 (local address 127.26.185.62:33231)
0809 05:31:33.380169 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:33.380174 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:33.380662 (+ 488us) server_negotiation.cc:407] Connection header received
0809 05:31:33.380839 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:33.380844 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:33.380969 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:33.381071 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:33.382641 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.383580 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.385008 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.385451 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.385547 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:33.388458 (+ 2911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:33.388464 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:33.388468 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:33.388508 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:33.391647 (+ 3139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:33.392538 (+ 891us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:33.392547 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:33.392552 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:33.392754 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:33.393345 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:33.393349 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:33.393352 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:33.393988 (+ 636us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:33.394208 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:33.394553 (+ 345us) server_negotiation.cc:299] Negotiation successful
0809 05:31:33.394759 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 05:31:33.400157 16190 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57222:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 05:31:33.408509 16190 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 05:31:33.462739 16890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:33.433411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:45545 (local address 127.0.0.1:40624)
0809 05:31:33.451596 (+ 18185us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:33.451614 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:33.451803 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:33.452443 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:33.452448 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:33.452481 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:31:33.453334 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:33.453354 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.455973 (+ 2619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.455978 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:33.458693 (+ 2715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:33.458710 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.461365 (+ 2655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.461373 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:33.461633 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:33.461709 (+ 76us) client_negotiation.cc:769] Sending connection context
0809 05:31:33.461882 (+ 173us) client_negotiation.cc:240] Negotiation successful
0809 05:31:33.462122 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18070,"mutex_wait_us":8,"thread_start_us":15760,"threads_started":1}
I20260809 05:31:33.464049 16893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:33.434097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40624 (local address 127.26.185.2:45545)
0809 05:31:33.447770 (+ 13673us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:33.447785 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:33.451776 (+ 3991us) server_negotiation.cc:407] Connection header received
0809 05:31:33.451984 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:33.452000 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:33.452202 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:33.452440 (+ 238us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:31:33.453629 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.455509 (+ 1880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.458925 (+ 3416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.460720 (+ 1795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.460913 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:33.461199 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:33.463369 (+ 2170us) server_negotiation.cc:299] Negotiation successful
0809 05:31:33.463628 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13379,"thread_start_us":13694,"threads_started":1}
I20260809 05:31:33.467036 16892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:33.433972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57974 (local address 127.26.185.3:35673)
0809 05:31:33.444798 (+ 10826us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:33.444817 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:33.450075 (+ 5258us) server_negotiation.cc:407] Connection header received
0809 05:31:33.451210 (+ 1135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:33.451224 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:33.451604 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:33.451859 (+ 255us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:31:33.455981 (+ 4122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.457824 (+ 1843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.462297 (+ 4473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.464631 (+ 2334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.464788 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:33.465154 (+ 366us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:33.466325 (+ 1171us) server_negotiation.cc:299] Negotiation successful
0809 05:31:33.466560 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10507,"thread_start_us":10247,"threads_started":1}
I20260809 05:31:33.468119 16891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:33.433191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:35673 (local address 127.0.0.1:57974)
0809 05:31:33.449762 (+ 16571us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:33.449828 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:33.450190 (+ 362us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:33.452331 (+ 2141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:33.452340 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:33.452391 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:31:33.455742 (+ 3351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:33.455758 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.458026 (+ 2268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.458034 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:33.462062 (+ 4028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:33.462078 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.465324 (+ 3246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.465344 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:33.465552 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:33.465594 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 05:31:33.465695 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 05:31:33.465856 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16157,"mutex_wait_us":76,"spinlock_wait_cycles":1408,"thread_start_us":19566,"threads_started":1}
I20260809 05:31:33.470778 16570 tablet_service.cc:1467] Processing CreateTablet for tablet df3746eef3ed4423a35e100cb6c13516 (DEFAULT_TABLE table=test-table [id=6d7d309720934a0194a638ec750e59db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:31:33.474642 16570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df3746eef3ed4423a35e100cb6c13516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:31:33.474107 16776 tablet_service.cc:1467] Processing CreateTablet for tablet df3746eef3ed4423a35e100cb6c13516 (DEFAULT_TABLE table=test-table [id=6d7d309720934a0194a638ec750e59db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:31:33.476104 16776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df3746eef3ed4423a35e100cb6c13516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:31:33.480986 16896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:33.453397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:33909 (local address 127.0.0.1:34952)
0809 05:31:33.465164 (+ 11767us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:33.465190 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:33.465890 (+ 700us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:33.471219 (+ 5329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:33.471227 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:33.471270 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:31:33.471726 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:33.471743 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.474222 (+ 2479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.474230 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:33.476894 (+ 2664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:33.476916 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.479816 (+ 2900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.479824 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:33.480093 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:33.480145 (+ 52us) client_negotiation.cc:769] Sending connection context
0809 05:31:33.480240 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 05:31:33.480460 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11580,"thread_start_us":5333,"threads_started":1}
I20260809 05:31:33.482488 16895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:33.453825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34952 (local address 127.26.185.1:33909)
0809 05:31:33.469608 (+ 15783us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:33.469620 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:33.469659 (+ 39us) server_negotiation.cc:407] Connection header received
0809 05:31:33.469808 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:33.469819 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:33.470447 (+ 628us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:33.470721 (+ 274us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:31:33.472022 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.474014 (+ 1992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.477137 (+ 3123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.479251 (+ 2114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.479434 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:33.481641 (+ 2207us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:33.481737 (+ 96us) server_negotiation.cc:299] Negotiation successful
0809 05:31:33.482002 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15514,"thread_start_us":16103,"threads_started":1}
I20260809 05:31:33.488107 16364 tablet_service.cc:1467] Processing CreateTablet for tablet df3746eef3ed4423a35e100cb6c13516 (DEFAULT_TABLE table=test-table [id=6d7d309720934a0194a638ec750e59db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:31:33.490259 16364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df3746eef3ed4423a35e100cb6c13516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:31:33.504014 16900 tablet_bootstrap.cc:492] T df3746eef3ed4423a35e100cb6c13516 P 4e86b85cbc8a45acbc2d45bab4869284: Bootstrap starting.
I20260809 05:31:33.510214 16901 tablet_bootstrap.cc:492] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf: Bootstrap starting.
I20260809 05:31:33.514271 16901 tablet_bootstrap.cc:654] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf: Neither blocks nor log segments found. Creating new log.
I20260809 05:31:33.514382 16900 tablet_bootstrap.cc:654] T df3746eef3ed4423a35e100cb6c13516 P 4e86b85cbc8a45acbc2d45bab4869284: Neither blocks nor log segments found. Creating new log.
I20260809 05:31:33.515971 16901 log.cc:824] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf: Log is configured to *not* fsync() on all Append() calls
I20260809 05:31:33.515983 16900 log.cc:824] T df3746eef3ed4423a35e100cb6c13516 P 4e86b85cbc8a45acbc2d45bab4869284: Log is configured to *not* fsync() on all Append() calls
I20260809 05:31:33.525373 16905 tablet_bootstrap.cc:492] T df3746eef3ed4423a35e100cb6c13516 P dbc74c333bd14948bd793098886ccf1d: Bootstrap starting.
I20260809 05:31:33.526624 16901 tablet_bootstrap.cc:492] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf: No bootstrap required, opened a new log
I20260809 05:31:33.527055 16901 ts_tablet_manager.cc:1397] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf: Time spent bootstrapping tablet: real 0.017s user 0.010s sys 0.005s
I20260809 05:31:33.528030 16900 tablet_bootstrap.cc:492] T df3746eef3ed4423a35e100cb6c13516 P 4e86b85cbc8a45acbc2d45bab4869284: No bootstrap required, opened a new log
I20260809 05:31:33.528469 16900 ts_tablet_manager.cc:1397] T df3746eef3ed4423a35e100cb6c13516 P 4e86b85cbc8a45acbc2d45bab4869284: Time spent bootstrapping tablet: real 0.025s user 0.014s sys 0.002s
I20260809 05:31:33.530086 16905 tablet_bootstrap.cc:654] T df3746eef3ed4423a35e100cb6c13516 P dbc74c333bd14948bd793098886ccf1d: Neither blocks nor log segments found. Creating new log.
I20260809 05:31:33.531785 16905 log.cc:824] T df3746eef3ed4423a35e100cb6c13516 P dbc74c333bd14948bd793098886ccf1d: Log is configured to *not* fsync() on all Append() calls
I20260809 05:31:33.541108 16901 raft_consensus.cc:348] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e86b85cbc8a45acbc2d45bab4869284" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 35673 } } peers { permanent_uuid: "13af1af05d3744488ea095a59decebdf" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45545 } } peers { permanent_uuid: "dbc74c333bd14948bd793098886ccf1d" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33909 } }
I20260809 05:31:33.541774 16901 raft_consensus.cc:374] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:31:33.541899 16901 raft_consensus.cc:729] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13af1af05d3744488ea095a59decebdf, State: Initialized, Role: FOLLOWER
I20260809 05:31:33.542879 16901 consensus_queue.cc:260] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e86b85cbc8a45acbc2d45bab4869284" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 35673 } } peers { permanent_uuid: "13af1af05d3744488ea095a59decebdf" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45545 } } peers { permanent_uuid: "dbc74c333bd14948bd793098886ccf1d" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33909 } }
I20260809 05:31:33.543465 16900 raft_consensus.cc:348] T df3746eef3ed4423a35e100cb6c13516 P 4e86b85cbc8a45acbc2d45bab4869284 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e86b85cbc8a45acbc2d45bab4869284" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 35673 } } peers { permanent_uuid: "13af1af05d3744488ea095a59decebdf" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45545 } } peers { permanent_uuid: "dbc74c333bd14948bd793098886ccf1d" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33909 } }
I20260809 05:31:33.544093 16900 raft_consensus.cc:374] T df3746eef3ed4423a35e100cb6c13516 P 4e86b85cbc8a45acbc2d45bab4869284 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:31:33.544230 16900 raft_consensus.cc:729] T df3746eef3ed4423a35e100cb6c13516 P 4e86b85cbc8a45acbc2d45bab4869284 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e86b85cbc8a45acbc2d45bab4869284, State: Initialized, Role: FOLLOWER
I20260809 05:31:33.545207 16900 consensus_queue.cc:260] T df3746eef3ed4423a35e100cb6c13516 P 4e86b85cbc8a45acbc2d45bab4869284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e86b85cbc8a45acbc2d45bab4869284" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 35673 } } peers { permanent_uuid: "13af1af05d3744488ea095a59decebdf" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45545 } } peers { permanent_uuid: "dbc74c333bd14948bd793098886ccf1d" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33909 } }
I20260809 05:31:33.547210 16905 tablet_bootstrap.cc:492] T df3746eef3ed4423a35e100cb6c13516 P dbc74c333bd14948bd793098886ccf1d: No bootstrap required, opened a new log
I20260809 05:31:33.547698 16905 ts_tablet_manager.cc:1397] T df3746eef3ed4423a35e100cb6c13516 P dbc74c333bd14948bd793098886ccf1d: Time spent bootstrapping tablet: real 0.023s user 0.009s sys 0.012s
I20260809 05:31:33.552044 16901 ts_tablet_manager.cc:1428] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf: Time spent starting tablet: real 0.025s user 0.014s sys 0.009s
I20260809 05:31:33.552645 16670 heartbeater.cc:503] Master 127.26.185.62:33231 was elected leader, sending a full tablet report...
I20260809 05:31:33.564770 16905 raft_consensus.cc:348] T df3746eef3ed4423a35e100cb6c13516 P dbc74c333bd14948bd793098886ccf1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e86b85cbc8a45acbc2d45bab4869284" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 35673 } } peers { permanent_uuid: "13af1af05d3744488ea095a59decebdf" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45545 } } peers { permanent_uuid: "dbc74c333bd14948bd793098886ccf1d" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33909 } }
I20260809 05:31:33.565508 16873 heartbeater.cc:503] Master 127.26.185.62:33231 was elected leader, sending a full tablet report...
I20260809 05:31:33.565735 16905 raft_consensus.cc:374] T df3746eef3ed4423a35e100cb6c13516 P dbc74c333bd14948bd793098886ccf1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:31:33.565955 16905 raft_consensus.cc:729] T df3746eef3ed4423a35e100cb6c13516 P dbc74c333bd14948bd793098886ccf1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc74c333bd14948bd793098886ccf1d, State: Initialized, Role: FOLLOWER
I20260809 05:31:33.566560 16900 ts_tablet_manager.cc:1428] T df3746eef3ed4423a35e100cb6c13516 P 4e86b85cbc8a45acbc2d45bab4869284: Time spent starting tablet: real 0.038s user 0.009s sys 0.025s
I20260809 05:31:33.567171 16905 consensus_queue.cc:260] T df3746eef3ed4423a35e100cb6c13516 P dbc74c333bd14948bd793098886ccf1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e86b85cbc8a45acbc2d45bab4869284" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 35673 } } peers { permanent_uuid: "13af1af05d3744488ea095a59decebdf" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45545 } } peers { permanent_uuid: "dbc74c333bd14948bd793098886ccf1d" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33909 } }
I20260809 05:31:33.569775 16905 ts_tablet_manager.cc:1428] T df3746eef3ed4423a35e100cb6c13516 P dbc74c333bd14948bd793098886ccf1d: Time spent starting tablet: real 0.022s user 0.013s sys 0.005s
I20260809 05:31:33.587446 16911 raft_consensus.cc:482] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:31:33.587870 16911 raft_consensus.cc:504] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e86b85cbc8a45acbc2d45bab4869284" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 35673 } } peers { permanent_uuid: "13af1af05d3744488ea095a59decebdf" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45545 } } peers { permanent_uuid: "dbc74c333bd14948bd793098886ccf1d" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33909 } }
W20260809 05:31:33.588330 16874 tablet.cc:2369] T df3746eef3ed4423a35e100cb6c13516 P 4e86b85cbc8a45acbc2d45bab4869284: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:31:33.590371 16911 leader_election.cc:288] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e86b85cbc8a45acbc2d45bab4869284 (127.26.185.3:35673), dbc74c333bd14948bd793098886ccf1d (127.26.185.1:33909)
I20260809 05:31:33.599975 16919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:33.590966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:35673 (local address 127.26.185.2:43999)
0809 05:31:33.592000 (+ 1034us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:33.592019 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:33.592221 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:33.592933 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:33.592943 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:33.592988 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:31:33.593540 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:33.593559 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.595126 (+ 1567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.595135 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:33.596716 (+ 1581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:33.596730 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.598953 (+ 2223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.598960 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:33.599181 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:33.599222 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 05:31:33.599333 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 05:31:33.599506 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":832,"thread_start_us":600,"threads_started":1}
I20260809 05:31:33.599996 16892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:33.591105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:43999 (local address 127.26.185.3:35673)
0809 05:31:33.591340 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:33.591346 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:33.592126 (+ 780us) server_negotiation.cc:407] Connection header received
0809 05:31:33.592437 (+ 311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:33.592443 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:33.592544 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:33.592637 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:31:33.593739 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.594957 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.596936 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.598692 (+ 1756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.598945 (+ 253us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:33.599109 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:33.599389 (+ 280us) server_negotiation.cc:299] Negotiation successful
0809 05:31:33.599589 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 05:31:33.600589 16895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:33.592458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:54165 (local address 127.26.185.1:33909)
0809 05:31:33.592758 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:33.592766 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:33.593619 (+ 853us) server_negotiation.cc:407] Connection header received
0809 05:31:33.593795 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:33.593804 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:33.593929 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:33.594049 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:31:33.594801 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.596447 (+ 1646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.598210 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.599333 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.599487 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:33.599561 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:33.600174 (+ 613us) server_negotiation.cc:299] Negotiation successful
0809 05:31:33.600328 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260809 05:31:33.601317 16920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:33.592287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:33909 (local address 127.26.185.2:54165)
0809 05:31:33.593460 (+ 1173us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:33.593492 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:33.593633 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:33.594082 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:33.594089 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:33.594124 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:31:33.594544 (+ 420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:33.594556 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.596643 (+ 2087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.596648 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:33.598041 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:33.598054 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.599736 (+ 1682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.599742 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:33.599949 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:33.599994 (+ 45us) client_negotiation.cc:769] Sending connection context
0809 05:31:33.600884 (+ 890us) client_negotiation.cc:240] Negotiation successful
0809 05:31:33.601006 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1021,"thread_start_us":768,"threads_started":1}
I20260809 05:31:33.601951 16806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df3746eef3ed4423a35e100cb6c13516" candidate_uuid: "13af1af05d3744488ea095a59decebdf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e86b85cbc8a45acbc2d45bab4869284" is_pre_election: true
I20260809 05:31:33.602699 16806 raft_consensus.cc:2454] T df3746eef3ed4423a35e100cb6c13516 P 4e86b85cbc8a45acbc2d45bab4869284 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13af1af05d3744488ea095a59decebdf in term 0.
I20260809 05:31:33.602739 16400 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df3746eef3ed4423a35e100cb6c13516" candidate_uuid: "13af1af05d3744488ea095a59decebdf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc74c333bd14948bd793098886ccf1d" is_pre_election: true
I20260809 05:31:33.603555 16400 raft_consensus.cc:2454] T df3746eef3ed4423a35e100cb6c13516 P dbc74c333bd14948bd793098886ccf1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13af1af05d3744488ea095a59decebdf in term 0.
I20260809 05:31:33.603638 16498 leader_election.cc:302] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13af1af05d3744488ea095a59decebdf, 4e86b85cbc8a45acbc2d45bab4869284; no voters:
I20260809 05:31:33.604131 16911 raft_consensus.cc:2781] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:31:33.604327 16911 raft_consensus.cc:482] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:31:33.604470 16911 raft_consensus.cc:3037] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:31:33.607213 16911 raft_consensus.cc:504] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e86b85cbc8a45acbc2d45bab4869284" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 35673 } } peers { permanent_uuid: "13af1af05d3744488ea095a59decebdf" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45545 } } peers { permanent_uuid: "dbc74c333bd14948bd793098886ccf1d" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33909 } }
I20260809 05:31:33.607970 16911 leader_election.cc:288] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf [CANDIDATE]: Term 1 election: Requested vote from peers 4e86b85cbc8a45acbc2d45bab4869284 (127.26.185.3:35673), dbc74c333bd14948bd793098886ccf1d (127.26.185.1:33909)
I20260809 05:31:33.608613 16806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df3746eef3ed4423a35e100cb6c13516" candidate_uuid: "13af1af05d3744488ea095a59decebdf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e86b85cbc8a45acbc2d45bab4869284"
I20260809 05:31:33.608901 16806 raft_consensus.cc:3037] T df3746eef3ed4423a35e100cb6c13516 P 4e86b85cbc8a45acbc2d45bab4869284 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:31:33.608834 16400 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df3746eef3ed4423a35e100cb6c13516" candidate_uuid: "13af1af05d3744488ea095a59decebdf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc74c333bd14948bd793098886ccf1d"
I20260809 05:31:33.609140 16400 raft_consensus.cc:3037] T df3746eef3ed4423a35e100cb6c13516 P dbc74c333bd14948bd793098886ccf1d [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:31:33.612021 16806 raft_consensus.cc:2454] T df3746eef3ed4423a35e100cb6c13516 P 4e86b85cbc8a45acbc2d45bab4869284 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13af1af05d3744488ea095a59decebdf in term 1.
I20260809 05:31:33.612497 16498 leader_election.cc:302] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13af1af05d3744488ea095a59decebdf, 4e86b85cbc8a45acbc2d45bab4869284; no voters:
I20260809 05:31:33.612828 16911 raft_consensus.cc:2781] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:31:33.613648 16400 raft_consensus.cc:2454] T df3746eef3ed4423a35e100cb6c13516 P dbc74c333bd14948bd793098886ccf1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13af1af05d3744488ea095a59decebdf in term 1.
I20260809 05:31:33.613451 16911 raft_consensus.cc:686] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf [term 1 LEADER]: Becoming Leader. State: Replica: 13af1af05d3744488ea095a59decebdf, State: Running, Role: LEADER
I20260809 05:31:33.614527 16911 consensus_queue.cc:237] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e86b85cbc8a45acbc2d45bab4869284" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 35673 } } peers { permanent_uuid: "13af1af05d3744488ea095a59decebdf" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45545 } } peers { permanent_uuid: "dbc74c333bd14948bd793098886ccf1d" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33909 } }
I20260809 05:31:33.621232 16189 catalog_manager.cc:5495] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf reported cstate change: term changed from 0 to 1, leader changed from <none> to 13af1af05d3744488ea095a59decebdf (127.26.185.2). New cstate: current_term: 1 leader_uuid: "13af1af05d3744488ea095a59decebdf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e86b85cbc8a45acbc2d45bab4869284" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13af1af05d3744488ea095a59decebdf" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbc74c333bd14948bd793098886ccf1d" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33909 } health_report { overall_health: UNKNOWN } } }
W20260809 05:31:33.670410 16672 tablet.cc:2369] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:31:33.676093 16893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:33.665323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40632 (local address 127.26.185.2:45545)
0809 05:31:33.665676 (+ 353us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:33.665685 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:33.665713 (+ 28us) server_negotiation.cc:407] Connection header received
0809 05:31:33.665873 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:33.665883 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:33.666033 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:33.666243 (+ 210us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:31:33.666852 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.668169 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.671373 (+ 3204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.672345 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.672530 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:33.673234 (+ 704us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:31:33.674947 (+ 1713us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:31:33.675247 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:33.675318 (+ 71us) server_negotiation.cc:299] Negotiation successful
0809 05:31:33.675476 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130}
I20260809 05:31:33.690090 16400 raft_consensus.cc:1261] T df3746eef3ed4423a35e100cb6c13516 P dbc74c333bd14948bd793098886ccf1d [term 1 FOLLOWER]: Refusing update from remote peer 13af1af05d3744488ea095a59decebdf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:31:33.690093 16806 raft_consensus.cc:1261] T df3746eef3ed4423a35e100cb6c13516 P 4e86b85cbc8a45acbc2d45bab4869284 [term 1 FOLLOWER]: Refusing update from remote peer 13af1af05d3744488ea095a59decebdf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:31:33.691526 16921 consensus_queue.cc:1035] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e86b85cbc8a45acbc2d45bab4869284" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:31:33.692005 16911 consensus_queue.cc:1035] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc74c333bd14948bd793098886ccf1d" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:31:33.708422 16929 mvcc.cc:205] Tried to move back new op lower bound from 7316494310139101184 to 7316494309851430912. Current Snapshot: MvccSnapshot[applied={T|T < 7316494310139101184}]
I20260809 05:31:33.747053 16189 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57222:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:31:33.747539 16189 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57222:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:31:33.753720 16189 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7: Sending DeleteTablet for 3 replicas of tablet df3746eef3ed4423a35e100cb6c13516
I20260809 05:31:33.755864 16776 tablet_service.cc:1514] Processing DeleteTablet for tablet df3746eef3ed4423a35e100cb6c13516 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:31:33 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:57974
I20260809 05:31:33.755832 16775 tablet_service.cc:1514] Processing DeleteTablet for tablet df3746eef3ed4423a35e100cb6c13516 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:31:33 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:57974
I20260809 05:31:33.757953 16570 tablet_service.cc:1514] Processing DeleteTablet for tablet df3746eef3ed4423a35e100cb6c13516 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:31:33 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:40624
I20260809 05:31:33.757979 16364 tablet_service.cc:1514] Processing DeleteTablet for tablet df3746eef3ed4423a35e100cb6c13516 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:31:33 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:34952
I20260809 05:31:33.766674 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 16270
I20260809 05:31:33.767771 16946 tablet_replica.cc:330] T df3746eef3ed4423a35e100cb6c13516 P dbc74c333bd14948bd793098886ccf1d: stopping tablet replica
I20260809 05:31:33.768502 16946 raft_consensus.cc:2229] T df3746eef3ed4423a35e100cb6c13516 P dbc74c333bd14948bd793098886ccf1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:31:33.769346 16946 raft_consensus.cc:2258] T df3746eef3ed4423a35e100cb6c13516 P dbc74c333bd14948bd793098886ccf1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:31:33.773751 16946 ts_tablet_manager.cc:1905] T df3746eef3ed4423a35e100cb6c13516 P dbc74c333bd14948bd793098886ccf1d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:31:33.781914 16945 tablet_replica.cc:330] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf: stopping tablet replica
I20260809 05:31:33.782536 16945 raft_consensus.cc:2229] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf [term 1 LEADER]: Raft consensus shutting down.
I20260809 05:31:33.783229 16946 ts_tablet_manager.cc:1918] T df3746eef3ed4423a35e100cb6c13516 P dbc74c333bd14948bd793098886ccf1d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:31:33.783516 16946 log.cc:1196] T df3746eef3ed4423a35e100cb6c13516 P dbc74c333bd14948bd793098886ccf1d: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/wal/wals/df3746eef3ed4423a35e100cb6c13516
I20260809 05:31:33.783516 16945 raft_consensus.cc:2258] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:31:33.784407 16946 ts_tablet_manager.cc:1939] T df3746eef3ed4423a35e100cb6c13516 P dbc74c333bd14948bd793098886ccf1d: Deleting consensus metadata
I20260809 05:31:33.784489 16944 tablet_replica.cc:330] T df3746eef3ed4423a35e100cb6c13516 P 4e86b85cbc8a45acbc2d45bab4869284: stopping tablet replica
I20260809 05:31:33.785000 16944 raft_consensus.cc:2229] T df3746eef3ed4423a35e100cb6c13516 P 4e86b85cbc8a45acbc2d45bab4869284 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:31:33.785646 16944 raft_consensus.cc:2258] T df3746eef3ed4423a35e100cb6c13516 P 4e86b85cbc8a45acbc2d45bab4869284 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:31:33.787335 16161 catalog_manager.cc:4841] TS dbc74c333bd14948bd793098886ccf1d (127.26.185.1:33909): tablet df3746eef3ed4423a35e100cb6c13516 (table test-table [id=6d7d309720934a0194a638ec750e59db]) successfully deleted
I20260809 05:31:33.789179 16945 ts_tablet_manager.cc:1905] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:31:33.791401 16944 ts_tablet_manager.cc:1905] T df3746eef3ed4423a35e100cb6c13516 P 4e86b85cbc8a45acbc2d45bab4869284: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:31:33.798067 16944 ts_tablet_manager.cc:1918] T df3746eef3ed4423a35e100cb6c13516 P 4e86b85cbc8a45acbc2d45bab4869284: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:31:33.798134 16945 ts_tablet_manager.cc:1918] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:31:33.798290 16944 log.cc:1196] T df3746eef3ed4423a35e100cb6c13516 P 4e86b85cbc8a45acbc2d45bab4869284: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/wal/wals/df3746eef3ed4423a35e100cb6c13516
I20260809 05:31:33.798341 16945 log.cc:1196] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/wal/wals/df3746eef3ed4423a35e100cb6c13516
I20260809 05:31:33.798820 16944 ts_tablet_manager.cc:1939] T df3746eef3ed4423a35e100cb6c13516 P 4e86b85cbc8a45acbc2d45bab4869284: Deleting consensus metadata
I20260809 05:31:33.798980 16945 ts_tablet_manager.cc:1939] T df3746eef3ed4423a35e100cb6c13516 P 13af1af05d3744488ea095a59decebdf: Deleting consensus metadata
I20260809 05:31:33.801050 16161 catalog_manager.cc:4841] TS 4e86b85cbc8a45acbc2d45bab4869284 (127.26.185.3:35673): tablet df3746eef3ed4423a35e100cb6c13516 (table test-table [id=6d7d309720934a0194a638ec750e59db]) successfully deleted
I20260809 05:31:33.801229 16162 catalog_manager.cc:4841] TS 13af1af05d3744488ea095a59decebdf (127.26.185.2:45545): tablet df3746eef3ed4423a35e100cb6c13516 (table test-table [id=6d7d309720934a0194a638ec750e59db]) successfully deleted
W20260809 05:31:33.801980 16161 catalog_manager.cc:4808] TS 4e86b85cbc8a45acbc2d45bab4869284 (127.26.185.3:35673): delete failed for tablet df3746eef3ed4423a35e100cb6c13516 because the tablet was not found. No further retry: Not found: Tablet not found: df3746eef3ed4423a35e100cb6c13516
Aug 09 05:31:33 dist-test-slave-h3ft krb5kdc[16122](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253490, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.1@KRBTEST.COM
I20260809 05:31:33.812654 16895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:33.782647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34954 (local address 127.26.185.1:33909)
0809 05:31:33.782887 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:33.782901 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:33.787095 (+ 4194us) server_negotiation.cc:407] Connection header received
0809 05:31:33.787472 (+ 377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:33.787478 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:33.787604 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:33.787689 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:33.789508 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.790717 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.792962 (+ 2245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.793649 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.793751 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:33.805671 (+ 11920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:33.805693 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:33.805712 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:33.805762 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:33.809149 (+ 3387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:33.810033 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:33.810042 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:33.810045 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:33.810206 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:33.810721 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:33.810726 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:33.810728 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:33.811246 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:33.811626 (+ 380us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:33.811971 (+ 345us) server_negotiation.cc:299] Negotiation successful
0809 05:31:33.812241 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 05:31:33.813508 16452 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:31:33.915107 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 16270
I20260809 05:31:33.950901 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 16470
Aug 09 05:31:33 dist-test-slave-h3ft krb5kdc[16122](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253490, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.2@KRBTEST.COM
I20260809 05:31:33.972971 16893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:33.952022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40648 (local address 127.26.185.2:45545)
0809 05:31:33.952263 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:33.952269 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:33.952336 (+ 67us) server_negotiation.cc:407] Connection header received
0809 05:31:33.952621 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:33.952626 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:33.952712 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:33.952801 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:33.954845 (+ 2044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.955975 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.958099 (+ 2124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:33.958713 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:33.958821 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:33.965125 (+ 6304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:33.965151 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:33.965181 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:33.965257 (+ 76us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:33.969636 (+ 4379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:33.970439 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:33.970449 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:33.970451 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:33.970618 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:33.971072 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:33.971078 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:33.971081 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:33.971532 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:33.971943 (+ 411us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:33.972228 (+ 285us) server_negotiation.cc:299] Negotiation successful
0809 05:31:33.972496 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260809 05:31:33.973887 16665 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:31:34.108146 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 16470
I20260809 05:31:34.142194 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 16680
Aug 09 05:31:34 dist-test-slave-h3ft krb5kdc[16122](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253490, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.3@KRBTEST.COM
I20260809 05:31:34.160655 16951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:34.143323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57976 (local address 127.26.185.3:35673)
0809 05:31:34.143988 (+ 665us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:34.143993 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:34.144019 (+ 26us) server_negotiation.cc:407] Connection header received
0809 05:31:34.144094 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:34.144098 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:34.144180 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:34.144288 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:34.145892 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:34.146883 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:34.148375 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:34.148790 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:34.148901 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:34.154075 (+ 5174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:34.154093 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:34.154125 (+ 32us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:34.154168 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:34.157480 (+ 3312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:34.158202 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:34.158211 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:34.158214 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:34.158379 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:34.158745 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:34.158748 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:34.158750 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:34.159391 (+ 641us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:34.159675 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:34.160000 (+ 325us) server_negotiation.cc:299] Negotiation successful
0809 05:31:34.160206 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":530,"thread_start_us":366,"threads_started":1}
I20260809 05:31:34.161437 16865 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:31:34.261420 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 16680
I20260809 05:31:34.289721 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 16139
I20260809 05:31:34.291330 16235 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:31:34.422098 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 16139
I20260809 05:31:34.459095 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:33231
--webserver_interface=127.26.185.62
--webserver_port=35827
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:40013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:33231
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:31:34.882953 16954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:31:34.883417 16954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:31:34.883597 16954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:31:34.891860 16954 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:31:34.891993 16954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:31:34.892082 16954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:31:34.892172 16954 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:31:34.892239 16954 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:31:34.903596 16954 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:40013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:33231
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:33231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=35827
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:31:34.905465 16954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:31:34.907292 16954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:31:34.942591 16964 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:34.942683 16963 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:34.942730 16967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:31:34.943511 16954 server_base.cc:1034] running on GCE node
I20260809 05:31:34.944756 16954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:31:34.946909 16954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:31:34.948253 16954 hybrid_clock.cc:648] HybridClock initialized: now 1786253494948173 us; error 64 us; skew 500 ppm
I20260809 05:31:34.948871 16954 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:31:34 dist-test-slave-h3ft krb5kdc[16122](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253494, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:31:34.953786 16954 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:31:34.956171 16954 webserver.cc:460] Webserver started at http://127.26.185.62:35827/ using document root <none> and password file <none>
I20260809 05:31:34.957329 16954 fs_manager.cc:359] Metadata directory not provided
I20260809 05:31:34.957544 16954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:31:34.965782 16954 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 05:31:34.969923 16975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:34.971820 16954 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:31:34.972110 16954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "e32ace97d3124854a30475fb4cb2feb7"
format_stamp: "Formatted at 2026-08-09 05:31:31 on dist-test-slave-h3ft"
server_key: "3447aef745b241fd293d43556db3aee4"
server_key_iv: "fb9667ad3e14e98658d3735394b53537"
server_key_version: "encryptionkey@0"
I20260809 05:31:34.973546 16954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:31:34.993687 16954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:31:34.999321 16954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:31:34.999692 16954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:31:35.023751 16954 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:33231
I20260809 05:31:35.023769 17054 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:33231 every 8 connection(s)
I20260809 05:31:35.026229 16954 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:31:35.029202 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 16954
I20260809 05:31:35.030659 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:33909
--local_ip_for_outbound_sockets=127.26.185.1
--tserver_master_addrs=127.26.185.62:33231
--webserver_port=35803
--webserver_interface=127.26.185.1
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:40013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:31:35.039949 17055 sys_catalog.cc:263] Verifying existing consensus state
I20260809 05:31:35.045400 17055 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7: Bootstrap starting.
I20260809 05:31:35.079126 17055 log.cc:824] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7: Log is configured to *not* fsync() on all Append() calls
I20260809 05:31:35.098798 17055 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 05:31:35.099725 17055 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7: Bootstrap complete.
I20260809 05:31:35.115813 17055 raft_consensus.cc:348] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e32ace97d3124854a30475fb4cb2feb7" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33231 } }
I20260809 05:31:35.117313 17055 raft_consensus.cc:729] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ace97d3124854a30475fb4cb2feb7, State: Initialized, Role: FOLLOWER
I20260809 05:31:35.118315 17055 consensus_queue.cc:260] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e32ace97d3124854a30475fb4cb2feb7" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33231 } }
I20260809 05:31:35.118665 17055 raft_consensus.cc:388] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:31:35.118830 17055 raft_consensus.cc:482] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:31:35.119076 17055 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [term 1 FOLLOWER]: Advancing to term 2
I20260809 05:31:35.126971 17055 raft_consensus.cc:504] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e32ace97d3124854a30475fb4cb2feb7" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33231 } }
I20260809 05:31:35.128177 17055 leader_election.cc:302] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e32ace97d3124854a30475fb4cb2feb7; no voters:
I20260809 05:31:35.129081 17055 leader_election.cc:288] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 05:31:35.129393 17059 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 05:31:35.132921 17059 raft_consensus.cc:686] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [term 2 LEADER]: Becoming Leader. State: Replica: e32ace97d3124854a30475fb4cb2feb7, State: Running, Role: LEADER
I20260809 05:31:35.133783 17059 consensus_queue.cc:237] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e32ace97d3124854a30475fb4cb2feb7" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33231 } }
I20260809 05:31:35.137446 17055 sys_catalog.cc:564] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:31:35.140849 17060 sys_catalog.cc:455] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e32ace97d3124854a30475fb4cb2feb7. Latest consensus state: current_term: 2 leader_uuid: "e32ace97d3124854a30475fb4cb2feb7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e32ace97d3124854a30475fb4cb2feb7" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33231 } } }
I20260809 05:31:35.141328 17060 sys_catalog.cc:458] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [sys.catalog]: This master's current role is: LEADER
I20260809 05:31:35.141578 17061 sys_catalog.cc:455] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "e32ace97d3124854a30475fb4cb2feb7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e32ace97d3124854a30475fb4cb2feb7" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33231 } } }
I20260809 05:31:35.142066 17061 sys_catalog.cc:458] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [sys.catalog]: This master's current role is: LEADER
I20260809 05:31:35.146024 17069 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:31:35.158649 17069 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:31:35.160744 17069 catalog_manager.cc:1259] Loaded cluster ID: 010314fd7bd742748a0c90bbcb34ecf5
I20260809 05:31:35.160959 17069 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:31:35.164778 17069 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260809 05:31:35.182477 17069 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260809 05:31:35.194257 17069 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:31:35.196681 17069 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7: Loaded TSK: 0
I20260809 05:31:35.198861 17069 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 05:31:35.569273 17057 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:31:35.569747 17057 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:31:35.569933 17057 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:31:35.579044 17057 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:31:35.579267 17057 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:31:35.579491 17057 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:31:35.591434 17057 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:40013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:33909
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=35803
--tserver_master_addrs=127.26.185.62:33231
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:31:35.593353 17057 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:31:35.595292 17057 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:31:35.614328 17094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:35.615109 17093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:35.616026 17097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:31:35.621248 17057 server_base.cc:1034] running on GCE node
I20260809 05:31:35.622532 17057 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:31:35.624657 17057 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:31:35.625979 17057 hybrid_clock.cc:648] HybridClock initialized: now 1786253495625918 us; error 57 us; skew 500 ppm
I20260809 05:31:35.626457 17057 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:31:35 dist-test-slave-h3ft krb5kdc[16122](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253495, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:31:35.631537 17057 init.cc:377] Logged in from keytab as kudu/127.26.185.1@KRBTEST.COM (short username kudu)
I20260809 05:31:35.633668 17057 webserver.cc:460] Webserver started at http://127.26.185.1:35803/ using document root <none> and password file <none>
I20260809 05:31:35.634656 17057 fs_manager.cc:359] Metadata directory not provided
I20260809 05:31:35.634841 17057 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:31:35.643311 17057 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.007s sys 0.000s
I20260809 05:31:35.647789 17108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:35.649955 17057 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.001s
I20260809 05:31:35.650264 17057 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "dbc74c333bd14948bd793098886ccf1d"
format_stamp: "Formatted at 2026-08-09 05:31:31 on dist-test-slave-h3ft"
server_key: "a5bee64724adbd30aedb81de707c72b0"
server_key_iv: "35acc289eecc04a2f69292ef269aa998"
server_key_version: "encryptionkey@0"
I20260809 05:31:35.651873 17057 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:31:35.690589 17057 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:31:35.697237 17057 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:31:35.697640 17057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:31:35.699138 17057 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:31:35.701103 17057 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:31:35.701263 17057 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:35.701416 17057 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:31:35.701508 17057 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:35.743480 17057 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:33909
I20260809 05:31:35.743635 17272 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:33909 every 8 connection(s)
I20260809 05:31:35.745530 17057 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:31:35.754964 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 17057
I20260809 05:31:35.755971 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:45545
--local_ip_for_outbound_sockets=127.26.185.2
--tserver_master_addrs=127.26.185.62:33231
--webserver_port=34231
--webserver_interface=127.26.185.2
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:40013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 05:31:35 dist-test-slave-h3ft krb5kdc[16122](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253495, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:31:35.778141 17275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:35.749714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:36817 (local address 127.26.185.62:33231)
0809 05:31:35.750516 (+ 802us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:35.750534 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:35.751680 (+ 1146us) server_negotiation.cc:407] Connection header received
0809 05:31:35.754639 (+ 2959us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:35.754667 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:35.755428 (+ 761us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:35.755945 (+ 517us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:35.758508 (+ 2563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:35.760019 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:35.761922 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:35.762703 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:35.762959 (+ 256us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:35.767899 (+ 4940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:35.767910 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:35.767932 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:35.767985 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:35.772122 (+ 4137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:35.773202 (+ 1080us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:35.773212 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:35.773219 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:35.773413 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:35.773965 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:35.773971 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:35.773974 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:35.774641 (+ 667us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:35.774884 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:35.776001 (+ 1117us) server_negotiation.cc:299] Negotiation successful
0809 05:31:35.776504 (+ 503us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":529,"thread_start_us":337,"threads_started":1}
I20260809 05:31:35.778193 17277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:35.750286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.1:36817)
0809 05:31:35.751427 (+ 1141us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:35.751486 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:35.753716 (+ 2230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:35.756557 (+ 2841us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:35.756567 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:35.757377 (+ 810us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:31:35.758201 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:35.758229 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:35.760257 (+ 2028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:35.760261 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:35.761704 (+ 1443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:35.761721 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:35.763058 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:35.763067 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:35.763385 (+ 318us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:35.764320 (+ 935us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:31:35.764351 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:31:35.767484 (+ 3133us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:31:35.772358 (+ 4874us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:35.772371 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:35.772397 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:35.772993 (+ 596us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:35.773587 (+ 594us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:35.773591 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:35.773594 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:35.773828 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:35.774819 (+ 991us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:31:35.774829 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:31:35.775337 (+ 508us) client_negotiation.cc:769] Sending connection context
0809 05:31:35.775692 (+ 355us) client_negotiation.cc:240] Negotiation successful
0809 05:31:35.776444 (+ 752us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":783,"thread_start_us":392,"threads_started":1}
I20260809 05:31:35.782308 17273 heartbeater.cc:347] Connected to a master server at 127.26.185.62:33231
I20260809 05:31:35.782747 17273 heartbeater.cc:464] Registering TS with master...
I20260809 05:31:35.783898 17273 heartbeater.cc:511] Master 127.26.185.62:33231 requested a full tablet report, sending...
I20260809 05:31:35.787453 17004 ts_manager.cc:194] Registered new tserver with Master: dbc74c333bd14948bd793098886ccf1d (127.26.185.1:33909)
I20260809 05:31:35.790364 17004 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.1@KRBTEST.COM'} at 127.26.185.1:36817
W20260809 05:31:36.198823 17278 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:31:36.199311 17278 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:31:36.199443 17278 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:31:36.207754 17278 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:31:36.207901 17278 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:31:36.208042 17278 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:31:36.219314 17278 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:40013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:45545
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=34231
--tserver_master_addrs=127.26.185.62:33231
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:31:36.221120 17278 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:31:36.222872 17278 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:31:36.239701 17287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:36.239665 17290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:36.239681 17288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:31:36.240775 17278 server_base.cc:1034] running on GCE node
I20260809 05:31:36.241562 17278 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:31:36.242702 17278 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:31:36.243930 17278 hybrid_clock.cc:648] HybridClock initialized: now 1786253496243827 us; error 95 us; skew 500 ppm
I20260809 05:31:36.244360 17278 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:31:36 dist-test-slave-h3ft krb5kdc[16122](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253496, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:31:36.248413 17278 init.cc:377] Logged in from keytab as kudu/127.26.185.2@KRBTEST.COM (short username kudu)
I20260809 05:31:36.250249 17278 webserver.cc:460] Webserver started at http://127.26.185.2:34231/ using document root <none> and password file <none>
I20260809 05:31:36.251266 17278 fs_manager.cc:359] Metadata directory not provided
I20260809 05:31:36.251462 17278 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:31:36.258822 17278 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 05:31:36.262526 17300 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:36.264421 17278 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:31:36.264649 17278 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "13af1af05d3744488ea095a59decebdf"
format_stamp: "Formatted at 2026-08-09 05:31:32 on dist-test-slave-h3ft"
server_key: "82d3be9727785a3ec15dda6e4a7e9cce"
server_key_iv: "34617f1ee9da555a309c05a93c4c5308"
server_key_version: "encryptionkey@0"
I20260809 05:31:36.265884 17278 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:31:36.310899 17278 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:31:36.316670 17278 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:31:36.317044 17278 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:31:36.318342 17278 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:31:36.320313 17278 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:31:36.320473 17278 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:36.320617 17278 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:31:36.320713 17278 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:36.360857 17278 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:45545
I20260809 05:31:36.360913 17459 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:45545 every 8 connection(s)
I20260809 05:31:36.362931 17278 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:31:36.371217 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 17278
I20260809 05:31:36.372161 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:35673
--local_ip_for_outbound_sockets=127.26.185.3
--tserver_master_addrs=127.26.185.62:33231
--webserver_port=37235
--webserver_interface=127.26.185.3
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:40013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 05:31:36 dist-test-slave-h3ft krb5kdc[16122](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253496, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:31:36.392730 17463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:36.366547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:41959 (local address 127.26.185.62:33231)
0809 05:31:36.367216 (+ 669us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:36.367222 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:36.368380 (+ 1158us) server_negotiation.cc:407] Connection header received
0809 05:31:36.370788 (+ 2408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:36.370795 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:36.370917 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:36.371103 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:36.373391 (+ 2288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:36.374188 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:36.376290 (+ 2102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:36.376904 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:36.378609 (+ 1705us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:36.384406 (+ 5797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:36.384417 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:36.384425 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:36.384516 (+ 91us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:36.388591 (+ 4075us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:36.389635 (+ 1044us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:36.389642 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:36.389644 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:36.389805 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:36.390356 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:36.390360 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:36.390363 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:36.390713 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:36.390902 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:36.391919 (+ 1017us) server_negotiation.cc:299] Negotiation successful
0809 05:31:36.392223 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":530,"thread_start_us":323,"threads_started":1}
I20260809 05:31:36.394094 17464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:36.367205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.2:41959)
0809 05:31:36.368157 (+ 952us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:36.368217 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:36.370309 (+ 2092us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:36.371464 (+ 1155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:36.371482 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:36.372217 (+ 735us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:31:36.373131 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:36.373155 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:36.374395 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:36.374399 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:36.376104 (+ 1705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:36.376119 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:36.378715 (+ 2596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:36.378724 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:36.379218 (+ 494us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:36.380320 (+ 1102us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:31:36.380361 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:31:36.384011 (+ 3650us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:31:36.388819 (+ 4808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:36.388838 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:36.388861 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:36.389443 (+ 582us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:36.389946 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:36.389952 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:36.389956 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:36.390208 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:36.390874 (+ 666us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:31:36.390884 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:31:36.391442 (+ 558us) client_negotiation.cc:769] Sending connection context
0809 05:31:36.391806 (+ 364us) client_negotiation.cc:240] Negotiation successful
0809 05:31:36.392556 (+ 750us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":356,"threads_started":1}
I20260809 05:31:36.396378 17460 heartbeater.cc:347] Connected to a master server at 127.26.185.62:33231
I20260809 05:31:36.396813 17460 heartbeater.cc:464] Registering TS with master...
I20260809 05:31:36.397827 17460 heartbeater.cc:511] Master 127.26.185.62:33231 requested a full tablet report, sending...
I20260809 05:31:36.399883 17004 ts_manager.cc:194] Registered new tserver with Master: 13af1af05d3744488ea095a59decebdf (127.26.185.2:45545)
I20260809 05:31:36.400903 17004 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.2@KRBTEST.COM'} at 127.26.185.2:41959
I20260809 05:31:36.795416 17273 heartbeater.cc:503] Master 127.26.185.62:33231 was elected leader, sending a full tablet report...
W20260809 05:31:36.810053 17465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:31:36.810424 17465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:31:36.810534 17465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:31:36.818495 17465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:31:36.818642 17465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:31:36.818771 17465 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:31:36.830579 17465 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:40013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:35673
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=37235
--tserver_master_addrs=127.26.185.62:33231
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:31:36.832415 17465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:31:36.834306 17465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:31:36.853606 17479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:36.853595 17482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:36.854220 17484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:31:36.855320 17465 server_base.cc:1034] running on GCE node
I20260809 05:31:36.856163 17465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:31:36.857734 17465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:31:36.859127 17465 hybrid_clock.cc:648] HybridClock initialized: now 1786253496859050 us; error 68 us; skew 500 ppm
I20260809 05:31:36.859594 17465 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:31:36 dist-test-slave-h3ft krb5kdc[16122](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253496, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:31:36.864077 17465 init.cc:377] Logged in from keytab as kudu/127.26.185.3@KRBTEST.COM (short username kudu)
I20260809 05:31:36.866219 17465 webserver.cc:460] Webserver started at http://127.26.185.3:37235/ using document root <none> and password file <none>
I20260809 05:31:36.867295 17465 fs_manager.cc:359] Metadata directory not provided
I20260809 05:31:36.867497 17465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:31:36.874820 17465 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 05:31:36.879123 17491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:36.881079 17465 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:31:36.881325 17465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "4e86b85cbc8a45acbc2d45bab4869284"
format_stamp: "Formatted at 2026-08-09 05:31:33 on dist-test-slave-h3ft"
server_key: "97483419748416474696408a8083d121"
server_key_iv: "8bb305ce598b516080817f21008f2afb"
server_key_version: "encryptionkey@0"
I20260809 05:31:36.882655 17465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:31:36.917579 17465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:31:36.923741 17465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:31:36.924103 17465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:31:36.925422 17465 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:31:36.927244 17465 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:31:36.927377 17465 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:36.927528 17465 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:31:36.927625 17465 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:36.968482 17465 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:35673
I20260809 05:31:36.968600 17657 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:35673 every 8 connection(s)
I20260809 05:31:36.970410 17465 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:31:36.976861 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 17465
Aug 09 05:31:36 dist-test-slave-h3ft krb5kdc[16122](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253496, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:31:36.996668 17665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:36.978243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57232 (local address 127.26.185.62:33231)
0809 05:31:36.979580 (+ 1337us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:36.979585 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:36.979601 (+ 16us) server_negotiation.cc:407] Connection header received
0809 05:31:36.979650 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:36.979653 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:36.979715 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:36.979839 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:36.981693 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:36.982674 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:36.984201 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:36.984769 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:36.984876 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:36.988765 (+ 3889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:36.988773 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:36.988778 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:36.988822 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:36.992694 (+ 3872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:36.993727 (+ 1033us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:36.993733 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:36.993736 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:36.993914 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:36.994577 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:36.994583 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:36.994586 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:36.995147 (+ 561us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:36.995491 (+ 344us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:36.995971 (+ 480us) server_negotiation.cc:299] Negotiation successful
0809 05:31:36.996262 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1207,"thread_start_us":967,"threads_started":1}
I20260809 05:31:36.997334 17661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:36.973863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:53491 (local address 127.26.185.62:33231)
0809 05:31:36.974493 (+ 630us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:36.974500 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:36.975867 (+ 1367us) server_negotiation.cc:407] Connection header received
0809 05:31:36.979067 (+ 3200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:36.979077 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:36.979219 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:36.979381 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:36.981607 (+ 2226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:36.982552 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:36.984492 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:36.985081 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:36.985212 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:36.989814 (+ 4602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:36.989819 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:36.989823 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:36.989874 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:36.993165 (+ 3291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:36.994261 (+ 1096us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:36.994268 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:36.994272 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:36.994446 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:36.995060 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:36.995066 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:36.995075 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:36.995423 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:36.995617 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:36.996483 (+ 866us) server_negotiation.cc:299] Negotiation successful
0809 05:31:36.996914 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":274,"threads_started":1}
I20260809 05:31:36.998836 17662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:36.974634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.3:53491)
0809 05:31:36.975659 (+ 1025us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:36.975711 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:36.978608 (+ 2897us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:36.979942 (+ 1334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:36.979953 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:36.980666 (+ 713us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:31:36.981397 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:36.981417 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:36.982724 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:36.982731 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:36.984329 (+ 1598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:36.984343 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:36.985316 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:36.985321 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:36.985555 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:36.986239 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:31:36.986266 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:31:36.989535 (+ 3269us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:31:36.993341 (+ 3806us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:36.993350 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:36.993370 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:36.994107 (+ 737us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:36.994587 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:36.994592 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:36.994596 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:36.994890 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:36.995573 (+ 683us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:31:36.995584 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:31:36.996066 (+ 482us) client_negotiation.cc:769] Sending connection context
0809 05:31:36.996385 (+ 319us) client_negotiation.cc:240] Negotiation successful
0809 05:31:36.997111 (+ 726us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":716,"thread_start_us":394,"threads_started":1}
I20260809 05:31:37.000571 17659 heartbeater.cc:347] Connected to a master server at 127.26.185.62:33231
I20260809 05:31:37.000943 17659 heartbeater.cc:464] Registering TS with master...
I20260809 05:31:37.001837 17659 heartbeater.cc:511] Master 127.26.185.62:33231 requested a full tablet report, sending...
I20260809 05:31:37.003623 17002 ts_manager.cc:194] Registered new tserver with Master: 4e86b85cbc8a45acbc2d45bab4869284 (127.26.185.3:35673)
I20260809 05:31:37.004796 17002 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.3@KRBTEST.COM'} at 127.26.185.3:53491
I20260809 05:31:37.013367 27364 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 05:31:37.021447 17661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:37.014488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57242 (local address 127.26.185.62:33231)
0809 05:31:37.014689 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:37.014694 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:37.015395 (+ 701us) server_negotiation.cc:407] Connection header received
0809 05:31:37.015619 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:37.015623 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:37.015828 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:37.015996 (+ 168us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:31:37.016462 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:37.017264 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:37.018900 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:37.019479 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:37.019588 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:37.020127 (+ 539us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:31:37.020834 (+ 707us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:31:37.020969 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:37.021072 (+ 103us) server_negotiation.cc:299] Negotiation successful
0809 05:31:37.021155 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 05:31:37.022603 17002 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:57242:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 05:31:37.031790 17002 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 05:31:37.076300 17679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:37.049208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:45545 (local address 127.0.0.1:40662)
0809 05:31:37.064107 (+ 14899us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:37.064199 (+ 92us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:37.064551 (+ 352us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:37.066445 (+ 1894us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:37.066454 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:37.066490 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:31:37.067125 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:37.067143 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:37.069690 (+ 2547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:37.069696 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:37.072986 (+ 3290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:37.073005 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:37.075081 (+ 2076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:37.075090 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:37.075338 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:37.075399 (+ 61us) client_negotiation.cc:769] Sending connection context
0809 05:31:37.075574 (+ 175us) client_negotiation.cc:240] Negotiation successful
0809 05:31:37.075829 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14397,"thread_start_us":14135,"threads_started":1}
I20260809 05:31:37.076295 17684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:37.049999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40662 (local address 127.26.185.2:45545)
0809 05:31:37.065433 (+ 15434us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:37.065446 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:37.065489 (+ 43us) server_negotiation.cc:407] Connection header received
0809 05:31:37.065673 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:37.065686 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:37.066094 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:37.067549 (+ 1455us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:31:37.067762 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:37.069491 (+ 1729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:37.073288 (+ 3797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:37.074787 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:37.074975 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:37.075386 (+ 411us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:37.075644 (+ 258us) server_negotiation.cc:299] Negotiation successful
0809 05:31:37.075906 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15227,"thread_start_us":17237,"threads_started":1}
I20260809 05:31:37.077857 17682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:37.049300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:33909 (local address 127.0.0.1:34970)
0809 05:31:37.065947 (+ 16647us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:37.065971 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:37.066120 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:37.067494 (+ 1374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:37.067502 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:37.067554 (+ 52us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:31:37.068016 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:37.068028 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:37.070311 (+ 2283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:37.070316 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:37.073748 (+ 3432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:37.073764 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:37.076900 (+ 3136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:37.076906 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:37.077086 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:37.077112 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 05:31:37.077225 (+ 113us) client_negotiation.cc:240] Negotiation successful
0809 05:31:37.077407 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16493,"thread_start_us":16321,"threads_started":1}
I20260809 05:31:37.078948 17681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:37.049345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34970 (local address 127.26.185.1:33909)
0809 05:31:37.065434 (+ 16089us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:37.065446 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:37.066279 (+ 833us) server_negotiation.cc:407] Connection header received
0809 05:31:37.066550 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:37.066564 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:37.066839 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:37.067125 (+ 286us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:31:37.068299 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:37.070107 (+ 1808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:37.074005 (+ 3898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:37.075895 (+ 1890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:37.076049 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:37.076300 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:37.078338 (+ 2038us) server_negotiation.cc:299] Negotiation successful
0809 05:31:37.078587 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15819,"thread_start_us":15608,"threads_started":1}
I20260809 05:31:37.082878 17687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:37.068440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:35673 (local address 127.0.0.1:57980)
0809 05:31:37.072667 (+ 4227us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:37.072694 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:37.072924 (+ 230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:37.074201 (+ 1277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:37.074206 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:37.074235 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:31:37.074652 (+ 417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:37.074665 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:37.077271 (+ 2606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:37.077276 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:37.079593 (+ 2317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:37.079613 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:37.082015 (+ 2402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:37.082022 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:37.082219 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:37.082258 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 05:31:37.082360 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 05:31:37.082519 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4024,"thread_start_us":3815,"threads_started":1}
I20260809 05:31:37.082101 17375 tablet_service.cc:1467] Processing CreateTablet for tablet 5cd6cc3cc61b490597d0fac0853a4b32 (DEFAULT_TABLE table=test-table [id=06bc7c8099cb4c68b1aaafd31391dae2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:31:37.083206 17177 tablet_service.cc:1467] Processing CreateTablet for tablet 5cd6cc3cc61b490597d0fac0853a4b32 (DEFAULT_TABLE table=test-table [id=06bc7c8099cb4c68b1aaafd31391dae2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:31:37.083817 17685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:37.066746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57980 (local address 127.26.185.3:35673)
0809 05:31:37.071986 (+ 5240us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:37.072000 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:37.072857 (+ 857us) server_negotiation.cc:407] Connection header received
0809 05:31:37.073148 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:37.073159 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:37.073526 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:37.073800 (+ 274us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:31:37.074889 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:37.077082 (+ 2193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:37.079785 (+ 2703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:37.081420 (+ 1635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:37.081570 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:37.081828 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:37.083194 (+ 1366us) server_negotiation.cc:299] Negotiation successful
0809 05:31:37.083405 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4965,"thread_start_us":4720,"threads_started":1}
I20260809 05:31:37.084136 17375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cd6cc3cc61b490597d0fac0853a4b32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:31:37.084759 17177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cd6cc3cc61b490597d0fac0853a4b32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:31:37.088583 17566 tablet_service.cc:1467] Processing CreateTablet for tablet 5cd6cc3cc61b490597d0fac0853a4b32 (DEFAULT_TABLE table=test-table [id=06bc7c8099cb4c68b1aaafd31391dae2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:31:37.090379 17566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cd6cc3cc61b490597d0fac0853a4b32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:31:37.099637 17688 tablet_bootstrap.cc:492] T 5cd6cc3cc61b490597d0fac0853a4b32 P dbc74c333bd14948bd793098886ccf1d: Bootstrap starting.
I20260809 05:31:37.102033 17689 tablet_bootstrap.cc:492] T 5cd6cc3cc61b490597d0fac0853a4b32 P 13af1af05d3744488ea095a59decebdf: Bootstrap starting.
I20260809 05:31:37.106854 17688 tablet_bootstrap.cc:654] T 5cd6cc3cc61b490597d0fac0853a4b32 P dbc74c333bd14948bd793098886ccf1d: Neither blocks nor log segments found. Creating new log.
I20260809 05:31:37.106856 17689 tablet_bootstrap.cc:654] T 5cd6cc3cc61b490597d0fac0853a4b32 P 13af1af05d3744488ea095a59decebdf: Neither blocks nor log segments found. Creating new log.
I20260809 05:31:37.107746 17690 tablet_bootstrap.cc:492] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284: Bootstrap starting.
I20260809 05:31:37.108570 17689 log.cc:824] T 5cd6cc3cc61b490597d0fac0853a4b32 P 13af1af05d3744488ea095a59decebdf: Log is configured to *not* fsync() on all Append() calls
I20260809 05:31:37.109086 17688 log.cc:824] T 5cd6cc3cc61b490597d0fac0853a4b32 P dbc74c333bd14948bd793098886ccf1d: Log is configured to *not* fsync() on all Append() calls
I20260809 05:31:37.111937 17690 tablet_bootstrap.cc:654] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284: Neither blocks nor log segments found. Creating new log.
I20260809 05:31:37.112888 17688 tablet_bootstrap.cc:492] T 5cd6cc3cc61b490597d0fac0853a4b32 P dbc74c333bd14948bd793098886ccf1d: No bootstrap required, opened a new log
I20260809 05:31:37.113013 17689 tablet_bootstrap.cc:492] T 5cd6cc3cc61b490597d0fac0853a4b32 P 13af1af05d3744488ea095a59decebdf: No bootstrap required, opened a new log
I20260809 05:31:37.113272 17688 ts_tablet_manager.cc:1397] T 5cd6cc3cc61b490597d0fac0853a4b32 P dbc74c333bd14948bd793098886ccf1d: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.004s
I20260809 05:31:37.113332 17689 ts_tablet_manager.cc:1397] T 5cd6cc3cc61b490597d0fac0853a4b32 P 13af1af05d3744488ea095a59decebdf: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260809 05:31:37.113476 17690 log.cc:824] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284: Log is configured to *not* fsync() on all Append() calls
I20260809 05:31:37.117280 17690 tablet_bootstrap.cc:492] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284: No bootstrap required, opened a new log
I20260809 05:31:37.117625 17690 ts_tablet_manager.cc:1397] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.003s
I20260809 05:31:37.123231 17689 raft_consensus.cc:348] T 5cd6cc3cc61b490597d0fac0853a4b32 P 13af1af05d3744488ea095a59decebdf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc74c333bd14948bd793098886ccf1d" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33909 } } peers { permanent_uuid: "13af1af05d3744488ea095a59decebdf" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45545 } } peers { permanent_uuid: "4e86b85cbc8a45acbc2d45bab4869284" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 35673 } }
I20260809 05:31:37.123731 17689 raft_consensus.cc:374] T 5cd6cc3cc61b490597d0fac0853a4b32 P 13af1af05d3744488ea095a59decebdf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:31:37.123836 17689 raft_consensus.cc:729] T 5cd6cc3cc61b490597d0fac0853a4b32 P 13af1af05d3744488ea095a59decebdf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13af1af05d3744488ea095a59decebdf, State: Initialized, Role: FOLLOWER
I20260809 05:31:37.124620 17689 consensus_queue.cc:260] T 5cd6cc3cc61b490597d0fac0853a4b32 P 13af1af05d3744488ea095a59decebdf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc74c333bd14948bd793098886ccf1d" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33909 } } peers { permanent_uuid: "13af1af05d3744488ea095a59decebdf" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45545 } } peers { permanent_uuid: "4e86b85cbc8a45acbc2d45bab4869284" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 35673 } }
I20260809 05:31:37.125062 17688 raft_consensus.cc:348] T 5cd6cc3cc61b490597d0fac0853a4b32 P dbc74c333bd14948bd793098886ccf1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc74c333bd14948bd793098886ccf1d" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33909 } } peers { permanent_uuid: "13af1af05d3744488ea095a59decebdf" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45545 } } peers { permanent_uuid: "4e86b85cbc8a45acbc2d45bab4869284" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 35673 } }
I20260809 05:31:37.125545 17688 raft_consensus.cc:374] T 5cd6cc3cc61b490597d0fac0853a4b32 P dbc74c333bd14948bd793098886ccf1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:31:37.125658 17688 raft_consensus.cc:729] T 5cd6cc3cc61b490597d0fac0853a4b32 P dbc74c333bd14948bd793098886ccf1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc74c333bd14948bd793098886ccf1d, State: Initialized, Role: FOLLOWER
I20260809 05:31:37.126106 17460 heartbeater.cc:503] Master 127.26.185.62:33231 was elected leader, sending a full tablet report...
I20260809 05:31:37.126439 17688 consensus_queue.cc:260] T 5cd6cc3cc61b490597d0fac0853a4b32 P dbc74c333bd14948bd793098886ccf1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc74c333bd14948bd793098886ccf1d" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33909 } } peers { permanent_uuid: "13af1af05d3744488ea095a59decebdf" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45545 } } peers { permanent_uuid: "4e86b85cbc8a45acbc2d45bab4869284" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 35673 } }
I20260809 05:31:37.126801 17689 ts_tablet_manager.cc:1428] T 5cd6cc3cc61b490597d0fac0853a4b32 P 13af1af05d3744488ea095a59decebdf: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260809 05:31:37.128453 17688 ts_tablet_manager.cc:1428] T 5cd6cc3cc61b490597d0fac0853a4b32 P dbc74c333bd14948bd793098886ccf1d: Time spent starting tablet: real 0.015s user 0.007s sys 0.008s
I20260809 05:31:37.129962 17690 raft_consensus.cc:348] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc74c333bd14948bd793098886ccf1d" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33909 } } peers { permanent_uuid: "13af1af05d3744488ea095a59decebdf" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45545 } } peers { permanent_uuid: "4e86b85cbc8a45acbc2d45bab4869284" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 35673 } }
I20260809 05:31:37.130457 17690 raft_consensus.cc:374] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:31:37.130599 17690 raft_consensus.cc:729] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e86b85cbc8a45acbc2d45bab4869284, State: Initialized, Role: FOLLOWER
I20260809 05:31:37.131424 17690 consensus_queue.cc:260] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc74c333bd14948bd793098886ccf1d" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33909 } } peers { permanent_uuid: "13af1af05d3744488ea095a59decebdf" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45545 } } peers { permanent_uuid: "4e86b85cbc8a45acbc2d45bab4869284" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 35673 } }
I20260809 05:31:37.133783 17659 heartbeater.cc:503] Master 127.26.185.62:33231 was elected leader, sending a full tablet report...
I20260809 05:31:37.134452 17690 ts_tablet_manager.cc:1428] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284: Time spent starting tablet: real 0.017s user 0.017s sys 0.000s
I20260809 05:31:37.141583 17697 raft_consensus.cc:482] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:31:37.141878 17697 raft_consensus.cc:504] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc74c333bd14948bd793098886ccf1d" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33909 } } peers { permanent_uuid: "13af1af05d3744488ea095a59decebdf" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45545 } } peers { permanent_uuid: "4e86b85cbc8a45acbc2d45bab4869284" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 35673 } }
I20260809 05:31:37.143878 17697 leader_election.cc:288] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc74c333bd14948bd793098886ccf1d (127.26.185.1:33909), 13af1af05d3744488ea095a59decebdf (127.26.185.2:45545)
I20260809 05:31:37.149932 17684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:37.144419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:56129 (local address 127.26.185.2:45545)
0809 05:31:37.144689 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:37.144696 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:37.144716 (+ 20us) server_negotiation.cc:407] Connection header received
0809 05:31:37.144879 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:37.144883 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:37.144950 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:37.145071 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:31:37.145552 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:37.146362 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:37.148141 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:37.148958 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:37.149141 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:37.149245 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:37.149505 (+ 260us) server_negotiation.cc:299] Negotiation successful
0809 05:31:37.149642 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117}
I20260809 05:31:37.149923 17662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:37.144200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:45545 (local address 127.26.185.3:56129)
0809 05:31:37.144551 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:37.144577 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:37.144716 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:37.145123 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:37.145130 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:37.145158 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:31:37.145395 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:37.145405 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:37.146505 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:37.146513 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:37.147969 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:37.147982 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:37.149122 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:37.149128 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:37.149328 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:37.149355 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 05:31:37.149469 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 05:31:37.149611 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151}
I20260809 05:31:37.151099 17698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:37.144346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:33909 (local address 127.26.185.3:44345)
0809 05:31:37.145495 (+ 1149us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:37.145515 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:37.145668 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:37.146013 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:37.146017 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:37.146049 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:31:37.146384 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:37.146392 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:37.147513 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:37.147519 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:37.148940 (+ 1421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:37.148951 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:37.150329 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:37.150335 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:37.150519 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:37.150565 (+ 46us) client_negotiation.cc:769] Sending connection context
0809 05:31:37.150649 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 05:31:37.150740 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1015,"mutex_wait_us":34,"thread_start_us":735,"threads_started":1}
I20260809 05:31:37.151196 17681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:37.144357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:44345 (local address 127.26.185.1:33909)
0809 05:31:37.144634 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:37.144639 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:37.145614 (+ 975us) server_negotiation.cc:407] Connection header received
0809 05:31:37.145826 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:37.145831 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:37.145898 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:37.146000 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:31:37.146550 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:37.147364 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:37.149109 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:37.149932 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:37.150142 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:37.150219 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:37.150719 (+ 500us) server_negotiation.cc:299] Negotiation successful
0809 05:31:37.150865 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260809 05:31:37.151258 17402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cd6cc3cc61b490597d0fac0853a4b32" candidate_uuid: "4e86b85cbc8a45acbc2d45bab4869284" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13af1af05d3744488ea095a59decebdf" is_pre_election: true
I20260809 05:31:37.152005 17402 raft_consensus.cc:2454] T 5cd6cc3cc61b490597d0fac0853a4b32 P 13af1af05d3744488ea095a59decebdf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e86b85cbc8a45acbc2d45bab4869284 in term 0.
I20260809 05:31:37.152433 17203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cd6cc3cc61b490597d0fac0853a4b32" candidate_uuid: "4e86b85cbc8a45acbc2d45bab4869284" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc74c333bd14948bd793098886ccf1d" is_pre_election: true
I20260809 05:31:37.152915 17493 leader_election.cc:302] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13af1af05d3744488ea095a59decebdf, 4e86b85cbc8a45acbc2d45bab4869284; no voters:
I20260809 05:31:37.153158 17203 raft_consensus.cc:2454] T 5cd6cc3cc61b490597d0fac0853a4b32 P dbc74c333bd14948bd793098886ccf1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e86b85cbc8a45acbc2d45bab4869284 in term 0.
I20260809 05:31:37.153430 17697 raft_consensus.cc:2781] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:31:37.153594 17697 raft_consensus.cc:482] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:31:37.153729 17697 raft_consensus.cc:3037] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:31:37.156579 17697 raft_consensus.cc:504] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc74c333bd14948bd793098886ccf1d" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33909 } } peers { permanent_uuid: "13af1af05d3744488ea095a59decebdf" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45545 } } peers { permanent_uuid: "4e86b85cbc8a45acbc2d45bab4869284" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 35673 } }
I20260809 05:31:37.157339 17697 leader_election.cc:288] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284 [CANDIDATE]: Term 1 election: Requested vote from peers dbc74c333bd14948bd793098886ccf1d (127.26.185.1:33909), 13af1af05d3744488ea095a59decebdf (127.26.185.2:45545)
I20260809 05:31:37.157812 17203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cd6cc3cc61b490597d0fac0853a4b32" candidate_uuid: "4e86b85cbc8a45acbc2d45bab4869284" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc74c333bd14948bd793098886ccf1d"
I20260809 05:31:37.157965 17402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cd6cc3cc61b490597d0fac0853a4b32" candidate_uuid: "4e86b85cbc8a45acbc2d45bab4869284" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13af1af05d3744488ea095a59decebdf"
I20260809 05:31:37.158123 17203 raft_consensus.cc:3037] T 5cd6cc3cc61b490597d0fac0853a4b32 P dbc74c333bd14948bd793098886ccf1d [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:31:37.158236 17402 raft_consensus.cc:3037] T 5cd6cc3cc61b490597d0fac0853a4b32 P 13af1af05d3744488ea095a59decebdf [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:31:37.161949 17203 raft_consensus.cc:2454] T 5cd6cc3cc61b490597d0fac0853a4b32 P dbc74c333bd14948bd793098886ccf1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e86b85cbc8a45acbc2d45bab4869284 in term 1.
I20260809 05:31:37.161950 17402 raft_consensus.cc:2454] T 5cd6cc3cc61b490597d0fac0853a4b32 P 13af1af05d3744488ea095a59decebdf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e86b85cbc8a45acbc2d45bab4869284 in term 1.
I20260809 05:31:37.162478 17492 leader_election.cc:302] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e86b85cbc8a45acbc2d45bab4869284, dbc74c333bd14948bd793098886ccf1d; no voters:
I20260809 05:31:37.162861 17697 raft_consensus.cc:2781] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:31:37.163432 17697 raft_consensus.cc:686] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284 [term 1 LEADER]: Becoming Leader. State: Replica: 4e86b85cbc8a45acbc2d45bab4869284, State: Running, Role: LEADER
I20260809 05:31:37.164039 17697 consensus_queue.cc:237] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc74c333bd14948bd793098886ccf1d" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33909 } } peers { permanent_uuid: "13af1af05d3744488ea095a59decebdf" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45545 } } peers { permanent_uuid: "4e86b85cbc8a45acbc2d45bab4869284" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 35673 } }
I20260809 05:31:37.170125 17004 catalog_manager.cc:5495] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e86b85cbc8a45acbc2d45bab4869284 (127.26.185.3). New cstate: current_term: 1 leader_uuid: "4e86b85cbc8a45acbc2d45bab4869284" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc74c333bd14948bd793098886ccf1d" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13af1af05d3744488ea095a59decebdf" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e86b85cbc8a45acbc2d45bab4869284" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 35673 } health_report { overall_health: HEALTHY } } }
I20260809 05:31:37.192232 17685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:37.185958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57986 (local address 127.26.185.3:35673)
0809 05:31:37.186179 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:37.186184 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:37.186302 (+ 118us) server_negotiation.cc:407] Connection header received
0809 05:31:37.186518 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:37.186522 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:37.186629 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:37.186770 (+ 141us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:31:37.187234 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:37.188059 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:37.189664 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:37.190149 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:37.190262 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:37.190821 (+ 559us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:31:37.191679 (+ 858us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:31:37.191809 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:37.191896 (+ 87us) server_negotiation.cc:299] Negotiation successful
0809 05:31:37.191980 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 05:31:37.202844 17203 raft_consensus.cc:1261] T 5cd6cc3cc61b490597d0fac0853a4b32 P dbc74c333bd14948bd793098886ccf1d [term 1 FOLLOWER]: Refusing update from remote peer 4e86b85cbc8a45acbc2d45bab4869284: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:31:37.202843 17402 raft_consensus.cc:1261] T 5cd6cc3cc61b490597d0fac0853a4b32 P 13af1af05d3744488ea095a59decebdf [term 1 FOLLOWER]: Refusing update from remote peer 4e86b85cbc8a45acbc2d45bab4869284: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:31:37.204113 17697 consensus_queue.cc:1035] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13af1af05d3744488ea095a59decebdf" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:31:37.204491 17700 consensus_queue.cc:1035] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc74c333bd14948bd793098886ccf1d" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:31:37.218350 17703 mvcc.cc:205] Tried to move back new op lower bound from 7316494324530532352 to 7316494324388462592. Current Snapshot: MvccSnapshot[applied={T|T < 7316494324530532352}]
I20260809 05:31:37.224253 17704 mvcc.cc:205] Tried to move back new op lower bound from 7316494324530532352 to 7316494324388462592. Current Snapshot: MvccSnapshot[applied={T|T < 7316494324530532352}]
I20260809 05:31:37.235613 17002 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:57242:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:31:37.235989 17002 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:57242:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:31:37.240664 17002 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7: Sending DeleteTablet for 3 replicas of tablet 5cd6cc3cc61b490597d0fac0853a4b32
I20260809 05:31:37.242259 17566 tablet_service.cc:1514] Processing DeleteTablet for tablet 5cd6cc3cc61b490597d0fac0853a4b32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:31:37 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:57980
I20260809 05:31:37.242213 17375 tablet_service.cc:1514] Processing DeleteTablet for tablet 5cd6cc3cc61b490597d0fac0853a4b32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:31:37 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:40662
I20260809 05:31:37.242286 17177 tablet_service.cc:1514] Processing DeleteTablet for tablet 5cd6cc3cc61b490597d0fac0853a4b32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:31:37 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:34970
I20260809 05:31:37.242676 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 17057
I20260809 05:31:37.244663 17719 tablet_replica.cc:330] T 5cd6cc3cc61b490597d0fac0853a4b32 P 13af1af05d3744488ea095a59decebdf: stopping tablet replica
I20260809 05:31:37.245378 17718 tablet_replica.cc:330] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284: stopping tablet replica
I20260809 05:31:37.246114 17718 raft_consensus.cc:2229] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284 [term 1 LEADER]: Raft consensus shutting down.
I20260809 05:31:37.246783 17719 raft_consensus.cc:2229] T 5cd6cc3cc61b490597d0fac0853a4b32 P 13af1af05d3744488ea095a59decebdf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:31:37.247578 17719 raft_consensus.cc:2258] T 5cd6cc3cc61b490597d0fac0853a4b32 P 13af1af05d3744488ea095a59decebdf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:31:37.248463 17718 raft_consensus.cc:2258] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:31:37.249742 17717 tablet_replica.cc:330] T 5cd6cc3cc61b490597d0fac0853a4b32 P dbc74c333bd14948bd793098886ccf1d: stopping tablet replica
I20260809 05:31:37.251335 17717 raft_consensus.cc:2229] T 5cd6cc3cc61b490597d0fac0853a4b32 P dbc74c333bd14948bd793098886ccf1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:31:37.252028 17717 raft_consensus.cc:2258] T 5cd6cc3cc61b490597d0fac0853a4b32 P dbc74c333bd14948bd793098886ccf1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:31:37.253399 17718 ts_tablet_manager.cc:1905] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:31:37.254482 17717 ts_tablet_manager.cc:1905] T 5cd6cc3cc61b490597d0fac0853a4b32 P dbc74c333bd14948bd793098886ccf1d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:31:37.256050 17719 ts_tablet_manager.cc:1905] T 5cd6cc3cc61b490597d0fac0853a4b32 P 13af1af05d3744488ea095a59decebdf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:31:37.262053 17718 ts_tablet_manager.cc:1918] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:31:37.262275 17718 log.cc:1196] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/wal/wals/5cd6cc3cc61b490597d0fac0853a4b32
I20260809 05:31:37.263062 17718 ts_tablet_manager.cc:1939] T 5cd6cc3cc61b490597d0fac0853a4b32 P 4e86b85cbc8a45acbc2d45bab4869284: Deleting consensus metadata
I20260809 05:31:37.263404 17717 ts_tablet_manager.cc:1918] T 5cd6cc3cc61b490597d0fac0853a4b32 P dbc74c333bd14948bd793098886ccf1d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:31:37.263602 17717 log.cc:1196] T 5cd6cc3cc61b490597d0fac0853a4b32 P dbc74c333bd14948bd793098886ccf1d: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/wal/wals/5cd6cc3cc61b490597d0fac0853a4b32
I20260809 05:31:37.264317 17717 ts_tablet_manager.cc:1939] T 5cd6cc3cc61b490597d0fac0853a4b32 P dbc74c333bd14948bd793098886ccf1d: Deleting consensus metadata
I20260809 05:31:37.265590 16976 catalog_manager.cc:4841] TS 4e86b85cbc8a45acbc2d45bab4869284 (127.26.185.3:35673): tablet 5cd6cc3cc61b490597d0fac0853a4b32 (table test-table [id=06bc7c8099cb4c68b1aaafd31391dae2]) successfully deleted
I20260809 05:31:37.266510 16976 catalog_manager.cc:4841] TS dbc74c333bd14948bd793098886ccf1d (127.26.185.1:33909): tablet 5cd6cc3cc61b490597d0fac0853a4b32 (table test-table [id=06bc7c8099cb4c68b1aaafd31391dae2]) successfully deleted
I20260809 05:31:37.271322 17681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:37.243977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34976 (local address 127.26.185.1:33909)
0809 05:31:37.244591 (+ 614us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:37.244598 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:37.244622 (+ 24us) server_negotiation.cc:407] Connection header received
0809 05:31:37.244699 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:37.244705 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:37.244809 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:37.244931 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:37.247370 (+ 2439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:37.248735 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:37.251067 (+ 2332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:37.251831 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:37.252015 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:37.261262 (+ 9247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:37.261281 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:37.261309 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:37.261373 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:37.266919 (+ 5546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:37.268160 (+ 1241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:37.268172 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:37.268179 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:37.268368 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:37.268890 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:37.268897 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:37.268904 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:37.269468 (+ 564us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:37.269847 (+ 379us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:37.270305 (+ 458us) server_negotiation.cc:299] Negotiation successful
0809 05:31:37.270602 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449}
I20260809 05:31:37.272193 17266 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:31:37.272518 17719 ts_tablet_manager.cc:1918] T 5cd6cc3cc61b490597d0fac0853a4b32 P 13af1af05d3744488ea095a59decebdf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:31:37.272763 17719 log.cc:1196] T 5cd6cc3cc61b490597d0fac0853a4b32 P 13af1af05d3744488ea095a59decebdf: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/wal/wals/5cd6cc3cc61b490597d0fac0853a4b32
I20260809 05:31:37.273319 17719 ts_tablet_manager.cc:1939] T 5cd6cc3cc61b490597d0fac0853a4b32 P 13af1af05d3744488ea095a59decebdf: Deleting consensus metadata
I20260809 05:31:37.275379 16978 catalog_manager.cc:4841] TS 13af1af05d3744488ea095a59decebdf (127.26.185.2:45545): tablet 5cd6cc3cc61b490597d0fac0853a4b32 (table test-table [id=06bc7c8099cb4c68b1aaafd31391dae2]) successfully deleted
I20260809 05:31:37.378705 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 17057
I20260809 05:31:37.412209 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 17278
I20260809 05:31:37.429169 17684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:37.413311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40670 (local address 127.26.185.2:45545)
0809 05:31:37.413535 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:37.413543 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:37.413570 (+ 27us) server_negotiation.cc:407] Connection header received
0809 05:31:37.413957 (+ 387us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:37.413965 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:37.414103 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:37.414234 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:37.416103 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:37.416938 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:37.418411 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:37.418853 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:37.419003 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:37.422150 (+ 3147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:37.422171 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:37.422194 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:37.422236 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:37.425610 (+ 3374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:37.426511 (+ 901us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:37.426521 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:37.426524 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:37.426687 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:37.427190 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:37.427197 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:37.427200 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:37.427701 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:37.428079 (+ 378us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:37.428455 (+ 376us) server_negotiation.cc:299] Negotiation successful
0809 05:31:37.428733 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260809 05:31:37.430231 17454 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:31:37.541980 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 17278
I20260809 05:31:37.588589 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 17465
I20260809 05:31:37.607678 17685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:37.589623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58002 (local address 127.26.185.3:35673)
0809 05:31:37.590001 (+ 378us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:37.590010 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:37.590037 (+ 27us) server_negotiation.cc:407] Connection header received
0809 05:31:37.590163 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:37.590169 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:37.590291 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:37.590423 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:37.592113 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:37.593533 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:37.595167 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:37.595916 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:37.596081 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:37.599138 (+ 3057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:37.599162 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:37.599200 (+ 38us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:37.599257 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:37.604091 (+ 4834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:37.604981 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:37.604998 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:37.605003 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:37.605229 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:37.605673 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:37.605680 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:37.605688 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:37.606243 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:37.606638 (+ 395us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:37.606837 (+ 199us) server_negotiation.cc:299] Negotiation successful
0809 05:31:37.607163 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202}
I20260809 05:31:37.608618 17649 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:31:37.755155 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 17465
I20260809 05:31:37.786911 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 16954
I20260809 05:31:37.788491 17049 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:31:37.922816 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 16954
I20260809 05:31:37.962016 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:33231
--webserver_interface=127.26.185.62
--webserver_port=35827
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:40013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:33231
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:31:38.389938 17726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:31:38.390360 17726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:31:38.390534 17726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:31:38.399274 17726 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:31:38.399425 17726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:31:38.399510 17726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:31:38.399607 17726 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:31:38.399699 17726 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:31:38.411578 17726 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:40013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:33231
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:33231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=35827
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:31:38.413648 17726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:31:38.415529 17726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:31:38.430033 17733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:38.430195 17734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:38.430378 17741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:31:38.431264 17726 server_base.cc:1034] running on GCE node
I20260809 05:31:38.432293 17726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:31:38.434168 17726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:31:38.435406 17726 hybrid_clock.cc:648] HybridClock initialized: now 1786253498435348 us; error 41 us; skew 500 ppm
I20260809 05:31:38.435808 17726 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:31:38 dist-test-slave-h3ft krb5kdc[16122](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253498, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:31:38.439841 17726 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:31:38.441753 17726 webserver.cc:460] Webserver started at http://127.26.185.62:35827/ using document root <none> and password file <none>
I20260809 05:31:38.442620 17726 fs_manager.cc:359] Metadata directory not provided
I20260809 05:31:38.442737 17726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:31:38.451900 17726 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.007s sys 0.000s
I20260809 05:31:38.455799 17748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:38.457650 17726 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 05:31:38.457885 17726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "e32ace97d3124854a30475fb4cb2feb7"
format_stamp: "Formatted at 2026-08-09 05:31:31 on dist-test-slave-h3ft"
server_key: "3447aef745b241fd293d43556db3aee4"
server_key_iv: "fb9667ad3e14e98658d3735394b53537"
server_key_version: "encryptionkey@0"
I20260809 05:31:38.459219 17726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:31:38.506016 17726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:31:38.512198 17726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:31:38.512622 17726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:31:38.534804 17726 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:33231
I20260809 05:31:38.534826 17818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:33231 every 8 connection(s)
I20260809 05:31:38.536824 17726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:31:38.542632 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 17726
I20260809 05:31:38.543730 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:33909
--local_ip_for_outbound_sockets=127.26.185.1
--tserver_master_addrs=127.26.185.62:33231
--webserver_port=35803
--webserver_interface=127.26.185.1
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:40013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:31:38.545624 17819 sys_catalog.cc:263] Verifying existing consensus state
I20260809 05:31:38.549582 17819 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7: Bootstrap starting.
I20260809 05:31:38.574749 17819 log.cc:824] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7: Log is configured to *not* fsync() on all Append() calls
I20260809 05:31:38.593796 17819 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 05:31:38.594514 17819 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7: Bootstrap complete.
I20260809 05:31:38.604959 17819 raft_consensus.cc:348] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e32ace97d3124854a30475fb4cb2feb7" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33231 } }
I20260809 05:31:38.606040 17819 raft_consensus.cc:729] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: e32ace97d3124854a30475fb4cb2feb7, State: Initialized, Role: FOLLOWER
I20260809 05:31:38.606865 17819 consensus_queue.cc:260] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e32ace97d3124854a30475fb4cb2feb7" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33231 } }
I20260809 05:31:38.607193 17819 raft_consensus.cc:388] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:31:38.607336 17819 raft_consensus.cc:482] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:31:38.607549 17819 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [term 2 FOLLOWER]: Advancing to term 3
I20260809 05:31:38.612231 17819 raft_consensus.cc:504] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e32ace97d3124854a30475fb4cb2feb7" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33231 } }
I20260809 05:31:38.612959 17819 leader_election.cc:302] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e32ace97d3124854a30475fb4cb2feb7; no voters:
I20260809 05:31:38.613821 17819 leader_election.cc:288] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 05:31:38.614027 17826 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [term 3 FOLLOWER]: Leader election won for term 3
I20260809 05:31:38.615384 17826 raft_consensus.cc:686] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [term 3 LEADER]: Becoming Leader. State: Replica: e32ace97d3124854a30475fb4cb2feb7, State: Running, Role: LEADER
I20260809 05:31:38.616134 17826 consensus_queue.cc:237] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e32ace97d3124854a30475fb4cb2feb7" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33231 } }
I20260809 05:31:38.617048 17819 sys_catalog.cc:564] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:31:38.618991 17833 sys_catalog.cc:455] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e32ace97d3124854a30475fb4cb2feb7. Latest consensus state: current_term: 3 leader_uuid: "e32ace97d3124854a30475fb4cb2feb7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e32ace97d3124854a30475fb4cb2feb7" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33231 } } }
I20260809 05:31:38.619402 17833 sys_catalog.cc:458] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [sys.catalog]: This master's current role is: LEADER
I20260809 05:31:38.622267 17831 sys_catalog.cc:455] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "e32ace97d3124854a30475fb4cb2feb7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e32ace97d3124854a30475fb4cb2feb7" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33231 } } }
I20260809 05:31:38.622653 17831 sys_catalog.cc:458] T 00000000000000000000000000000000 P e32ace97d3124854a30475fb4cb2feb7 [sys.catalog]: This master's current role is: LEADER
I20260809 05:31:38.622831 17839 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:31:38.633369 17839 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:31:38.635309 17839 catalog_manager.cc:1259] Loaded cluster ID: 010314fd7bd742748a0c90bbcb34ecf5
I20260809 05:31:38.635499 17839 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260809 05:31:38.638000 17839 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fc2a1ab99ad google::LogMessage::Fail() at ??:0
@ 0x7fc2a1abc88a google::LogMessage::SendToLog() at ??:0
@ 0x7fc2a1ab94de google::LogMessage::Flush() at ??:0
@ 0x7fc2a1abaa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fc2b74ec512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7fc2b74e9976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fc2b7571610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7fc2b7571439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fc2a4705345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fc2a470891c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7fc2a4708799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fc2a46e3eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fc2a79bd6db start_thread at ??:0
@ 0x7fc2a095361f clone at ??:0
W20260809 05:31:39.072369 17823 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:31:39.072830 17823 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:31:39.073096 17823 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:31:39.081955 17823 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:31:39.082154 17823 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:31:39.082387 17823 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:31:39.094504 17823 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:40013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:33909
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=35803
--tserver_master_addrs=127.26.185.62:33231
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:31:39.096441 17823 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:31:39.098346 17823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:31:39.115844 17884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:39.115727 17887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:39.115785 17885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:31:39.116940 17823 server_base.cc:1034] running on GCE node
I20260809 05:31:39.117717 17823 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:31:39.118889 17823 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:31:39.120127 17823 hybrid_clock.cc:648] HybridClock initialized: now 1786253499120046 us; error 72 us; skew 500 ppm
I20260809 05:31:39.120491 17823 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:31:39 dist-test-slave-h3ft krb5kdc[16122](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253499, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:31:39.129913 17823 init.cc:377] Logged in from keytab as kudu/127.26.185.1@KRBTEST.COM (short username kudu)
I20260809 05:31:39.132055 17823 webserver.cc:460] Webserver started at http://127.26.185.1:35803/ using document root <none> and password file <none>
I20260809 05:31:39.133069 17823 fs_manager.cc:359] Metadata directory not provided
I20260809 05:31:39.133246 17823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:31:39.140443 17823 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.000s
I20260809 05:31:39.143989 17898 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:39.145725 17823 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 05:31:39.145948 17823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "dbc74c333bd14948bd793098886ccf1d"
format_stamp: "Formatted at 2026-08-09 05:31:31 on dist-test-slave-h3ft"
server_key: "a5bee64724adbd30aedb81de707c72b0"
server_key_iv: "35acc289eecc04a2f69292ef269aa998"
server_key_version: "encryptionkey@0"
I20260809 05:31:39.147260 17823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:31:39.164675 17823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:31:39.170233 17823 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:31:39.170603 17823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:31:39.171965 17823 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:31:39.173784 17823 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:31:39.173900 17823 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:39.174055 17823 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:31:39.174173 17823 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:39.215063 17823 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:33909
I20260809 05:31:39.215143 18061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:33909 every 8 connection(s)
I20260809 05:31:39.217116 17823 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:31:39.219234 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 17823
I20260809 05:31:39.220167 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:45545
--local_ip_for_outbound_sockets=127.26.185.2
--tserver_master_addrs=127.26.185.62:33231
--webserver_port=34231
--webserver_interface=127.26.185.2
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:40013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:31:39.224123 18065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:39.221631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.1:45545)
0809 05:31:39.222645 (+ 1014us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:39.222905 (+ 260us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":679,"thread_start_us":407,"threads_started":1}
W20260809 05:31:39.225063 18062 heartbeater.cc:644] Failed to heartbeat to 127.26.185.62:33231 (0 consecutive failures): Network error: Failed to ping master at 127.26.185.62:33231: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
I20260809 05:31:39.226138 18065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:39.225723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.1:53633)
0809 05:31:39.225907 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:39.225999 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260809 05:31:39.227196 18065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:39.226756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.1:32997)
0809 05:31:39.226912 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:39.227050 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260809 05:31:39.227429 18062 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 05:31:39.648700 18067 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:31:39.649147 18067 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:31:39.649358 18067 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:31:39.658289 18067 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:31:39.658512 18067 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:31:39.658732 18067 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:31:39.670411 18067 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:40013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:45545
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=34231
--tserver_master_addrs=127.26.185.62:33231
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:31:39.672482 18067 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:31:39.674350 18067 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:31:39.692262 18074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:39.692202 18075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:39.692171 18077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:31:39.693339 18067 server_base.cc:1034] running on GCE node
I20260809 05:31:39.694219 18067 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:31:39.695574 18067 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:31:39.696880 18067 hybrid_clock.cc:648] HybridClock initialized: now 1786253499696805 us; error 51 us; skew 500 ppm
I20260809 05:31:39.697326 18067 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:31:39 dist-test-slave-h3ft krb5kdc[16122](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253499, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:31:39.701462 18067 init.cc:377] Logged in from keytab as kudu/127.26.185.2@KRBTEST.COM (short username kudu)
I20260809 05:31:39.703389 18067 webserver.cc:460] Webserver started at http://127.26.185.2:34231/ using document root <none> and password file <none>
I20260809 05:31:39.704293 18067 fs_manager.cc:359] Metadata directory not provided
I20260809 05:31:39.704418 18067 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:31:39.711706 18067 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.005s sys 0.002s
I20260809 05:31:39.715323 18085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:39.717075 18067 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 05:31:39.717263 18067 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "13af1af05d3744488ea095a59decebdf"
format_stamp: "Formatted at 2026-08-09 05:31:32 on dist-test-slave-h3ft"
server_key: "82d3be9727785a3ec15dda6e4a7e9cce"
server_key_iv: "34617f1ee9da555a309c05a93c4c5308"
server_key_version: "encryptionkey@0"
I20260809 05:31:39.718467 18067 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:31:39.747359 18067 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:31:39.753100 18067 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:31:39.753407 18067 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:31:39.754673 18067 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:31:39.756553 18067 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:31:39.756668 18067 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:39.756759 18067 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:31:39.756824 18067 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:39.795974 18067 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:45545
I20260809 05:31:39.796046 18253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:45545 every 8 connection(s)
I20260809 05:31:39.797870 18067 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:31:39.801374 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 18067
I20260809 05:31:39.802202 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:35673
--local_ip_for_outbound_sockets=127.26.185.3
--tserver_master_addrs=127.26.185.62:33231
--webserver_port=37235
--webserver_interface=127.26.185.3
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:40013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:31:39.804280 18258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:39.801727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.2:35559)
0809 05:31:39.802768 (+ 1041us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:39.803160 (+ 392us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":664,"thread_start_us":430,"threads_started":1}
W20260809 05:31:39.805152 18255 heartbeater.cc:644] Failed to heartbeat to 127.26.185.62:33231 (0 consecutive failures): Network error: Failed to ping master at 127.26.185.62:33231: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
I20260809 05:31:39.806232 18258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:39.805848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.2:49709)
0809 05:31:39.806019 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:39.806106 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260809 05:31:39.807333 18258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:39.806833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.2:58853)
0809 05:31:39.807042 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:39.807156 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260809 05:31:39.807612 18255 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 05:31:40.229350 18260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:40.228226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.1:42827)
0809 05:31:40.228895 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:40.229049 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":349,"threads_started":1}
W20260809 05:31:40.239624 18259 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:31:40.240061 18259 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:31:40.240254 18259 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:31:40.249428 18259 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:31:40.249670 18259 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:31:40.249915 18259 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:31:40.262619 18259 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:40013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:35673
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=37235
--tserver_master_addrs=127.26.185.62:33231
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:31:40.264611 18259 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:31:40.266346 18259 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:31:40.282604 18273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:40.282600 18276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:40.282889 18270 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:31:40.283643 18259 server_base.cc:1034] running on GCE node
I20260809 05:31:40.284399 18259 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:31:40.285537 18259 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:31:40.286769 18259 hybrid_clock.cc:648] HybridClock initialized: now 1786253500286690 us; error 63 us; skew 500 ppm
I20260809 05:31:40.287190 18259 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:31:40 dist-test-slave-h3ft krb5kdc[16122](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253500, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:31:40.291162 18259 init.cc:377] Logged in from keytab as kudu/127.26.185.3@KRBTEST.COM (short username kudu)
I20260809 05:31:40.292997 18259 webserver.cc:460] Webserver started at http://127.26.185.3:37235/ using document root <none> and password file <none>
I20260809 05:31:40.293874 18259 fs_manager.cc:359] Metadata directory not provided
I20260809 05:31:40.293990 18259 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:31:40.300637 18259 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 05:31:40.304246 18291 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:40.305992 18259 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 05:31:40.306216 18259 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "4e86b85cbc8a45acbc2d45bab4869284"
format_stamp: "Formatted at 2026-08-09 05:31:33 on dist-test-slave-h3ft"
server_key: "97483419748416474696408a8083d121"
server_key_iv: "8bb305ce598b516080817f21008f2afb"
server_key_version: "encryptionkey@0"
I20260809 05:31:40.307488 18259 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:31:40.340555 18259 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:31:40.345927 18259 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:31:40.346272 18259 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:31:40.347604 18259 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:31:40.349277 18259 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:31:40.349411 18259 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:40.349567 18259 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:31:40.349663 18259 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:40.389294 18259 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:35673
I20260809 05:31:40.389336 18463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:35673 every 8 connection(s)
I20260809 05:31:40.391326 18259 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:31:40.394785 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 18259
I20260809 05:31:40.398221 18468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:40.395514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.3:57095)
0809 05:31:40.396653 (+ 1139us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:40.397042 (+ 389us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":679,"thread_start_us":409,"threads_started":1}
W20260809 05:31:40.399163 18464 heartbeater.cc:644] Failed to heartbeat to 127.26.185.62:33231 (0 consecutive failures): Network error: Failed to ping master at 127.26.185.62:33231: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
I20260809 05:31:40.400171 18468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:40.399771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.3:53277)
0809 05:31:40.399938 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:40.400049 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260809 05:31:40.401062 18468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:40.400704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.3:37353)
0809 05:31:40.400847 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:40.400933 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260809 05:31:40.401328 18464 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 05:31:40.809594 18471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:40.808507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.2:44731)
0809 05:31:40.809153 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:40.809283 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":313,"threads_started":1}
I20260809 05:31:41.231552 18472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:41.230421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.1:57543)
0809 05:31:41.231183 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:41.231305 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":322,"threads_started":1}
I20260809 05:31:41.403079 18475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:41.402065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.3:60701)
0809 05:31:41.402603 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:41.402721 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":258,"threads_started":1}
I20260809 05:31:41.811748 18476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:41.810711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.2:60631)
0809 05:31:41.811368 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:41.811504 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":373,"threads_started":1}
I20260809 05:31:42.233639 18477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:42.232695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.1:41551)
0809 05:31:42.233286 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:42.233398 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":302,"threads_started":1}
I20260809 05:31:42.405210 18478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:42.404258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.3:54013)
0809 05:31:42.404838 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:42.404946 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":293,"threads_started":1}
I20260809 05:31:42.814008 18479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:42.813056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.2:45937)
0809 05:31:42.813656 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:42.813759 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":311,"threads_started":1}
I20260809 05:31:43.235793 18480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:43.234763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.1:52703)
0809 05:31:43.235439 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:43.235561 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":395,"threads_started":1}
I20260809 05:31:43.407454 18482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:43.406480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.3:58071)
0809 05:31:43.407095 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:43.407206 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":293,"threads_started":1}
I20260809 05:31:43.816684 18483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:43.815540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.2:60269)
0809 05:31:43.816324 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:43.816437 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":617,"thread_start_us":380,"threads_started":1}
I20260809 05:31:44.237972 18484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:44.237064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.1:42419)
0809 05:31:44.237648 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:44.237753 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":300,"threads_started":1}
I20260809 05:31:44.409572 18485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:44.408706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.3:39839)
0809 05:31:44.409247 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:44.409350 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":278,"threads_started":1}
I20260809 05:31:44.818696 18486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:44.817790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.2:37559)
0809 05:31:44.818358 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:44.818457 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":304,"threads_started":1}
I20260809 05:31:45.240231 18487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:45.239275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.1:42685)
0809 05:31:45.239870 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:45.239991 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":306,"threads_started":1}
I20260809 05:31:45.411861 18488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:45.410782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.3:56431)
0809 05:31:45.411492 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:45.411612 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":576,"thread_start_us":399,"threads_started":1}
I20260809 05:31:45.821000 18490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:45.820018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.2:50277)
0809 05:31:45.820665 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:45.820785 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":322,"threads_started":1}
I20260809 05:31:46.242374 18493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:46.241399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.1:52331)
0809 05:31:46.241995 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:46.242098 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":263,"threads_started":1}
I20260809 05:31:46.414055 18495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:46.412994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.3:38441)
0809 05:31:46.413670 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:46.413796 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":387,"threads_started":1}
I20260809 05:31:46.823568 18496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:46.822345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.2:41831)
0809 05:31:46.823112 (+ 767us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:46.823211 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":605,"thread_start_us":351,"threads_started":1}
I20260809 05:31:47.244738 18497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:47.243778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.1:37307)
0809 05:31:47.244379 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:47.244492 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":310,"threads_started":1}
I20260809 05:31:47.416445 18500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:47.415389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.3:36763)
0809 05:31:47.416028 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:47.416144 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":282,"threads_started":1}
I20260809 05:31:47.825686 18502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:47.824745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.2:59887)
0809 05:31:47.825332 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:47.825452 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":303,"threads_started":1}
I20260809 05:31:48.247069 18503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:48.245999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.1:57123)
0809 05:31:48.246636 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:48.246754 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":303,"threads_started":1}
I20260809 05:31:48.418504 18504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:48.417613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.3:45001)
0809 05:31:48.418186 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:48.418291 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":327,"threads_started":1}
I20260809 05:31:48.828317 18505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:48.827198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.2:36249)
0809 05:31:48.827924 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:48.828054 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":326,"threads_started":1}
I20260809 05:31:49.249552 18506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:49.248469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.1:43741)
0809 05:31:49.249180 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:49.249301 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":397,"threads_started":1}
I20260809 05:31:49.420965 18507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:49.419891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.3:54205)
0809 05:31:49.420601 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:49.420733 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":379,"threads_started":1}
I20260809 05:31:49.830561 18508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:49.829618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.2:50687)
0809 05:31:49.830213 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:49.830323 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":337,"threads_started":1}
I20260809 05:31:50.252218 18510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:50.250998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.1:49273)
0809 05:31:50.251866 (+ 868us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:50.251983 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":619,"thread_start_us":446,"threads_started":1}
I20260809 05:31:50.423331 18512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:50.422258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.3:54721)
0809 05:31:50.422898 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:50.423087 (+ 189us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":399,"threads_started":1}
I20260809 05:31:50.832762 18513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:50.831748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.2:52465)
0809 05:31:50.832364 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:50.832507 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":326,"threads_started":1}
I20260809 05:31:51.254487 18514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:51.253523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.1:38923)
0809 05:31:51.254142 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:51.254258 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":327,"threads_started":1}
I20260809 05:31:51.425585 18515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:51.424642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.3:36113)
0809 05:31:51.425211 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:51.425330 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":311,"threads_started":1}
I20260809 05:31:51.835426 18516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:51.834215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.2:49691)
0809 05:31:51.834921 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:51.835143 (+ 222us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":401,"threads_started":1}
I20260809 05:31:52.257266 18517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:52.256002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.1:52571)
0809 05:31:52.256884 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:52.257014 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":727,"thread_start_us":517,"threads_started":1}
I20260809 05:31:52.427872 18518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:52.426884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.3:52617)
0809 05:31:52.427531 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:52.427643 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":360,"threads_started":1}
I20260809 05:31:52.837951 18519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:52.836791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.2:59377)
0809 05:31:52.837542 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:52.837671 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":615,"thread_start_us":450,"threads_started":1}
I20260809 05:31:53.259649 18521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:53.258542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.1:57049)
0809 05:31:53.259295 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:53.259403 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":582,"thread_start_us":367,"threads_started":1}
I20260809 05:31:53.430267 18524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:53.429217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.3:50829)
0809 05:31:53.429839 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:53.429960 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":319,"threads_started":1}
I20260809 05:31:53.840495 18526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:53.839453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.2:52623)
0809 05:31:53.840093 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:53.840227 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":310,"threads_started":1}
I20260809 05:31:54.262243 18528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:54.261298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.1:50111)
0809 05:31:54.261866 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:54.261988 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":290,"threads_started":1}
I20260809 05:31:54.432590 18529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:54.431538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.3:49373)
0809 05:31:54.432206 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:54.432323 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":379,"threads_started":1}
I20260809 05:31:54.843541 18532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:54.842156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.2:57159)
0809 05:31:54.842957 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:54.843186 (+ 229us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":602,"thread_start_us":442,"threads_started":1}
I20260809 05:31:55.264801 18533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:55.263736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.1:44243)
0809 05:31:55.264480 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:55.264594 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":441,"threads_started":1}
I20260809 05:31:55.398914 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 17823
I20260809 05:31:55.427752 18535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:55.400557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59152 (local address 127.26.185.1:33909)
0809 05:31:55.401457 (+ 900us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:55.401495 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:55.401577 (+ 82us) server_negotiation.cc:407] Connection header received
0809 05:31:55.404445 (+ 2868us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:55.404459 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:55.405085 (+ 626us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:55.405485 (+ 400us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:55.407356 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:55.408965 (+ 1609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:55.410394 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:55.411295 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:55.411517 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:55.419266 (+ 7749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:55.419279 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:55.419306 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:55.419371 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:55.423420 (+ 4049us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:55.424387 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:55.424396 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:55.424407 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:55.424649 (+ 242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:55.425135 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:55.425140 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:55.425142 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:55.425988 (+ 846us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:55.426312 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:55.426771 (+ 459us) server_negotiation.cc:299] Negotiation successful
0809 05:31:55.427364 (+ 593us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":542,"spinlock_wait_cycles":44928,"thread_start_us":515,"threads_started":1}
I20260809 05:31:55.429605 18057 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:31:55.440070 18538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:55.434325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33231 (local address 127.26.185.3:48523)
0809 05:31:55.439600 (+ 5275us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:55.439760 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5070,"thread_start_us":4896,"threads_started":1}
I20260809 05:31:55.524308 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 17823
I20260809 05:31:55.559429 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 18067
I20260809 05:31:55.582010 18539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:55.560844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37710 (local address 127.26.185.2:45545)
0809 05:31:55.561618 (+ 774us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:55.561638 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:55.561691 (+ 53us) server_negotiation.cc:407] Connection header received
0809 05:31:55.563889 (+ 2198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:55.563904 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:55.564633 (+ 729us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:55.565073 (+ 440us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:55.566741 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:55.568452 (+ 1711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:55.569883 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:55.570864 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:55.571136 (+ 272us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:55.574366 (+ 3230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:55.574376 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:55.574410 (+ 34us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:55.574462 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:55.577984 (+ 3522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:55.578783 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:55.578791 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:55.578800 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:55.579110 (+ 310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:55.579607 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:55.579612 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:55.579614 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:55.580336 (+ 722us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:55.580646 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:55.581109 (+ 463us) server_negotiation.cc:299] Negotiation successful
0809 05:31:55.581659 (+ 550us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":577,"thread_start_us":364,"threads_started":1}
I20260809 05:31:55.584004 18244 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:31:55.678498 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 18067
I20260809 05:31:55.714367 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 18259
I20260809 05:31:55.738176 18543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:55.715735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51510 (local address 127.26.185.3:35673)
0809 05:31:55.716497 (+ 762us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:55.716519 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:55.716578 (+ 59us) server_negotiation.cc:407] Connection header received
0809 05:31:55.718624 (+ 2046us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:55.718639 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:55.719435 (+ 796us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:55.719997 (+ 562us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:55.721662 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:55.723189 (+ 1527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:55.724762 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:55.725616 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:55.725779 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:55.729515 (+ 3736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:55.729527 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:55.729552 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:55.729633 (+ 81us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:55.733534 (+ 3901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:55.734485 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:55.734494 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:55.734504 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:55.734721 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:55.735266 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:55.735270 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:55.735272 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:55.736165 (+ 893us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:55.736457 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:55.737123 (+ 666us) server_negotiation.cc:299] Negotiation successful
0809 05:31:55.737753 (+ 630us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":570,"thread_start_us":381,"threads_started":1}
I20260809 05:31:55.740269 18458 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:31:55.834900 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 18259
2026-08-09T05:31:55Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (27007 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:31:55 dist-test-slave-h3ft krb5kdc[18547](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:31:55 dist-test-slave-h3ft krb5kdc[18547](info): set up 2 sockets
Aug 09 05:31:55 dist-test-slave-h3ft krb5kdc[18547](info): commencing operation
krb5kdc: starting...
W20260809 05:31:57.270355 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.383s user 0.006s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:31:57 dist-test-slave-h3ft krb5kdc[18547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253517, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:31:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:31:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
I20260809 05:31:57.655606 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:44243
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:33389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:44243
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:31:58.124571 18567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:31:58.125116 18567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:31:58.125298 18567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:31:58.133764 18567 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 05:31:58.133980 18567 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 05:31:58.134099 18567 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 05:31:58.134195 18567 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:31:58.134305 18567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:31:58.134440 18567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:31:58.134549 18567 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:31:58.134639 18567 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:31:58.146517 18567 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:33389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:44243
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:44243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:31:58.148463 18567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:31:58.150296 18567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:31:58.165693 18576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:58.165689 18577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:58.165676 18579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:31:58.167273 18567 server_base.cc:1034] running on GCE node
I20260809 05:31:58.168413 18567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:31:58.170252 18567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:31:58.171535 18567 hybrid_clock.cc:648] HybridClock initialized: now 1786253518171450 us; error 57 us; skew 500 ppm
I20260809 05:31:58.172024 18567 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:31:58 dist-test-slave-h3ft krb5kdc[18547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253518, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:31:58.176160 18567 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:31:58.178094 18567 webserver.cc:460] Webserver started at http://127.26.185.62:35617/ using document root <none> and password file <none>
I20260809 05:31:58.179088 18567 fs_manager.cc:359] Metadata directory not provided
I20260809 05:31:58.179224 18567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:31:58.179636 18567 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:31:58.183606 18567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "77850d510ea14382984bfcfefe74dc4d"
format_stamp: "Formatted at 2026-08-09 05:31:58 on dist-test-slave-h3ft"
server_key: "69088751a9974ad7b023f55aaab64db2"
server_key_iv: "bcd68203300b421bfd0648ebd532c11f"
server_key_version: "encryptionkey@0"
I20260809 05:31:58.184682 18567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "77850d510ea14382984bfcfefe74dc4d"
format_stamp: "Formatted at 2026-08-09 05:31:58 on dist-test-slave-h3ft"
server_key: "69088751a9974ad7b023f55aaab64db2"
server_key_iv: "bcd68203300b421bfd0648ebd532c11f"
server_key_version: "encryptionkey@0"
I20260809 05:31:58.191969 18567 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260809 05:31:58.196828 18593 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:58.198824 18567 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.003s
I20260809 05:31:58.199183 18567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "77850d510ea14382984bfcfefe74dc4d"
format_stamp: "Formatted at 2026-08-09 05:31:58 on dist-test-slave-h3ft"
server_key: "69088751a9974ad7b023f55aaab64db2"
server_key_iv: "bcd68203300b421bfd0648ebd532c11f"
server_key_version: "encryptionkey@0"
I20260809 05:31:58.199512 18567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:31:58.214643 18567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:31:58.220649 18567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:31:58.221030 18567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:31:58.244740 18567 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:44243
I20260809 05:31:58.244761 18671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:44243 every 8 connection(s)
I20260809 05:31:58.246626 18567 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:31:58.248433 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 18567
I20260809 05:31:58.248775 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:31:58.249593 27364 external_mini_cluster.cc:1428] Setting key 4322ad7b83bd60fd9a09df70809c6798
I20260809 05:31:58.252974 18672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 05:31:58 dist-test-slave-h3ft krb5kdc[18547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253517, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:31:58.270113 18672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d: Bootstrap starting.
I20260809 05:31:58.276049 18672 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d: Neither blocks nor log segments found. Creating new log.
I20260809 05:31:58.277681 18672 log.cc:824] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d: Log is configured to *not* fsync() on all Append() calls
I20260809 05:31:58.281948 18675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:58.252537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53864 (local address 127.26.185.62:44243)
0809 05:31:58.253610 (+ 1073us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:58.253631 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:58.253713 (+ 82us) server_negotiation.cc:407] Connection header received
0809 05:31:58.256676 (+ 2963us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:58.256722 (+ 46us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:58.257444 (+ 722us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:58.258078 (+ 634us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:58.260012 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:58.262384 (+ 2372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:58.264359 (+ 1975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:58.265608 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:58.265859 (+ 251us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:58.271041 (+ 5182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:58.271057 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:58.271084 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:58.271152 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:58.276000 (+ 4848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:58.276977 (+ 977us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:58.276989 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:58.277001 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:58.277278 (+ 277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:58.277759 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:58.277766 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:58.277771 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:58.278727 (+ 956us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:58.279116 (+ 389us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:58.279764 (+ 648us) server_negotiation.cc:299] Negotiation successful
0809 05:31:58.280304 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":735,"thread_start_us":432,"threads_started":1}
I20260809 05:31:58.282131 18672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d: No bootstrap required, opened a new log
I20260809 05:31:58.292043 18672 raft_consensus.cc:348] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77850d510ea14382984bfcfefe74dc4d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44243 } }
I20260809 05:31:58.292569 18672 raft_consensus.cc:374] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:31:58.292721 18672 raft_consensus.cc:729] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77850d510ea14382984bfcfefe74dc4d, State: Initialized, Role: FOLLOWER
I20260809 05:31:58.293551 18672 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77850d510ea14382984bfcfefe74dc4d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44243 } }
I20260809 05:31:58.293900 18672 raft_consensus.cc:388] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:31:58.294039 18672 raft_consensus.cc:482] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:31:58.294211 18672 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:31:58.297020 18672 raft_consensus.cc:504] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77850d510ea14382984bfcfefe74dc4d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44243 } }
I20260809 05:31:58.297653 18672 leader_election.cc:302] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77850d510ea14382984bfcfefe74dc4d; no voters:
I20260809 05:31:58.298346 18672 leader_election.cc:288] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:31:58.298537 18677 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:31:58.299393 18677 raft_consensus.cc:686] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [term 1 LEADER]: Becoming Leader. State: Replica: 77850d510ea14382984bfcfefe74dc4d, State: Running, Role: LEADER
I20260809 05:31:58.300045 18677 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77850d510ea14382984bfcfefe74dc4d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44243 } }
I20260809 05:31:58.301255 18672 sys_catalog.cc:564] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:31:58.303514 18679 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77850d510ea14382984bfcfefe74dc4d. Latest consensus state: current_term: 1 leader_uuid: "77850d510ea14382984bfcfefe74dc4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77850d510ea14382984bfcfefe74dc4d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44243 } } }
I20260809 05:31:58.304028 18679 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [sys.catalog]: This master's current role is: LEADER
I20260809 05:31:58.306036 18678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77850d510ea14382984bfcfefe74dc4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77850d510ea14382984bfcfefe74dc4d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44243 } } }
I20260809 05:31:58.306430 18678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [sys.catalog]: This master's current role is: LEADER
I20260809 05:31:58.312943 18686 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:31:58.319432 18686 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:31:58.331032 18686 catalog_manager.cc:1347] Generated new cluster ID: 6956b73c13be46e9bbce413195b0b1f8
I20260809 05:31:58.331194 18686 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:31:58.347963 18686 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:31:58.350159 18686 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:31:58.365207 18686 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d: Generated new TSK 0
I20260809 05:31:58.366346 18686 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.185.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
I20260809 05:31:58.467280 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:0
--local_ip_for_outbound_sockets=127.26.185.1
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:44243
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:33389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:31:58.917635 18701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:31:58.918048 18701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:31:58.918259 18701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:31:58.926533 18701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:31:58.926699 18701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:31:58.926959 18701 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:31:58.938544 18701 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:33389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:44243
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:31:58.940539 18701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:31:58.942346 18701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:31:58.959239 18716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:58.959184 18711 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:58.959165 18713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:31:58.960232 18701 server_base.cc:1034] running on GCE node
I20260809 05:31:58.961057 18701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:31:58.962344 18701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:31:58.963613 18701 hybrid_clock.cc:648] HybridClock initialized: now 1786253518963551 us; error 51 us; skew 500 ppm
I20260809 05:31:58.964027 18701 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:31:58 dist-test-slave-h3ft krb5kdc[18547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253518, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:31:58.968277 18701 init.cc:377] Logged in from keytab as kudu/127.26.185.1@KRBTEST.COM (short username kudu)
I20260809 05:31:58.970201 18701 webserver.cc:460] Webserver started at http://127.26.185.1:37531/ using document root <none> and password file <none>
I20260809 05:31:58.971231 18701 fs_manager.cc:359] Metadata directory not provided
I20260809 05:31:58.971427 18701 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:31:58.971854 18701 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:31:58.975899 18701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/data/instance:
uuid: "0c52f3b292e84243bd61a5cb61f0fcea"
format_stamp: "Formatted at 2026-08-09 05:31:58 on dist-test-slave-h3ft"
server_key: "4a77e4cfc3be81d51672dc430879f7fa"
server_key_iv: "a8472cbc63d5dd3fc7632e6a450f722a"
server_key_version: "encryptionkey@0"
I20260809 05:31:58.976871 18701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance:
uuid: "0c52f3b292e84243bd61a5cb61f0fcea"
format_stamp: "Formatted at 2026-08-09 05:31:58 on dist-test-slave-h3ft"
server_key: "4a77e4cfc3be81d51672dc430879f7fa"
server_key_iv: "a8472cbc63d5dd3fc7632e6a450f722a"
server_key_version: "encryptionkey@0"
I20260809 05:31:58.983785 18701 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260809 05:31:58.988160 18726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:58.989820 18701 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260809 05:31:58.990046 18701 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "0c52f3b292e84243bd61a5cb61f0fcea"
format_stamp: "Formatted at 2026-08-09 05:31:58 on dist-test-slave-h3ft"
server_key: "4a77e4cfc3be81d51672dc430879f7fa"
server_key_iv: "a8472cbc63d5dd3fc7632e6a450f722a"
server_key_version: "encryptionkey@0"
I20260809 05:31:58.990305 18701 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:31:59.029066 18701 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:31:59.035574 18701 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:31:59.035969 18701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:31:59.037436 18701 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:31:59.039374 18701 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:31:59.039489 18701 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:59.039676 18701 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:31:59.039757 18701 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:59.081123 18701 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:41937
I20260809 05:31:59.081198 18889 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:41937 every 8 connection(s)
I20260809 05:31:59.082895 18701 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:31:59.091218 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 18701
I20260809 05:31:59.091542 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance
I20260809 05:31:59.092424 27364 external_mini_cluster.cc:1428] Setting key 605dcee5e994abff3c58f6692253ddd0
Aug 09 05:31:59 dist-test-slave-h3ft krb5kdc[18547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253518, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:31:59.113384 18892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:59.086812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:37289 (local address 127.26.185.62:44243)
0809 05:31:59.087560 (+ 748us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:59.087566 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:59.088929 (+ 1363us) server_negotiation.cc:407] Connection header received
0809 05:31:59.091395 (+ 2466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:59.091403 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:59.091550 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:59.091703 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:59.094065 (+ 2362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:59.095188 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:59.097214 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:59.097693 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:59.097872 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:59.103816 (+ 5944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:59.103825 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:59.103828 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:59.103886 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:59.108087 (+ 4201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:59.109361 (+ 1274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:59.109370 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:59.109376 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:59.109579 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:59.110241 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:59.110250 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:59.110259 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:59.110679 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:59.110914 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:59.112442 (+ 1528us) server_negotiation.cc:299] Negotiation successful
0809 05:31:59.113003 (+ 561us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":409,"threads_started":1}
I20260809 05:31:59.115648 18893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:59.087745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.1:37289)
0809 05:31:59.088685 (+ 940us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:59.088739 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:59.090920 (+ 2181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:59.092061 (+ 1141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:59.092073 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:59.092864 (+ 791us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:31:59.093832 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:59.093860 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:59.095398 (+ 1538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:59.095403 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:59.097028 (+ 1625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:59.097044 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:59.098035 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:59.098044 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:59.098360 (+ 316us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:59.099446 (+ 1086us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:31:59.099490 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:31:59.103305 (+ 3815us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:31:59.108368 (+ 5063us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:59.108393 (+ 25us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:59.108418 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:59.109150 (+ 732us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:59.109760 (+ 610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:59.109767 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:59.109771 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:59.110080 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:59.110869 (+ 789us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:31:59.110881 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:31:59.111644 (+ 763us) client_negotiation.cc:769] Sending connection context
0809 05:31:59.112167 (+ 523us) client_negotiation.cc:240] Negotiation successful
0809 05:31:59.113209 (+ 1042us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":617,"thread_start_us":365,"threads_started":1}
I20260809 05:31:59.118160 18890 heartbeater.cc:347] Connected to a master server at 127.26.185.62:44243
I20260809 05:31:59.118602 18890 heartbeater.cc:464] Registering TS with master...
I20260809 05:31:59.119699 18890 heartbeater.cc:511] Master 127.26.185.62:44243 requested a full tablet report, sending...
I20260809 05:31:59.122707 18615 ts_manager.cc:194] Registered new tserver with Master: 0c52f3b292e84243bd61a5cb61f0fcea (127.26.185.1:41937)
I20260809 05:31:59.124584 18615 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.1@KRBTEST.COM'} at 127.26.185.1:37289
WARNING: no policy specified for kudu/127.26.185.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
I20260809 05:31:59.182469 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:0
--local_ip_for_outbound_sockets=127.26.185.2
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:44243
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:33389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:31:59.603616 18897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:31:59.604060 18897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:31:59.604241 18897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:31:59.612669 18897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:31:59.612859 18897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:31:59.613076 18897 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:31:59.625218 18897 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:33389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:44243
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:31:59.627329 18897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:31:59.629133 18897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:31:59.646117 18905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:59.646049 18908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:31:59.646070 18906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:31:59.652609 18897 server_base.cc:1034] running on GCE node
I20260809 05:31:59.653596 18897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:31:59.654948 18897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:31:59.656262 18897 hybrid_clock.cc:648] HybridClock initialized: now 1786253519656214 us; error 42 us; skew 500 ppm
I20260809 05:31:59.656721 18897 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:31:59 dist-test-slave-h3ft krb5kdc[18547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253519, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:31:59.661239 18897 init.cc:377] Logged in from keytab as kudu/127.26.185.2@KRBTEST.COM (short username kudu)
I20260809 05:31:59.663369 18897 webserver.cc:460] Webserver started at http://127.26.185.2:43755/ using document root <none> and password file <none>
I20260809 05:31:59.664316 18897 fs_manager.cc:359] Metadata directory not provided
I20260809 05:31:59.664476 18897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:31:59.664870 18897 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:31:59.668663 18897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/data/instance:
uuid: "bc85ed485bb24332a07e1090217c2aed"
format_stamp: "Formatted at 2026-08-09 05:31:59 on dist-test-slave-h3ft"
server_key: "bb6487fa0b3660c3dd257458f5126b68"
server_key_iv: "a75b6bed2c44ce9f0dbec077dfe7dc60"
server_key_version: "encryptionkey@0"
I20260809 05:31:59.669616 18897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance:
uuid: "bc85ed485bb24332a07e1090217c2aed"
format_stamp: "Formatted at 2026-08-09 05:31:59 on dist-test-slave-h3ft"
server_key: "bb6487fa0b3660c3dd257458f5126b68"
server_key_iv: "a75b6bed2c44ce9f0dbec077dfe7dc60"
server_key_version: "encryptionkey@0"
I20260809 05:31:59.676429 18897 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260809 05:31:59.681051 18916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:59.682885 18897 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.004s
I20260809 05:31:59.683174 18897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "bc85ed485bb24332a07e1090217c2aed"
format_stamp: "Formatted at 2026-08-09 05:31:59 on dist-test-slave-h3ft"
server_key: "bb6487fa0b3660c3dd257458f5126b68"
server_key_iv: "a75b6bed2c44ce9f0dbec077dfe7dc60"
server_key_version: "encryptionkey@0"
I20260809 05:31:59.683459 18897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:31:59.698983 18897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:31:59.704728 18897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:31:59.705124 18897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:31:59.706545 18897 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:31:59.708294 18897 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:31:59.708413 18897 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:59.708595 18897 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:31:59.708684 18897 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:31:59.748871 18897 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:45901
I20260809 05:31:59.748944 19094 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:45901 every 8 connection(s)
I20260809 05:31:59.750589 18897 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:31:59.755616 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 18897
I20260809 05:31:59.755882 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance
I20260809 05:31:59.756557 27364 external_mini_cluster.cc:1428] Setting key 914eadd0211c4ae9f70f5e72df384142
Aug 09 05:31:59 dist-test-slave-h3ft krb5kdc[18547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253519, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:31:59.777231 19097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:59.754207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:45115 (local address 127.26.185.62:44243)
0809 05:31:59.754850 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0809 05:31:59.754856 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:31:59.756241 (+ 1385us) server_negotiation.cc:407] Connection header received
0809 05:31:59.758501 (+ 2260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:31:59.758506 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:31:59.758605 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:31:59.758776 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:31:59.760776 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:59.762170 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:59.764172 (+ 2002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:31:59.764988 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:31:59.765142 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:59.769349 (+ 4207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:31:59.769358 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:31:59.769366 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:31:59.769420 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:31:59.773479 (+ 4059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:59.774371 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:59.774380 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:59.774386 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:59.774563 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:31:59.775054 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:31:59.775061 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:31:59.775067 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:31:59.775430 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:31:59.775558 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 05:31:59.776668 (+ 1110us) server_negotiation.cc:299] Negotiation successful
0809 05:31:59.776892 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":359,"threads_started":1}
I20260809 05:31:59.779196 19099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:31:59.754866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.2:45115)
0809 05:31:59.755994 (+ 1128us) negotiation.cc:107] Waiting for socket to connect
0809 05:31:59.756051 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 05:31:59.758168 (+ 2117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:31:59.759140 (+ 972us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:31:59.759152 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:31:59.759797 (+ 645us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:31:59.760546 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:59.760569 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:59.762389 (+ 1820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:59.762395 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:59.763998 (+ 1603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:31:59.764013 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:31:59.765226 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:31:59.765231 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:31:59.765462 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:31:59.766330 (+ 868us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:31:59.766358 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:31:59.769046 (+ 2688us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:31:59.773662 (+ 4616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:59.773671 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:59.773690 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:59.774219 (+ 529us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:59.774677 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:31:59.774681 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:31:59.774683 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:31:59.774903 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:31:59.775579 (+ 676us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:31:59.775591 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:31:59.776175 (+ 584us) client_negotiation.cc:769] Sending connection context
0809 05:31:59.776590 (+ 415us) client_negotiation.cc:240] Negotiation successful
0809 05:31:59.777325 (+ 735us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":772,"thread_start_us":448,"threads_started":1}
I20260809 05:31:59.781217 19095 heartbeater.cc:347] Connected to a master server at 127.26.185.62:44243
I20260809 05:31:59.781647 19095 heartbeater.cc:464] Registering TS with master...
I20260809 05:31:59.782614 19095 heartbeater.cc:511] Master 127.26.185.62:44243 requested a full tablet report, sending...
I20260809 05:31:59.784832 18615 ts_manager.cc:194] Registered new tserver with Master: bc85ed485bb24332a07e1090217c2aed (127.26.185.2:45901)
I20260809 05:31:59.786307 18615 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.2@KRBTEST.COM'} at 127.26.185.2:45115
WARNING: no policy specified for kudu/127.26.185.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
I20260809 05:31:59.843770 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:0
--local_ip_for_outbound_sockets=127.26.185.3
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:44243
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:33389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:32:00.128842 18890 heartbeater.cc:503] Master 127.26.185.62:44243 was elected leader, sending a full tablet report...
W20260809 05:32:00.285156 19103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:32:00.285650 19103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:32:00.285851 19103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:32:00.294595 19103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:32:00.294808 19103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:32:00.295054 19103 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:32:00.307394 19103 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:33389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:44243
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:32:00.309273 19103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:32:00.311071 19103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:32:00.328176 19112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:32:00.328145 19113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:32:00.328248 19116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:32:00.329126 19103 server_base.cc:1034] running on GCE node
I20260809 05:32:00.330013 19103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:32:00.331290 19103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:32:00.332551 19103 hybrid_clock.cc:648] HybridClock initialized: now 1786253520332475 us; error 69 us; skew 500 ppm
I20260809 05:32:00.333067 19103 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:32:00 dist-test-slave-h3ft krb5kdc[18547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253520, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:32:00.337105 19103 init.cc:377] Logged in from keytab as kudu/127.26.185.3@KRBTEST.COM (short username kudu)
I20260809 05:32:00.338919 19103 webserver.cc:460] Webserver started at http://127.26.185.3:40541/ using document root <none> and password file <none>
I20260809 05:32:00.339884 19103 fs_manager.cc:359] Metadata directory not provided
I20260809 05:32:00.340054 19103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:32:00.340427 19103 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:32:00.344247 19103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/data/instance:
uuid: "bd1dd4e479844edb99bac9cd8aa02be6"
format_stamp: "Formatted at 2026-08-09 05:32:00 on dist-test-slave-h3ft"
server_key: "60ce4833fea28e93297a552c4622caca"
server_key_iv: "f8c538005c712a664b366e2f614d6358"
server_key_version: "encryptionkey@0"
I20260809 05:32:00.345165 19103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance:
uuid: "bd1dd4e479844edb99bac9cd8aa02be6"
format_stamp: "Formatted at 2026-08-09 05:32:00 on dist-test-slave-h3ft"
server_key: "60ce4833fea28e93297a552c4622caca"
server_key_iv: "f8c538005c712a664b366e2f614d6358"
server_key_version: "encryptionkey@0"
I20260809 05:32:00.351873 19103 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260809 05:32:00.356472 19131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:32:00.358302 19103 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.004s
I20260809 05:32:00.358534 19103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "bd1dd4e479844edb99bac9cd8aa02be6"
format_stamp: "Formatted at 2026-08-09 05:32:00 on dist-test-slave-h3ft"
server_key: "60ce4833fea28e93297a552c4622caca"
server_key_iv: "f8c538005c712a664b366e2f614d6358"
server_key_version: "encryptionkey@0"
I20260809 05:32:00.358803 19103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:32:00.378526 19103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:32:00.384436 19103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:32:00.384807 19103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:32:00.386132 19103 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:32:00.388005 19103 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:32:00.388121 19103 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:32:00.388312 19103 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:32:00.388391 19103 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:32:00.432679 19103 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:40229
I20260809 05:32:00.432704 19297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:40229 every 8 connection(s)
I20260809 05:32:00.434348 19103 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:32:00.435627 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 19103
I20260809 05:32:00.435869 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance
I20260809 05:32:00.436426 27364 external_mini_cluster.cc:1428] Setting key 4ae46219d488a4b903507f066c08e0e0
Aug 09 05:32:00 dist-test-slave-h3ft krb5kdc[18547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253520, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:32:00.461830 19301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:00.437758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:38561 (local address 127.26.185.62:44243)
0809 05:32:00.438589 (+ 831us) server_negotiation.cc:206] Beginning negotiation
0809 05:32:00.438595 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:32:00.441056 (+ 2461us) server_negotiation.cc:407] Connection header received
0809 05:32:00.443322 (+ 2266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:32:00.443327 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:32:00.443446 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:32:00.443581 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:32:00.445435 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.446255 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.448043 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.448492 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.448634 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:00.455863 (+ 7229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:32:00.455869 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:32:00.455873 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:32:00.455910 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:32:00.458642 (+ 2732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:32:00.459515 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:32:00.459520 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:32:00.459522 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:32:00.459668 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:32:00.460078 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:32:00.460081 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:32:00.460083 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:32:00.460381 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:32:00.460529 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 05:32:00.461283 (+ 754us) server_negotiation.cc:299] Negotiation successful
0809 05:32:00.461495 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":702,"thread_start_us":535,"threads_started":1}
I20260809 05:32:00.463218 19302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:00.438653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.3:38561)
0809 05:32:00.440850 (+ 2197us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:00.440915 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0809 05:32:00.442937 (+ 2022us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:32:00.443891 (+ 954us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:32:00.443901 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:32:00.444527 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:32:00.445251 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:32:00.445272 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.446421 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.446427 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:32:00.447880 (+ 1453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:32:00.447894 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.448762 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.448770 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:32:00.449044 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:00.452514 (+ 3470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:32:00.452554 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:32:00.455638 (+ 3084us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:32:00.458778 (+ 3140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:32:00.458787 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:32:00.458804 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:32:00.459372 (+ 568us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:32:00.459768 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:32:00.459771 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:32:00.459774 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:32:00.459979 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:32:00.460489 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:32:00.460496 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:32:00.460894 (+ 398us) client_negotiation.cc:769] Sending connection context
0809 05:32:00.461177 (+ 283us) client_negotiation.cc:240] Negotiation successful
0809 05:32:00.461655 (+ 478us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1778,"thread_start_us":1503,"threads_started":1}
I20260809 05:32:00.465036 19298 heartbeater.cc:347] Connected to a master server at 127.26.185.62:44243
I20260809 05:32:00.465488 19298 heartbeater.cc:464] Registering TS with master...
I20260809 05:32:00.466670 19298 heartbeater.cc:511] Master 127.26.185.62:44243 requested a full tablet report, sending...
I20260809 05:32:00.468351 18615 ts_manager.cc:194] Registered new tserver with Master: bd1dd4e479844edb99bac9cd8aa02be6 (127.26.185.3:40229)
I20260809 05:32:00.469301 18615 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.3@KRBTEST.COM'} at 127.26.185.3:38561
I20260809 05:32:00.479532 27364 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 05:32:00.501073 19301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:00.484899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39120 (local address 127.26.185.62:44243)
0809 05:32:00.485155 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0809 05:32:00.485161 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:32:00.485808 (+ 647us) server_negotiation.cc:407] Connection header received
0809 05:32:00.485970 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:32:00.485975 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:32:00.486103 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:32:00.486216 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:32:00.488507 (+ 2291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.489505 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.491057 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.491551 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.491667 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:00.494517 (+ 2850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:32:00.494523 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:32:00.494527 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:32:00.494570 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:32:00.497897 (+ 3327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:32:00.498653 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:32:00.498658 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:32:00.498661 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:32:00.498830 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:32:00.499438 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:32:00.499443 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:32:00.499446 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:32:00.499880 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:32:00.500124 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0809 05:32:00.500567 (+ 443us) server_negotiation.cc:299] Negotiation successful
0809 05:32:00.500781 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260809 05:32:00.506964 18615 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39120:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 05:32:00.514950 18615 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 05:32:00.543898 19318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:00.532774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:45901 (local address 127.0.0.1:51608)
0809 05:32:00.533356 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:00.533380 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 05:32:00.533514 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:32:00.536081 (+ 2567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:32:00.536088 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:32:00.536116 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:32:00.536613 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:32:00.536628 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.538358 (+ 1730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.538364 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:32:00.540897 (+ 2533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:32:00.540915 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.542640 (+ 1725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.542647 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:32:00.542864 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:00.542937 (+ 73us) client_negotiation.cc:769] Sending connection context
0809 05:32:00.543116 (+ 179us) client_negotiation.cc:240] Negotiation successful
0809 05:32:00.543340 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"mutex_wait_us":43,"thread_start_us":299,"threads_started":1}
I20260809 05:32:00.544654 19320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:00.533148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51608 (local address 127.26.185.2:45901)
0809 05:32:00.535241 (+ 2093us) server_negotiation.cc:206] Beginning negotiation
0809 05:32:00.535250 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:32:00.535287 (+ 37us) server_negotiation.cc:407] Connection header received
0809 05:32:00.535376 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:32:00.535383 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:32:00.535658 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:32:00.536845 (+ 1187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:32:00.537071 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.538192 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.541082 (+ 2890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.542403 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.542576 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:00.542858 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0809 05:32:00.543195 (+ 337us) server_negotiation.cc:299] Negotiation successful
0809 05:32:00.543393 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1930,"thread_start_us":1794,"threads_started":1}
I20260809 05:32:00.544688 19315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:00.531366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:41937 (local address 127.0.0.1:56954)
0809 05:32:00.532241 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:00.532289 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 05:32:00.532512 (+ 223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:32:00.533701 (+ 1189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:32:00.533709 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:32:00.533738 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:32:00.534285 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:32:00.534301 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.537944 (+ 3643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.537950 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:32:00.541247 (+ 3297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:32:00.541258 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.543658 (+ 2400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.543664 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:32:00.543886 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:00.543931 (+ 45us) client_negotiation.cc:769] Sending connection context
0809 05:32:00.544038 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 05:32:00.544201 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":596,"mutex_wait_us":77,"thread_start_us":419,"threads_started":1}
I20260809 05:32:00.545550 19317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:00.531870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56954 (local address 127.26.185.1:41937)
0809 05:32:00.532710 (+ 840us) server_negotiation.cc:206] Beginning negotiation
0809 05:32:00.532719 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:32:00.532759 (+ 40us) server_negotiation.cc:407] Connection header received
0809 05:32:00.532886 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:32:00.532894 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:32:00.533253 (+ 359us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:32:00.533515 (+ 262us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:32:00.535422 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.537750 (+ 2328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.541433 (+ 3683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.543104 (+ 1671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.543248 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:00.543494 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0809 05:32:00.544940 (+ 1446us) server_negotiation.cc:299] Negotiation successful
0809 05:32:00.545148 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":617,"thread_start_us":394,"threads_started":1}
I20260809 05:32:00.546944 19322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:00.534343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52088 (local address 127.26.185.3:40229)
0809 05:32:00.538555 (+ 4212us) server_negotiation.cc:206] Beginning negotiation
0809 05:32:00.538562 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:32:00.538595 (+ 33us) server_negotiation.cc:407] Connection header received
0809 05:32:00.538691 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:32:00.538697 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:32:00.538879 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:32:00.539183 (+ 304us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:32:00.540024 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.541609 (+ 1585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.544207 (+ 2598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.545738 (+ 1531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.545944 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:00.546192 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0809 05:32:00.546407 (+ 215us) server_negotiation.cc:299] Negotiation successful
0809 05:32:00.546585 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4024,"thread_start_us":3804,"threads_started":1}
I20260809 05:32:00.550153 19321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:00.533876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:40229 (local address 127.0.0.1:52088)
0809 05:32:00.534959 (+ 1083us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:00.534982 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 05:32:00.535157 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:32:00.539163 (+ 4006us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:32:00.539170 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:32:00.539199 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:32:00.539780 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:32:00.539794 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.541766 (+ 1972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.541771 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:32:00.544019 (+ 2248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:32:00.544034 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.546016 (+ 1982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.546022 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:32:00.546195 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:00.546232 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 05:32:00.549537 (+ 3305us) client_negotiation.cc:240] Negotiation successful
0809 05:32:00.549714 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":908,"thread_start_us":678,"threads_started":1}
I20260809 05:32:00.550124 18798 tablet_service.cc:1467] Processing CreateTablet for tablet c5be60e1a158482ab8ef0912453d2831 (DEFAULT_TABLE table=test-table [id=7719c7e3eb124a09b832db9cd476c2ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:32:00.550117 18995 tablet_service.cc:1467] Processing CreateTablet for tablet c5be60e1a158482ab8ef0912453d2831 (DEFAULT_TABLE table=test-table [id=7719c7e3eb124a09b832db9cd476c2ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:32:00.552168 18798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5be60e1a158482ab8ef0912453d2831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:32:00.552177 18995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5be60e1a158482ab8ef0912453d2831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:32:00.554622 19197 tablet_service.cc:1467] Processing CreateTablet for tablet c5be60e1a158482ab8ef0912453d2831 (DEFAULT_TABLE table=test-table [id=7719c7e3eb124a09b832db9cd476c2ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:32:00.557497 19197 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5be60e1a158482ab8ef0912453d2831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:32:00.570140 19323 tablet_bootstrap.cc:492] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed: Bootstrap starting.
I20260809 05:32:00.571233 19326 tablet_bootstrap.cc:492] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea: Bootstrap starting.
I20260809 05:32:00.576021 19327 tablet_bootstrap.cc:492] T c5be60e1a158482ab8ef0912453d2831 P bd1dd4e479844edb99bac9cd8aa02be6: Bootstrap starting.
I20260809 05:32:00.576745 19323 tablet_bootstrap.cc:654] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed: Neither blocks nor log segments found. Creating new log.
I20260809 05:32:00.577100 19326 tablet_bootstrap.cc:654] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea: Neither blocks nor log segments found. Creating new log.
I20260809 05:32:00.578307 19326 log.cc:824] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea: Log is configured to *not* fsync() on all Append() calls
I20260809 05:32:00.578439 19323 log.cc:824] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed: Log is configured to *not* fsync() on all Append() calls
I20260809 05:32:00.580745 19327 tablet_bootstrap.cc:654] T c5be60e1a158482ab8ef0912453d2831 P bd1dd4e479844edb99bac9cd8aa02be6: Neither blocks nor log segments found. Creating new log.
I20260809 05:32:00.582301 19327 log.cc:824] T c5be60e1a158482ab8ef0912453d2831 P bd1dd4e479844edb99bac9cd8aa02be6: Log is configured to *not* fsync() on all Append() calls
I20260809 05:32:00.582368 19323 tablet_bootstrap.cc:492] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed: No bootstrap required, opened a new log
I20260809 05:32:00.582420 19326 tablet_bootstrap.cc:492] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea: No bootstrap required, opened a new log
I20260809 05:32:00.582726 19326 ts_tablet_manager.cc:1397] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.002s
I20260809 05:32:00.582751 19323 ts_tablet_manager.cc:1397] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.003s
I20260809 05:32:00.586344 19327 tablet_bootstrap.cc:492] T c5be60e1a158482ab8ef0912453d2831 P bd1dd4e479844edb99bac9cd8aa02be6: No bootstrap required, opened a new log
I20260809 05:32:00.586728 19327 ts_tablet_manager.cc:1397] T c5be60e1a158482ab8ef0912453d2831 P bd1dd4e479844edb99bac9cd8aa02be6: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.004s
I20260809 05:32:00.592670 19326 raft_consensus.cc:348] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c52f3b292e84243bd61a5cb61f0fcea" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41937 } } peers { permanent_uuid: "bc85ed485bb24332a07e1090217c2aed" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45901 } } peers { permanent_uuid: "bd1dd4e479844edb99bac9cd8aa02be6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40229 } }
I20260809 05:32:00.593235 19326 raft_consensus.cc:374] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:32:00.593367 19326 raft_consensus.cc:729] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c52f3b292e84243bd61a5cb61f0fcea, State: Initialized, Role: FOLLOWER
I20260809 05:32:00.594188 19326 consensus_queue.cc:260] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c52f3b292e84243bd61a5cb61f0fcea" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41937 } } peers { permanent_uuid: "bc85ed485bb24332a07e1090217c2aed" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45901 } } peers { permanent_uuid: "bd1dd4e479844edb99bac9cd8aa02be6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40229 } }
I20260809 05:32:00.594507 19323 raft_consensus.cc:348] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c52f3b292e84243bd61a5cb61f0fcea" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41937 } } peers { permanent_uuid: "bc85ed485bb24332a07e1090217c2aed" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45901 } } peers { permanent_uuid: "bd1dd4e479844edb99bac9cd8aa02be6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40229 } }
I20260809 05:32:00.595118 19323 raft_consensus.cc:374] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:32:00.595264 19323 raft_consensus.cc:729] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc85ed485bb24332a07e1090217c2aed, State: Initialized, Role: FOLLOWER
I20260809 05:32:00.596024 19323 consensus_queue.cc:260] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c52f3b292e84243bd61a5cb61f0fcea" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41937 } } peers { permanent_uuid: "bc85ed485bb24332a07e1090217c2aed" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45901 } } peers { permanent_uuid: "bd1dd4e479844edb99bac9cd8aa02be6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40229 } }
I20260809 05:32:00.596966 19326 ts_tablet_manager.cc:1428] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea: Time spent starting tablet: real 0.014s user 0.009s sys 0.006s
I20260809 05:32:00.598218 19095 heartbeater.cc:503] Master 127.26.185.62:44243 was elected leader, sending a full tablet report...
I20260809 05:32:00.599956 19323 ts_tablet_manager.cc:1428] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed: Time spent starting tablet: real 0.017s user 0.010s sys 0.008s
I20260809 05:32:00.600129 19327 raft_consensus.cc:348] T c5be60e1a158482ab8ef0912453d2831 P bd1dd4e479844edb99bac9cd8aa02be6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c52f3b292e84243bd61a5cb61f0fcea" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41937 } } peers { permanent_uuid: "bc85ed485bb24332a07e1090217c2aed" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45901 } } peers { permanent_uuid: "bd1dd4e479844edb99bac9cd8aa02be6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40229 } }
I20260809 05:32:00.600710 19327 raft_consensus.cc:374] T c5be60e1a158482ab8ef0912453d2831 P bd1dd4e479844edb99bac9cd8aa02be6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:32:00.600852 19327 raft_consensus.cc:729] T c5be60e1a158482ab8ef0912453d2831 P bd1dd4e479844edb99bac9cd8aa02be6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd1dd4e479844edb99bac9cd8aa02be6, State: Initialized, Role: FOLLOWER
I20260809 05:32:00.601691 19327 consensus_queue.cc:260] T c5be60e1a158482ab8ef0912453d2831 P bd1dd4e479844edb99bac9cd8aa02be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c52f3b292e84243bd61a5cb61f0fcea" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41937 } } peers { permanent_uuid: "bc85ed485bb24332a07e1090217c2aed" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45901 } } peers { permanent_uuid: "bd1dd4e479844edb99bac9cd8aa02be6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40229 } }
I20260809 05:32:00.604868 19327 ts_tablet_manager.cc:1428] T c5be60e1a158482ab8ef0912453d2831 P bd1dd4e479844edb99bac9cd8aa02be6: Time spent starting tablet: real 0.018s user 0.014s sys 0.004s
I20260809 05:32:00.604809 19298 heartbeater.cc:503] Master 127.26.185.62:44243 was elected leader, sending a full tablet report...
W20260809 05:32:00.686532 19300 tablet.cc:2369] T c5be60e1a158482ab8ef0912453d2831 P bd1dd4e479844edb99bac9cd8aa02be6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:32:00.688669 19338 raft_consensus.cc:482] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:32:00.689128 19338 raft_consensus.cc:504] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c52f3b292e84243bd61a5cb61f0fcea" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41937 } } peers { permanent_uuid: "bc85ed485bb24332a07e1090217c2aed" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45901 } } peers { permanent_uuid: "bd1dd4e479844edb99bac9cd8aa02be6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40229 } }
I20260809 05:32:00.691672 19338 leader_election.cc:288] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c52f3b292e84243bd61a5cb61f0fcea (127.26.185.1:41937), bd1dd4e479844edb99bac9cd8aa02be6 (127.26.185.3:40229)
I20260809 05:32:00.700546 19322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:00.693727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:55217 (local address 127.26.185.3:40229)
0809 05:32:00.693973 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0809 05:32:00.693979 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:32:00.694207 (+ 228us) server_negotiation.cc:407] Connection header received
0809 05:32:00.694407 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:32:00.694416 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:32:00.694550 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:32:00.694663 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:32:00.695473 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.696447 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.698544 (+ 2097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.699379 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.699558 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:00.699660 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 05:32:00.700070 (+ 410us) server_negotiation.cc:299] Negotiation successful
0809 05:32:00.700214 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260809 05:32:00.700549 19317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:00.692155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:48025 (local address 127.26.185.1:41937)
0809 05:32:00.692470 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0809 05:32:00.692479 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:32:00.693274 (+ 795us) server_negotiation.cc:407] Connection header received
0809 05:32:00.693579 (+ 305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:32:00.693590 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:32:00.693735 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:32:00.693853 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:32:00.694858 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.696218 (+ 1360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.698282 (+ 2064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.699403 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.699632 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:00.699718 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 05:32:00.700056 (+ 338us) server_negotiation.cc:299] Negotiation successful
0809 05:32:00.700213 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 05:32:00.700780 19344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:00.693291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:40229 (local address 127.26.185.2:55217)
0809 05:32:00.694081 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:00.694100 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 05:32:00.694239 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:32:00.694711 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:32:00.694717 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:32:00.694750 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:32:00.695248 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:32:00.695262 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.696629 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.696633 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:32:00.698352 (+ 1719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:32:00.698376 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.699656 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.699667 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:32:00.699882 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:00.699908 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 05:32:00.700023 (+ 115us) client_negotiation.cc:240] Negotiation successful
0809 05:32:00.700206 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":641,"mutex_wait_us":7,"thread_start_us":397,"threads_started":1}
I20260809 05:32:00.700817 19343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:00.692125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:41937 (local address 127.26.185.2:48025)
0809 05:32:00.693136 (+ 1011us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:00.693157 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 05:32:00.693387 (+ 230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:32:00.693964 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:32:00.693970 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:32:00.694006 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:32:00.694594 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:32:00.694612 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.696367 (+ 1755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.696372 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:32:00.698089 (+ 1717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:32:00.698102 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.699689 (+ 1587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.699695 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:32:00.699874 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:00.699901 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 05:32:00.700029 (+ 128us) client_negotiation.cc:240] Negotiation successful
0809 05:32:00.700209 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":858,"mutex_wait_us":34,"spinlock_wait_cycles":33152,"thread_start_us":609,"threads_started":1}
I20260809 05:32:00.702275 19227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5be60e1a158482ab8ef0912453d2831" candidate_uuid: "bc85ed485bb24332a07e1090217c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1dd4e479844edb99bac9cd8aa02be6" is_pre_election: true
I20260809 05:32:00.702281 18830 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5be60e1a158482ab8ef0912453d2831" candidate_uuid: "bc85ed485bb24332a07e1090217c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c52f3b292e84243bd61a5cb61f0fcea" is_pre_election: true
I20260809 05:32:00.703092 19227 raft_consensus.cc:2454] T c5be60e1a158482ab8ef0912453d2831 P bd1dd4e479844edb99bac9cd8aa02be6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc85ed485bb24332a07e1090217c2aed in term 0.
I20260809 05:32:00.703092 18830 raft_consensus.cc:2454] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc85ed485bb24332a07e1090217c2aed in term 0.
I20260809 05:32:00.704053 18921 leader_election.cc:302] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc85ed485bb24332a07e1090217c2aed, bd1dd4e479844edb99bac9cd8aa02be6; no voters:
I20260809 05:32:00.704638 19338 raft_consensus.cc:2781] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:32:00.704830 19338 raft_consensus.cc:482] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:32:00.704986 19338 raft_consensus.cc:3037] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:32:00.707834 19338 raft_consensus.cc:504] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c52f3b292e84243bd61a5cb61f0fcea" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41937 } } peers { permanent_uuid: "bc85ed485bb24332a07e1090217c2aed" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45901 } } peers { permanent_uuid: "bd1dd4e479844edb99bac9cd8aa02be6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40229 } }
I20260809 05:32:00.708564 19338 leader_election.cc:288] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed [CANDIDATE]: Term 1 election: Requested vote from peers 0c52f3b292e84243bd61a5cb61f0fcea (127.26.185.1:41937), bd1dd4e479844edb99bac9cd8aa02be6 (127.26.185.3:40229)
I20260809 05:32:00.709185 18830 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5be60e1a158482ab8ef0912453d2831" candidate_uuid: "bc85ed485bb24332a07e1090217c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c52f3b292e84243bd61a5cb61f0fcea"
I20260809 05:32:00.709265 19227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5be60e1a158482ab8ef0912453d2831" candidate_uuid: "bc85ed485bb24332a07e1090217c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1dd4e479844edb99bac9cd8aa02be6"
I20260809 05:32:00.709467 18830 raft_consensus.cc:3037] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:32:00.709501 19227 raft_consensus.cc:3037] T c5be60e1a158482ab8ef0912453d2831 P bd1dd4e479844edb99bac9cd8aa02be6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:32:00.713264 18830 raft_consensus.cc:2454] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc85ed485bb24332a07e1090217c2aed in term 1.
I20260809 05:32:00.713264 19227 raft_consensus.cc:2454] T c5be60e1a158482ab8ef0912453d2831 P bd1dd4e479844edb99bac9cd8aa02be6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc85ed485bb24332a07e1090217c2aed in term 1.
I20260809 05:32:00.713836 18921 leader_election.cc:302] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c52f3b292e84243bd61a5cb61f0fcea, bc85ed485bb24332a07e1090217c2aed; no voters:
I20260809 05:32:00.714179 19338 raft_consensus.cc:2781] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:32:00.714720 19338 raft_consensus.cc:686] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed [term 1 LEADER]: Becoming Leader. State: Replica: bc85ed485bb24332a07e1090217c2aed, State: Running, Role: LEADER
I20260809 05:32:00.715418 19338 consensus_queue.cc:237] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c52f3b292e84243bd61a5cb61f0fcea" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41937 } } peers { permanent_uuid: "bc85ed485bb24332a07e1090217c2aed" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45901 } } peers { permanent_uuid: "bd1dd4e479844edb99bac9cd8aa02be6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40229 } }
I20260809 05:32:00.721985 18615 catalog_manager.cc:5495] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed reported cstate change: term changed from 0 to 1, leader changed from <none> to bc85ed485bb24332a07e1090217c2aed (127.26.185.2). New cstate: current_term: 1 leader_uuid: "bc85ed485bb24332a07e1090217c2aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c52f3b292e84243bd61a5cb61f0fcea" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc85ed485bb24332a07e1090217c2aed" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd1dd4e479844edb99bac9cd8aa02be6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40229 } health_report { overall_health: UNKNOWN } } }
I20260809 05:32:00.744956 19320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:00.738353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51612 (local address 127.26.185.2:45901)
0809 05:32:00.738633 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0809 05:32:00.738647 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 05:32:00.738669 (+ 22us) server_negotiation.cc:407] Connection header received
0809 05:32:00.738911 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:32:00.738916 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:32:00.739070 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:32:00.739222 (+ 152us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:32:00.739618 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.740483 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.742071 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.742548 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.742671 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:00.743358 (+ 687us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:32:00.744066 (+ 708us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:32:00.744205 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 05:32:00.744375 (+ 170us) server_negotiation.cc:299] Negotiation successful
0809 05:32:00.744466 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
W20260809 05:32:00.753453 19096 tablet.cc:2369] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:32:00.756377 19227 raft_consensus.cc:1261] T c5be60e1a158482ab8ef0912453d2831 P bd1dd4e479844edb99bac9cd8aa02be6 [term 1 FOLLOWER]: Refusing update from remote peer bc85ed485bb24332a07e1090217c2aed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:32:00.756428 18830 raft_consensus.cc:1261] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea [term 1 FOLLOWER]: Refusing update from remote peer bc85ed485bb24332a07e1090217c2aed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:32:00.757592 19338 consensus_queue.cc:1035] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd1dd4e479844edb99bac9cd8aa02be6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:32:00.758070 19346 consensus_queue.cc:1035] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c52f3b292e84243bd61a5cb61f0fcea" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:32:00.775153 19353 mvcc.cc:205] Tried to move back new op lower bound from 7316494421004148736 to 7316494420855783424. Current Snapshot: MvccSnapshot[applied={T|T < 7316494421004148736}]
I20260809 05:32:00.790784 18614 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39120:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:32:00.791256 18614 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39120:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:32:00.796545 18614 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d: Sending DeleteTablet for 3 replicas of tablet c5be60e1a158482ab8ef0912453d2831
I20260809 05:32:00.798257 18798 tablet_service.cc:1514] Processing DeleteTablet for tablet c5be60e1a158482ab8ef0912453d2831 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:32:00 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:56954
I20260809 05:32:00.798661 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 18701
I20260809 05:32:00.798539 19197 tablet_service.cc:1514] Processing DeleteTablet for tablet c5be60e1a158482ab8ef0912453d2831 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:32:00 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:52088
I20260809 05:32:00.800019 18995 tablet_service.cc:1514] Processing DeleteTablet for tablet c5be60e1a158482ab8ef0912453d2831 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:32:00 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:51608
I20260809 05:32:00.815826 19365 tablet_replica.cc:330] T c5be60e1a158482ab8ef0912453d2831 P bd1dd4e479844edb99bac9cd8aa02be6: stopping tablet replica
I20260809 05:32:00.816649 19365 raft_consensus.cc:2229] T c5be60e1a158482ab8ef0912453d2831 P bd1dd4e479844edb99bac9cd8aa02be6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:32:00.817601 19365 raft_consensus.cc:2258] T c5be60e1a158482ab8ef0912453d2831 P bd1dd4e479844edb99bac9cd8aa02be6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:32:00.818914 19370 tablet_replica.cc:330] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed: stopping tablet replica
I20260809 05:32:00.819720 19370 raft_consensus.cc:2229] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed [term 1 LEADER]: Raft consensus shutting down.
I20260809 05:32:00.820835 19370 raft_consensus.cc:2258] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:32:00.821655 19364 tablet_replica.cc:330] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea: stopping tablet replica
I20260809 05:32:00.824105 19365 ts_tablet_manager.cc:1905] T c5be60e1a158482ab8ef0912453d2831 P bd1dd4e479844edb99bac9cd8aa02be6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:32:00.824324 19370 ts_tablet_manager.cc:1905] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:32:00.824666 19364 raft_consensus.cc:2229] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:32:00.825387 19364 raft_consensus.cc:2258] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea [term 1 FOLLOWER]: Raft consensus is shut down!
Aug 09 05:32:00 dist-test-slave-h3ft krb5kdc[18547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253517, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.1@KRBTEST.COM
I20260809 05:32:00.833061 19365 ts_tablet_manager.cc:1918] T c5be60e1a158482ab8ef0912453d2831 P bd1dd4e479844edb99bac9cd8aa02be6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:32:00.833415 19365 log.cc:1196] T c5be60e1a158482ab8ef0912453d2831 P bd1dd4e479844edb99bac9cd8aa02be6: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/wal/wals/c5be60e1a158482ab8ef0912453d2831
I20260809 05:32:00.834151 19365 ts_tablet_manager.cc:1939] T c5be60e1a158482ab8ef0912453d2831 P bd1dd4e479844edb99bac9cd8aa02be6: Deleting consensus metadata
I20260809 05:32:00.836903 19364 ts_tablet_manager.cc:1905] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:32:00.836861 18596 catalog_manager.cc:4841] TS bd1dd4e479844edb99bac9cd8aa02be6 (127.26.185.3:40229): tablet c5be60e1a158482ab8ef0912453d2831 (table test-table [id=7719c7e3eb124a09b832db9cd476c2ef]) successfully deleted
I20260809 05:32:00.837754 19317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:00.800313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56968 (local address 127.26.185.1:41937)
0809 05:32:00.800546 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0809 05:32:00.800556 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:32:00.811405 (+ 10849us) server_negotiation.cc:407] Connection header received
0809 05:32:00.812134 (+ 729us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:32:00.812145 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:32:00.812303 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:32:00.812405 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:32:00.816541 (+ 4136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.817872 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.820246 (+ 2374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.820955 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.821112 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:00.828244 (+ 7132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:32:00.828265 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:32:00.828287 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:32:00.828348 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:32:00.832868 (+ 4520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:32:00.834149 (+ 1281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:32:00.834163 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:32:00.834167 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:32:00.834361 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:32:00.834936 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:32:00.834942 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:32:00.834946 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:32:00.835600 (+ 654us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:32:00.835993 (+ 393us) server_negotiation.cc:1035] Waiting for connection context
0809 05:32:00.836795 (+ 802us) server_negotiation.cc:299] Negotiation successful
0809 05:32:00.837121 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 05:32:00.837709 19370 ts_tablet_manager.cc:1918] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:32:00.837975 19370 log.cc:1196] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/wal/wals/c5be60e1a158482ab8ef0912453d2831
I20260809 05:32:00.838665 19370 ts_tablet_manager.cc:1939] T c5be60e1a158482ab8ef0912453d2831 P bc85ed485bb24332a07e1090217c2aed: Deleting consensus metadata
I20260809 05:32:00.840082 18885 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:32:00.843866 18596 catalog_manager.cc:4841] TS bc85ed485bb24332a07e1090217c2aed (127.26.185.2:45901): tablet c5be60e1a158482ab8ef0912453d2831 (table test-table [id=7719c7e3eb124a09b832db9cd476c2ef]) successfully deleted
I20260809 05:32:00.950037 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 18701
W20260809 05:32:00.991256 18596 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.185.1:41937 (error 108)
I20260809 05:32:00.991679 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 18897
I20260809 05:32:00.994227 19321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:00.993645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:41937 (local address 127.0.0.1:56970)
0809 05:32:00.993875 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:00.994043 (+ 168us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.1:41937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
W20260809 05:32:00.994572 18596 catalog_manager.cc:4584] TS 0c52f3b292e84243bd61a5cb61f0fcea (127.26.185.1:41937): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c5be60e1a158482ab8ef0912453d2831: Network error: Client connection negotiation failed: client connection to 127.26.185.1:41937: connect: Connection refused (error 111)
Aug 09 05:32:01 dist-test-slave-h3ft krb5kdc[18547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253517, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.2@KRBTEST.COM
I20260809 05:32:01.014537 19320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:00.993853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51620 (local address 127.26.185.2:45901)
0809 05:32:00.994107 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0809 05:32:00.994114 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:32:00.994139 (+ 25us) server_negotiation.cc:407] Connection header received
0809 05:32:00.994224 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:32:00.994231 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:32:00.994354 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:32:00.994492 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:32:00.996361 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.997671 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.999153 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:00.999843 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:00.999989 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:01.005960 (+ 5971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:32:01.006015 (+ 55us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:32:01.006050 (+ 35us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:32:01.006117 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:32:01.010670 (+ 4553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:32:01.011794 (+ 1124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:32:01.011808 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:32:01.011811 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:32:01.012034 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:32:01.012489 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:32:01.012494 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:32:01.012497 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:32:01.013150 (+ 653us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:32:01.013536 (+ 386us) server_negotiation.cc:1035] Waiting for connection context
0809 05:32:01.013819 (+ 283us) server_negotiation.cc:299] Negotiation successful
0809 05:32:01.014085 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 05:32:01.015609 19090 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:32:01.048875 19321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:01.048280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:41937 (local address 127.0.0.1:56974)
0809 05:32:01.048542 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:01.048673 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.1:41937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260809 05:32:01.050184 19321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:01.049755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:41937 (local address 127.0.0.1:56978)
0809 05:32:01.049901 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:01.050018 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.1:41937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 05:32:01.111373 19321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:01.110568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:41937 (local address 127.0.0.1:56988)
0809 05:32:01.110858 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:01.111106 (+ 248us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.1:41937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
I20260809 05:32:01.112787 19321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:01.112341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:41937 (local address 127.0.0.1:56996)
0809 05:32:01.112508 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:01.112623 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.1:41937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260809 05:32:01.151757 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 18897
I20260809 05:32:01.184193 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 19103
I20260809 05:32:01.193723 19321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:01.193126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:41937 (local address 127.0.0.1:57000)
0809 05:32:01.193380 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:01.193486 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.1:41937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
Aug 09 05:32:01 dist-test-slave-h3ft krb5kdc[18547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253517, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.3@KRBTEST.COM
I20260809 05:32:01.194965 19321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:01.194481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:41937 (local address 127.0.0.1:57004)
0809 05:32:01.194726 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:01.194807 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.1:41937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122}
I20260809 05:32:01.202940 19322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:01.185124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52102 (local address 127.26.185.3:40229)
0809 05:32:01.185323 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 05:32:01.185328 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:32:01.185413 (+ 85us) server_negotiation.cc:407] Connection header received
0809 05:32:01.185604 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:32:01.185609 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:32:01.185700 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:32:01.185796 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:32:01.187586 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:01.188423 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:01.189884 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:01.190299 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:01.190396 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:01.196096 (+ 5700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:32:01.196117 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:32:01.196140 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:32:01.196182 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:32:01.199663 (+ 3481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:32:01.200462 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:32:01.200471 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:32:01.200474 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:32:01.200636 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:32:01.201046 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:32:01.201050 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:32:01.201052 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:32:01.201525 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:32:01.201798 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0809 05:32:01.202231 (+ 433us) server_negotiation.cc:299] Negotiation successful
0809 05:32:01.202497 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 05:32:01.203825 19293 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:32:01.312772 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 19103
I20260809 05:32:01.343052 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 18567
I20260809 05:32:01.344633 18666 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:32:01.476914 19321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:01.476189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:41937 (local address 127.0.0.1:57006)
0809 05:32:01.476488 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:01.476617 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.1:41937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260809 05:32:01.477238 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 18567
I20260809 05:32:21.512507 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:44243
--webserver_interface=127.26.185.62
--webserver_port=35617
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:33389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:44243
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:32:21.966590 19379 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:32:21.967154 19379 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:32:21.967334 19379 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:32:21.975824 19379 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 05:32:21.976001 19379 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 05:32:21.976099 19379 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 05:32:21.976195 19379 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:32:21.976298 19379 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:32:21.976424 19379 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:32:21.976512 19379 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:32:21.976599 19379 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:32:21.989573 19379 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:33389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:44243
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:44243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=35617
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:32:21.992038 19379 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:32:21.994007 19379 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:32:22.029465 19387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:32:22.029527 19388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:32:22.029548 19393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:32:22.030695 19379 server_base.cc:1034] running on GCE node
I20260809 05:32:22.032001 19379 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:32:22.034201 19379 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:32:22.035485 19379 hybrid_clock.cc:648] HybridClock initialized: now 1786253542035389 us; error 73 us; skew 500 ppm
I20260809 05:32:22.035986 19379 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:32:22 dist-test-slave-h3ft krb5kdc[18547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253542, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:32:22.041334 19379 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:32:22.043550 19379 webserver.cc:460] Webserver started at http://127.26.185.62:35617/ using document root <none> and password file <none>
I20260809 05:32:22.044579 19379 fs_manager.cc:359] Metadata directory not provided
I20260809 05:32:22.044749 19379 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:32:22.052543 19379 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 05:32:22.057202 19402 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:32:22.059481 19379 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.004s
I20260809 05:32:22.059703 19379 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "77850d510ea14382984bfcfefe74dc4d"
format_stamp: "Formatted at 2026-08-09 05:31:58 on dist-test-slave-h3ft"
server_key: "69088751a9974ad7b023f55aaab64db2"
server_key_iv: "bcd68203300b421bfd0648ebd532c11f"
server_key_version: "encryptionkey@0"
I20260809 05:32:22.061046 19379 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:32:22.081765 19379 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:32:22.088579 19379 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:32:22.088961 19379 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:32:22.114823 19379 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:44243
I20260809 05:32:22.114852 19480 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:44243 every 8 connection(s)
I20260809 05:32:22.117336 19379 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:32:22.119784 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 19379
I20260809 05:32:22.121073 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:41937
--local_ip_for_outbound_sockets=127.26.185.1
--tserver_master_addrs=127.26.185.62:44243
--webserver_port=37531
--webserver_interface=127.26.185.1
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:33389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:32:22.130367 19481 sys_catalog.cc:263] Verifying existing consensus state
I20260809 05:32:22.136942 19481 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d: Bootstrap starting.
I20260809 05:32:22.162518 19481 log.cc:824] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d: Log is configured to *not* fsync() on all Append() calls
I20260809 05:32:22.177618 19481 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 05:32:22.178275 19481 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d: Bootstrap complete.
I20260809 05:32:22.189515 19481 raft_consensus.cc:348] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77850d510ea14382984bfcfefe74dc4d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44243 } }
I20260809 05:32:22.190510 19481 raft_consensus.cc:729] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77850d510ea14382984bfcfefe74dc4d, State: Initialized, Role: FOLLOWER
I20260809 05:32:22.191367 19481 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77850d510ea14382984bfcfefe74dc4d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44243 } }
I20260809 05:32:22.191646 19481 raft_consensus.cc:388] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:32:22.191785 19481 raft_consensus.cc:482] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:32:22.191987 19481 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [term 1 FOLLOWER]: Advancing to term 2
I20260809 05:32:22.196696 19481 raft_consensus.cc:504] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77850d510ea14382984bfcfefe74dc4d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44243 } }
I20260809 05:32:22.197350 19481 leader_election.cc:302] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77850d510ea14382984bfcfefe74dc4d; no voters:
I20260809 05:32:22.198145 19481 leader_election.cc:288] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 05:32:22.198319 19488 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [term 2 FOLLOWER]: Leader election won for term 2
I20260809 05:32:22.199811 19488 raft_consensus.cc:686] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [term 2 LEADER]: Becoming Leader. State: Replica: 77850d510ea14382984bfcfefe74dc4d, State: Running, Role: LEADER
I20260809 05:32:22.200603 19488 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77850d510ea14382984bfcfefe74dc4d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44243 } }
I20260809 05:32:22.201107 19481 sys_catalog.cc:564] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:32:22.203730 19490 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77850d510ea14382984bfcfefe74dc4d. Latest consensus state: current_term: 2 leader_uuid: "77850d510ea14382984bfcfefe74dc4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77850d510ea14382984bfcfefe74dc4d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44243 } } }
I20260809 05:32:22.204149 19490 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [sys.catalog]: This master's current role is: LEADER
I20260809 05:32:22.204814 19489 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "77850d510ea14382984bfcfefe74dc4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77850d510ea14382984bfcfefe74dc4d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44243 } } }
I20260809 05:32:22.205163 19489 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [sys.catalog]: This master's current role is: LEADER
I20260809 05:32:22.217521 19498 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:32:22.228015 19498 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:32:22.229809 19498 catalog_manager.cc:1259] Loaded cluster ID: 6956b73c13be46e9bbce413195b0b1f8
I20260809 05:32:22.229933 19498 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:32:22.234441 19498 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:32:22.236173 19498 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d: Loaded TSK: 0
I20260809 05:32:22.268292 19498 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d: Generated new TSK 1
I20260809 05:32:22.268910 19498 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 05:32:22.571241 19485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:32:22.571697 19485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:32:22.571894 19485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:32:22.580148 19485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:32:22.580294 19485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:32:22.580490 19485 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:32:22.592195 19485 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:33389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:41937
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=37531
--tserver_master_addrs=127.26.185.62:44243
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:32:22.594077 19485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:32:22.595890 19485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:32:22.613580 19524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:32:22.613380 19528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:32:22.614256 19523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:32:22.615296 19485 server_base.cc:1034] running on GCE node
I20260809 05:32:22.616230 19485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:32:22.617519 19485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:32:22.618772 19485 hybrid_clock.cc:648] HybridClock initialized: now 1786253542618700 us; error 60 us; skew 500 ppm
I20260809 05:32:22.619225 19485 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:32:22 dist-test-slave-h3ft krb5kdc[18547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253542, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:32:22.623534 19485 init.cc:377] Logged in from keytab as kudu/127.26.185.1@KRBTEST.COM (short username kudu)
I20260809 05:32:22.625509 19485 webserver.cc:460] Webserver started at http://127.26.185.1:37531/ using document root <none> and password file <none>
I20260809 05:32:22.626433 19485 fs_manager.cc:359] Metadata directory not provided
I20260809 05:32:22.626607 19485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:32:22.633630 19485 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 05:32:22.637539 19538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:32:22.639451 19485 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:32:22.639644 19485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "0c52f3b292e84243bd61a5cb61f0fcea"
format_stamp: "Formatted at 2026-08-09 05:31:58 on dist-test-slave-h3ft"
server_key: "4a77e4cfc3be81d51672dc430879f7fa"
server_key_iv: "a8472cbc63d5dd3fc7632e6a450f722a"
server_key_version: "encryptionkey@0"
I20260809 05:32:22.640810 19485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:32:22.665527 19485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:32:22.671625 19485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:32:22.671990 19485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:32:22.673362 19485 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:32:22.675770 19549 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260809 05:32:22.683138 19485 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 05:32:22.683332 19485 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.008s user 0.001s sys 0.000s
I20260809 05:32:22.683531 19485 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 05:32:22.688457 19485 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 05:32:22.688575 19485 ts_tablet_manager.cc:589] Time spent register tablets: real 0.005s user 0.004s sys 0.000s
I20260809 05:32:22.689039 19549 tablet_bootstrap.cc:492] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea: Bootstrap starting.
I20260809 05:32:22.701364 19549 log.cc:824] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea: Log is configured to *not* fsync() on all Append() calls
I20260809 05:32:22.720103 19549 tablet_bootstrap.cc:492] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 05:32:22.721246 19549 tablet_bootstrap.cc:492] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea: Bootstrap complete.
I20260809 05:32:22.722061 19549 ts_tablet_manager.cc:1397] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea: Time spent bootstrapping tablet: real 0.033s user 0.031s sys 0.000s
I20260809 05:32:22.734838 19549 raft_consensus.cc:348] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c52f3b292e84243bd61a5cb61f0fcea" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41937 } } peers { permanent_uuid: "bc85ed485bb24332a07e1090217c2aed" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45901 } } peers { permanent_uuid: "bd1dd4e479844edb99bac9cd8aa02be6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40229 } }
I20260809 05:32:22.736889 19549 raft_consensus.cc:729] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c52f3b292e84243bd61a5cb61f0fcea, State: Initialized, Role: FOLLOWER
I20260809 05:32:22.737942 19549 consensus_queue.cc:260] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c52f3b292e84243bd61a5cb61f0fcea" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41937 } } peers { permanent_uuid: "bc85ed485bb24332a07e1090217c2aed" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45901 } } peers { permanent_uuid: "bd1dd4e479844edb99bac9cd8aa02be6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40229 } }
I20260809 05:32:22.740602 19549 ts_tablet_manager.cc:1428] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea: Time spent starting tablet: real 0.018s user 0.013s sys 0.004s
I20260809 05:32:22.743094 19485 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:41937
I20260809 05:32:22.743165 19715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:41937 every 8 connection(s)
I20260809 05:32:22.744762 19485 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:32:22.748162 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 19485
I20260809 05:32:22.749240 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:45901
--local_ip_for_outbound_sockets=127.26.185.2
--tserver_master_addrs=127.26.185.62:44243
--webserver_port=43755
--webserver_interface=127.26.185.2
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:33389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 05:32:22 dist-test-slave-h3ft krb5kdc[18547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253542, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:32:22.773995 19723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:22.748723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:45863 (local address 127.26.185.62:44243)
0809 05:32:22.751572 (+ 2849us) server_negotiation.cc:206] Beginning negotiation
0809 05:32:22.751589 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 05:32:22.751639 (+ 50us) server_negotiation.cc:407] Connection header received
0809 05:32:22.752058 (+ 419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:32:22.752074 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:32:22.752527 (+ 453us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:32:22.753064 (+ 537us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:32:22.755294 (+ 2230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:22.756810 (+ 1516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:22.758649 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:22.759514 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:22.759765 (+ 251us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:22.764409 (+ 4644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:32:22.764420 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:32:22.764442 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:32:22.764500 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:32:22.768242 (+ 3742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:32:22.769225 (+ 983us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:32:22.769234 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:32:22.769241 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:32:22.769444 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:32:22.769941 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:32:22.769946 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:32:22.769949 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:32:22.770581 (+ 632us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:32:22.770815 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0809 05:32:22.771840 (+ 1025us) server_negotiation.cc:299] Negotiation successful
0809 05:32:22.772320 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2587,"thread_start_us":2442,"threads_started":1}
I20260809 05:32:22.774055 19721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:22.748547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.1:45863)
0809 05:32:22.749707 (+ 1160us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:22.749765 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 05:32:22.750437 (+ 672us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:32:22.753188 (+ 2751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:32:22.753205 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:32:22.754118 (+ 913us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:32:22.754910 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:32:22.754938 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:32:22.757044 (+ 2106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:32:22.757049 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:32:22.758468 (+ 1419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:32:22.758483 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:32:22.759737 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:32:22.759744 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:32:22.760088 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:22.760985 (+ 897us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:32:22.761015 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:32:22.764058 (+ 3043us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:32:22.768430 (+ 4372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:32:22.768442 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:32:22.768462 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:32:22.769044 (+ 582us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:32:22.769592 (+ 548us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:32:22.769598 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:32:22.769602 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:32:22.769820 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:32:22.770766 (+ 946us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:32:22.770776 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:32:22.771255 (+ 479us) client_negotiation.cc:769] Sending connection context
0809 05:32:22.771599 (+ 344us) client_negotiation.cc:240] Negotiation successful
0809 05:32:22.772320 (+ 721us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":768,"thread_start_us":486,"threads_started":1}
I20260809 05:32:22.777659 19716 heartbeater.cc:347] Connected to a master server at 127.26.185.62:44243
I20260809 05:32:22.778112 19716 heartbeater.cc:464] Registering TS with master...
I20260809 05:32:22.779304 19716 heartbeater.cc:511] Master 127.26.185.62:44243 requested a full tablet report, sending...
I20260809 05:32:22.784240 19425 ts_manager.cc:194] Registered new tserver with Master: 0c52f3b292e84243bd61a5cb61f0fcea (127.26.185.1:41937)
I20260809 05:32:22.789434 19425 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.1@KRBTEST.COM'} at 127.26.185.1:45863
I20260809 05:32:22.801550 19730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:22.788994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46230 (local address 127.26.185.1:41937)
0809 05:32:22.791931 (+ 2937us) server_negotiation.cc:206] Beginning negotiation
0809 05:32:22.791941 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:32:22.792765 (+ 824us) server_negotiation.cc:407] Connection header received
0809 05:32:22.793292 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:32:22.793302 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:32:22.793627 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:32:22.793882 (+ 255us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:32:22.794576 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:22.795959 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:22.798168 (+ 2209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:22.800024 (+ 1856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:22.800213 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:22.800520 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0809 05:32:22.800840 (+ 320us) server_negotiation.cc:299] Negotiation successful
0809 05:32:22.801050 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2696,"thread_start_us":2806,"threads_started":1}
I20260809 05:32:22.801546 19728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:22.788758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:41937 (local address 127.0.0.1:46230)
0809 05:32:22.792483 (+ 3725us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:22.792522 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 05:32:22.792907 (+ 385us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:32:22.793911 (+ 1004us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:32:22.793921 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:32:22.793962 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:32:22.794365 (+ 403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:32:22.794379 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:32:22.796116 (+ 1737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:32:22.796129 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:32:22.797971 (+ 1842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:32:22.797987 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:32:22.800267 (+ 2280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:32:22.800274 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:32:22.800559 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:22.800617 (+ 58us) client_negotiation.cc:769] Sending connection context
0809 05:32:22.800783 (+ 166us) client_negotiation.cc:240] Negotiation successful
0809 05:32:22.801051 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3486,"thread_start_us":4115,"threads_started":1}
I20260809 05:32:22.803774 19615 tablet_service.cc:1514] Processing DeleteTablet for tablet c5be60e1a158482ab8ef0912453d2831 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:32:00 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:46230
I20260809 05:32:22.806849 19731 tablet_replica.cc:330] stopping tablet replica
I20260809 05:32:22.807432 19731 raft_consensus.cc:2229] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:32:22.807947 19731 raft_consensus.cc:2258] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:32:22.809719 19731 ts_tablet_manager.cc:1905] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:32:22.821615 19731 ts_tablet_manager.cc:1918] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:32:22.821869 19731 log.cc:1196] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/wal/wals/c5be60e1a158482ab8ef0912453d2831
I20260809 05:32:22.822497 19731 ts_tablet_manager.cc:1939] T c5be60e1a158482ab8ef0912453d2831 P 0c52f3b292e84243bd61a5cb61f0fcea: Deleting consensus metadata
I20260809 05:32:22.826088 19404 catalog_manager.cc:4841] TS 0c52f3b292e84243bd61a5cb61f0fcea (127.26.185.1:41937): tablet c5be60e1a158482ab8ef0912453d2831 (table test-table [id=7719c7e3eb124a09b832db9cd476c2ef]) successfully deleted
W20260809 05:32:23.200614 19726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:32:23.201015 19726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:32:23.201167 19726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:32:23.209771 19726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:32:23.209976 19726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:32:23.210170 19726 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:32:23.221660 19726 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:33389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:45901
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=43755
--tserver_master_addrs=127.26.185.62:44243
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:32:23.223604 19726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:32:23.225405 19726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:32:23.241894 19740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:32:23.241770 19743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:32:23.241740 19739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:32:23.243640 19726 server_base.cc:1034] running on GCE node
I20260809 05:32:23.244531 19726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:32:23.245929 19726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:32:23.247174 19726 hybrid_clock.cc:648] HybridClock initialized: now 1786253543247115 us; error 72 us; skew 500 ppm
I20260809 05:32:23.247591 19726 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:32:23 dist-test-slave-h3ft krb5kdc[18547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253543, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:32:23.257231 19726 init.cc:377] Logged in from keytab as kudu/127.26.185.2@KRBTEST.COM (short username kudu)
I20260809 05:32:23.259608 19726 webserver.cc:460] Webserver started at http://127.26.185.2:43755/ using document root <none> and password file <none>
I20260809 05:32:23.260633 19726 fs_manager.cc:359] Metadata directory not provided
I20260809 05:32:23.260830 19726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:32:23.268023 19726 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.002s sys 0.001s
I20260809 05:32:23.271469 19753 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:32:23.273293 19726 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.002s
I20260809 05:32:23.273566 19726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "bc85ed485bb24332a07e1090217c2aed"
format_stamp: "Formatted at 2026-08-09 05:31:59 on dist-test-slave-h3ft"
server_key: "bb6487fa0b3660c3dd257458f5126b68"
server_key_iv: "a75b6bed2c44ce9f0dbec077dfe7dc60"
server_key_version: "encryptionkey@0"
I20260809 05:32:23.275079 19726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:32:23.305450 19726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:32:23.310952 19726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:32:23.311318 19726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:32:23.312601 19726 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:32:23.314260 19726 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:32:23.314363 19726 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:32:23.314499 19726 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:32:23.314613 19726 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:32:23.354761 19726 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:45901
I20260809 05:32:23.354802 19937 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:45901 every 8 connection(s)
I20260809 05:32:23.356848 19726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:32:23.366426 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 19726
I20260809 05:32:23.367478 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:40229
--local_ip_for_outbound_sockets=127.26.185.3
--tserver_master_addrs=127.26.185.62:44243
--webserver_port=40541
--webserver_interface=127.26.185.3
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:33389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 05:32:23 dist-test-slave-h3ft krb5kdc[18547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253543, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:32:23.381973 19942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:23.360330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:48933 (local address 127.26.185.62:44243)
0809 05:32:23.361002 (+ 672us) server_negotiation.cc:206] Beginning negotiation
0809 05:32:23.361011 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:32:23.362440 (+ 1429us) server_negotiation.cc:407] Connection header received
0809 05:32:23.364937 (+ 2497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:32:23.364943 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:32:23.365049 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:32:23.365171 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:32:23.367442 (+ 2271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:23.368337 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:23.370119 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:23.370598 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:23.370746 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:23.375028 (+ 4282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:32:23.375038 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:32:23.375044 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:32:23.375094 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:32:23.378154 (+ 3060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:32:23.379039 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:32:23.379044 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:32:23.379046 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:32:23.379202 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:32:23.379721 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:32:23.379725 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:32:23.379727 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:32:23.380068 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:32:23.380269 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0809 05:32:23.381184 (+ 915us) server_negotiation.cc:299] Negotiation successful
0809 05:32:23.381514 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":482,"thread_start_us":318,"threads_started":1}
I20260809 05:32:23.384032 19943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:23.361103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.2:48933)
0809 05:32:23.362005 (+ 902us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:23.362086 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0809 05:32:23.364510 (+ 2424us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:32:23.365451 (+ 941us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:32:23.365462 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:32:23.366275 (+ 813us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:32:23.367211 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:32:23.367237 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:32:23.368534 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:32:23.368538 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:32:23.369949 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:32:23.369962 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:32:23.370870 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:32:23.370878 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:32:23.371238 (+ 360us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:23.372128 (+ 890us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:32:23.372155 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:32:23.374728 (+ 2573us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:32:23.378334 (+ 3606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:32:23.378346 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:32:23.378372 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:32:23.378866 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:32:23.379324 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:32:23.379329 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:32:23.379333 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:32:23.379578 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:32:23.380216 (+ 638us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:32:23.380228 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:32:23.380714 (+ 486us) client_negotiation.cc:769] Sending connection context
0809 05:32:23.381063 (+ 349us) client_negotiation.cc:240] Negotiation successful
0809 05:32:23.381828 (+ 765us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":596,"thread_start_us":372,"threads_started":1}
I20260809 05:32:23.386067 19938 heartbeater.cc:347] Connected to a master server at 127.26.185.62:44243
I20260809 05:32:23.386490 19938 heartbeater.cc:464] Registering TS with master...
I20260809 05:32:23.387650 19938 heartbeater.cc:511] Master 127.26.185.62:44243 requested a full tablet report, sending...
I20260809 05:32:23.389706 19425 ts_manager.cc:194] Registered new tserver with Master: bc85ed485bb24332a07e1090217c2aed (127.26.185.2:45901)
I20260809 05:32:23.390770 19425 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.2@KRBTEST.COM'} at 127.26.185.2:48933
I20260809 05:32:23.795457 19716 heartbeater.cc:503] Master 127.26.185.62:44243 was elected leader, sending a full tablet report...
W20260809 05:32:23.820684 19945 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:32:23.821125 19945 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:32:23.821244 19945 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:32:23.829804 19945 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:32:23.829996 19945 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:32:23.830142 19945 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:32:23.842175 19945 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:33389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:40229
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=40541
--tserver_master_addrs=127.26.185.62:44243
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:32:23.844137 19945 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:32:23.845841 19945 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:32:23.862273 19953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:32:23.862371 19957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:32:23.862396 19951 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:32:23.863710 19945 server_base.cc:1034] running on GCE node
I20260809 05:32:23.864665 19945 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:32:23.866120 19945 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:32:23.867372 19945 hybrid_clock.cc:648] HybridClock initialized: now 1786253543867314 us; error 57 us; skew 500 ppm
I20260809 05:32:23.867782 19945 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:32:23 dist-test-slave-h3ft krb5kdc[18547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253543, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:32:23.871919 19945 init.cc:377] Logged in from keytab as kudu/127.26.185.3@KRBTEST.COM (short username kudu)
I20260809 05:32:23.873796 19945 webserver.cc:460] Webserver started at http://127.26.185.3:40541/ using document root <none> and password file <none>
I20260809 05:32:23.874747 19945 fs_manager.cc:359] Metadata directory not provided
I20260809 05:32:23.874938 19945 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:32:23.882709 19945 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 05:32:23.886382 19966 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:32:23.888388 19945 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:32:23.888577 19945 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "bd1dd4e479844edb99bac9cd8aa02be6"
format_stamp: "Formatted at 2026-08-09 05:32:00 on dist-test-slave-h3ft"
server_key: "60ce4833fea28e93297a552c4622caca"
server_key_iv: "f8c538005c712a664b366e2f614d6358"
server_key_version: "encryptionkey@0"
I20260809 05:32:23.889817 19945 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:32:23.931456 19945 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:32:23.937522 19945 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:32:23.937847 19945 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:32:23.939190 19945 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:32:23.941157 19945 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:32:23.941306 19945 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:32:23.941411 19945 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:32:23.941479 19945 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:32:23.983647 19945 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:40229
I20260809 05:32:23.983719 20156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:40229 every 8 connection(s)
I20260809 05:32:23.985651 19945 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:32:23.995085 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 19945
Aug 09 05:32:24 dist-test-slave-h3ft krb5kdc[18547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253543, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:32:24.014655 20162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:23.989274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:59273 (local address 127.26.185.62:44243)
0809 05:32:23.989929 (+ 655us) server_negotiation.cc:206] Beginning negotiation
0809 05:32:23.989938 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:32:23.991344 (+ 1406us) server_negotiation.cc:407] Connection header received
0809 05:32:23.993587 (+ 2243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:32:23.993597 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:32:23.993740 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:32:23.993858 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:32:23.996547 (+ 2689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:23.997527 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.000292 (+ 2765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.000780 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.000902 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:24.006612 (+ 5710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:32:24.006617 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:32:24.006621 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:32:24.006658 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:32:24.010297 (+ 3639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:32:24.011383 (+ 1086us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:32:24.011392 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:32:24.011398 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:32:24.011597 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:32:24.012203 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:32:24.012208 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:32:24.012212 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:32:24.012674 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:32:24.012855 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0809 05:32:24.013971 (+ 1116us) server_negotiation.cc:299] Negotiation successful
0809 05:32:24.014240 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":298,"threads_started":1}
I20260809 05:32:24.016510 20166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:23.996499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49720 (local address 127.26.185.62:44243)
0809 05:32:23.998640 (+ 2141us) server_negotiation.cc:206] Beginning negotiation
0809 05:32:23.998644 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 05:32:23.998660 (+ 16us) server_negotiation.cc:407] Connection header received
0809 05:32:23.998709 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:32:23.998712 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:32:23.998786 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:32:23.998885 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:32:24.001245 (+ 2360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.002199 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.004413 (+ 2214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.005210 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.005329 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:24.009372 (+ 4043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:32:24.009379 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:32:24.009384 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:32:24.009454 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:32:24.013091 (+ 3637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:32:24.014177 (+ 1086us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:32:24.014182 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:32:24.014185 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:32:24.014323 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:32:24.014948 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:32:24.014952 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:32:24.014954 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:32:24.015281 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:32:24.015526 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0809 05:32:24.016064 (+ 538us) server_negotiation.cc:299] Negotiation successful
0809 05:32:24.016247 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2012,"thread_start_us":1842,"threads_started":1}
I20260809 05:32:24.016572 20165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:23.990097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.3:59273)
0809 05:32:23.991116 (+ 1019us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:23.991178 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0809 05:32:23.993218 (+ 2040us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:32:23.994173 (+ 955us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:32:23.994184 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:32:23.995254 (+ 1070us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:32:23.996325 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:32:23.996357 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:32:23.997700 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:32:23.997708 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:32:24.000112 (+ 2404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:32:24.000133 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.001112 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.001122 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:32:24.001453 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:24.002312 (+ 859us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:32:24.002352 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:32:24.006271 (+ 3919us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:32:24.010472 (+ 4201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:32:24.010487 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:32:24.010518 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:32:24.011233 (+ 715us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:32:24.011769 (+ 536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:32:24.011772 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:32:24.011775 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:32:24.012058 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:32:24.012853 (+ 795us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:32:24.012861 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:32:24.013445 (+ 584us) client_negotiation.cc:769] Sending connection context
0809 05:32:24.013861 (+ 416us) client_negotiation.cc:240] Negotiation successful
0809 05:32:24.014612 (+ 751us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":336,"threads_started":1}
I20260809 05:32:24.018527 20159 heartbeater.cc:347] Connected to a master server at 127.26.185.62:44243
I20260809 05:32:24.018993 20159 heartbeater.cc:464] Registering TS with master...
I20260809 05:32:24.020181 20159 heartbeater.cc:511] Master 127.26.185.62:44243 requested a full tablet report, sending...
I20260809 05:32:24.022035 19424 ts_manager.cc:194] Registered new tserver with Master: bd1dd4e479844edb99bac9cd8aa02be6 (127.26.185.3:40229)
I20260809 05:32:24.023188 19424 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.3@KRBTEST.COM'} at 127.26.185.3:59273
I20260809 05:32:24.033771 27364 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 05:32:24.042187 20166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:24.035051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49726 (local address 127.26.185.62:44243)
0809 05:32:24.035343 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0809 05:32:24.035354 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:32:24.035868 (+ 514us) server_negotiation.cc:407] Connection header received
0809 05:32:24.036105 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:32:24.036110 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:32:24.036305 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:32:24.036471 (+ 166us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:32:24.037242 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.038052 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.039940 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.040404 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.040510 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:24.041086 (+ 576us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:32:24.041456 (+ 370us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0809 05:32:24.041842 (+ 386us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49726: token expired
Metrics: {"server-negotiator.queue_time_us":78}
W20260809 05:32:24.042372 20166 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49726: token expired
W20260809 05:32:24.043131 19303 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.26.185.62:44243)
I20260809 05:32:24.060803 20166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:24.043726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49730 (local address 127.26.185.62:44243)
0809 05:32:24.043949 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0809 05:32:24.043955 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:32:24.044097 (+ 142us) server_negotiation.cc:407] Connection header received
0809 05:32:24.044319 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:32:24.044337 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:32:24.044421 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:32:24.044536 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:32:24.046390 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.047290 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.048893 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.049392 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.049537 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:24.053101 (+ 3564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:32:24.053108 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:32:24.053112 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:32:24.053159 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:32:24.057168 (+ 4009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:32:24.058108 (+ 940us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:32:24.058115 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:32:24.058119 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:32:24.058306 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:32:24.058790 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:32:24.058797 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:32:24.058801 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:32:24.059300 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:32:24.059627 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0809 05:32:24.060043 (+ 416us) server_negotiation.cc:299] Negotiation successful
0809 05:32:24.060382 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260809 05:32:24.065651 19424 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49730:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 05:32:24.074790 19424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 05:32:24.091707 19615 tablet_service.cc:1467] Processing CreateTablet for tablet 8c394936f58b40f88c091af1260dba6f (DEFAULT_TABLE table=test-table [id=8f1cb58a83054fd4b41f4529fe2e5e89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:32:24.093007 19615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c394936f58b40f88c091af1260dba6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:32:24.102890 20183 tablet_bootstrap.cc:492] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea: Bootstrap starting.
I20260809 05:32:24.105369 20179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:24.089331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50570 (local address 127.26.185.3:40229)
0809 05:32:24.091340 (+ 2009us) server_negotiation.cc:206] Beginning negotiation
0809 05:32:24.091354 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 05:32:24.091407 (+ 53us) server_negotiation.cc:407] Connection header received
0809 05:32:24.091560 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:32:24.091574 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:32:24.091981 (+ 407us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:32:24.092305 (+ 324us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:32:24.094011 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.097431 (+ 3420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.102064 (+ 4633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.104050 (+ 1986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.104245 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:24.104581 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0809 05:32:24.104767 (+ 186us) server_negotiation.cc:299] Negotiation successful
0809 05:32:24.104974 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1769,"thread_start_us":1551,"threads_started":1}
I20260809 05:32:24.105912 20178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:24.088853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:40229 (local address 127.0.0.1:50570)
0809 05:32:24.089989 (+ 1136us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:24.090016 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 05:32:24.090181 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:32:24.092672 (+ 2491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:32:24.092680 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:32:24.092724 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:32:24.093303 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:32:24.093320 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.097654 (+ 4334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.097662 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:32:24.101794 (+ 4132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:32:24.101818 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.104324 (+ 2506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.104330 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:32:24.104527 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:24.104583 (+ 56us) client_negotiation.cc:769] Sending connection context
0809 05:32:24.104712 (+ 129us) client_negotiation.cc:240] Negotiation successful
0809 05:32:24.104900 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":945,"thread_start_us":784,"threads_started":1}
I20260809 05:32:24.106796 20183 tablet_bootstrap.cc:654] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea: Neither blocks nor log segments found. Creating new log.
I20260809 05:32:24.107098 20181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:24.090382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:45901 (local address 127.0.0.1:36734)
0809 05:32:24.091708 (+ 1326us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:24.091728 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 05:32:24.091863 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:32:24.098927 (+ 7064us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:32:24.098933 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:32:24.098972 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:32:24.099495 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:32:24.099513 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.101169 (+ 1656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.101177 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:32:24.103426 (+ 2249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:32:24.103445 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.106206 (+ 2761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.106211 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:32:24.106398 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:24.106448 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 05:32:24.106546 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 05:32:24.106723 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1196,"thread_start_us":1042,"threads_started":1}
I20260809 05:32:24.107388 20182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:24.090827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36734 (local address 127.26.185.2:45901)
0809 05:32:24.098220 (+ 7393us) server_negotiation.cc:206] Beginning negotiation
0809 05:32:24.098229 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:32:24.098264 (+ 35us) server_negotiation.cc:407] Connection header received
0809 05:32:24.098380 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:32:24.098388 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:32:24.098679 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:32:24.098955 (+ 276us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:32:24.099701 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.101002 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.103699 (+ 2697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.105938 (+ 2239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.106119 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:24.106379 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0809 05:32:24.106652 (+ 273us) server_negotiation.cc:299] Negotiation successful
0809 05:32:24.106900 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7163,"thread_start_us":6988,"threads_started":1}
I20260809 05:32:24.112139 20183 tablet_bootstrap.cc:492] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea: No bootstrap required, opened a new log
I20260809 05:32:24.112413 20183 ts_tablet_manager.cc:1397] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.000s
I20260809 05:32:24.112314 19828 tablet_service.cc:1467] Processing CreateTablet for tablet 8c394936f58b40f88c091af1260dba6f (DEFAULT_TABLE table=test-table [id=8f1cb58a83054fd4b41f4529fe2e5e89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:32:24.112149 20045 tablet_service.cc:1467] Processing CreateTablet for tablet 8c394936f58b40f88c091af1260dba6f (DEFAULT_TABLE table=test-table [id=8f1cb58a83054fd4b41f4529fe2e5e89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:32:24.113448 20183 raft_consensus.cc:348] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1dd4e479844edb99bac9cd8aa02be6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40229 } } peers { permanent_uuid: "0c52f3b292e84243bd61a5cb61f0fcea" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41937 } } peers { permanent_uuid: "bc85ed485bb24332a07e1090217c2aed" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45901 } }
I20260809 05:32:24.113762 20183 raft_consensus.cc:374] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:32:24.113906 20183 raft_consensus.cc:729] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c52f3b292e84243bd61a5cb61f0fcea, State: Initialized, Role: FOLLOWER
I20260809 05:32:24.114346 19828 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c394936f58b40f88c091af1260dba6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:32:24.114349 20045 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c394936f58b40f88c091af1260dba6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:32:24.114360 20183 consensus_queue.cc:260] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1dd4e479844edb99bac9cd8aa02be6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40229 } } peers { permanent_uuid: "0c52f3b292e84243bd61a5cb61f0fcea" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41937 } } peers { permanent_uuid: "bc85ed485bb24332a07e1090217c2aed" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45901 } }
I20260809 05:32:24.140844 20183 ts_tablet_manager.cc:1428] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea: Time spent starting tablet: real 0.028s user 0.013s sys 0.015s
I20260809 05:32:24.141278 20187 tablet_bootstrap.cc:492] T 8c394936f58b40f88c091af1260dba6f P bd1dd4e479844edb99bac9cd8aa02be6: Bootstrap starting.
I20260809 05:32:24.141278 20186 tablet_bootstrap.cc:492] T 8c394936f58b40f88c091af1260dba6f P bc85ed485bb24332a07e1090217c2aed: Bootstrap starting.
I20260809 05:32:24.148367 20186 tablet_bootstrap.cc:654] T 8c394936f58b40f88c091af1260dba6f P bc85ed485bb24332a07e1090217c2aed: Neither blocks nor log segments found. Creating new log.
I20260809 05:32:24.148378 20187 tablet_bootstrap.cc:654] T 8c394936f58b40f88c091af1260dba6f P bd1dd4e479844edb99bac9cd8aa02be6: Neither blocks nor log segments found. Creating new log.
I20260809 05:32:24.150126 20187 log.cc:824] T 8c394936f58b40f88c091af1260dba6f P bd1dd4e479844edb99bac9cd8aa02be6: Log is configured to *not* fsync() on all Append() calls
I20260809 05:32:24.150125 20186 log.cc:824] T 8c394936f58b40f88c091af1260dba6f P bc85ed485bb24332a07e1090217c2aed: Log is configured to *not* fsync() on all Append() calls
I20260809 05:32:24.154340 20187 tablet_bootstrap.cc:492] T 8c394936f58b40f88c091af1260dba6f P bd1dd4e479844edb99bac9cd8aa02be6: No bootstrap required, opened a new log
I20260809 05:32:24.154351 20186 tablet_bootstrap.cc:492] T 8c394936f58b40f88c091af1260dba6f P bc85ed485bb24332a07e1090217c2aed: No bootstrap required, opened a new log
I20260809 05:32:24.154721 20186 ts_tablet_manager.cc:1397] T 8c394936f58b40f88c091af1260dba6f P bc85ed485bb24332a07e1090217c2aed: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.005s
I20260809 05:32:24.154721 20187 ts_tablet_manager.cc:1397] T 8c394936f58b40f88c091af1260dba6f P bd1dd4e479844edb99bac9cd8aa02be6: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.008s
I20260809 05:32:24.163367 20186 raft_consensus.cc:348] T 8c394936f58b40f88c091af1260dba6f P bc85ed485bb24332a07e1090217c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1dd4e479844edb99bac9cd8aa02be6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40229 } } peers { permanent_uuid: "0c52f3b292e84243bd61a5cb61f0fcea" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41937 } } peers { permanent_uuid: "bc85ed485bb24332a07e1090217c2aed" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45901 } }
I20260809 05:32:24.163431 20187 raft_consensus.cc:348] T 8c394936f58b40f88c091af1260dba6f P bd1dd4e479844edb99bac9cd8aa02be6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1dd4e479844edb99bac9cd8aa02be6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40229 } } peers { permanent_uuid: "0c52f3b292e84243bd61a5cb61f0fcea" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41937 } } peers { permanent_uuid: "bc85ed485bb24332a07e1090217c2aed" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45901 } }
I20260809 05:32:24.163985 20186 raft_consensus.cc:374] T 8c394936f58b40f88c091af1260dba6f P bc85ed485bb24332a07e1090217c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:32:24.163995 20187 raft_consensus.cc:374] T 8c394936f58b40f88c091af1260dba6f P bd1dd4e479844edb99bac9cd8aa02be6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:32:24.164134 20186 raft_consensus.cc:729] T 8c394936f58b40f88c091af1260dba6f P bc85ed485bb24332a07e1090217c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc85ed485bb24332a07e1090217c2aed, State: Initialized, Role: FOLLOWER
I20260809 05:32:24.164136 20187 raft_consensus.cc:729] T 8c394936f58b40f88c091af1260dba6f P bd1dd4e479844edb99bac9cd8aa02be6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd1dd4e479844edb99bac9cd8aa02be6, State: Initialized, Role: FOLLOWER
I20260809 05:32:24.165098 20187 consensus_queue.cc:260] T 8c394936f58b40f88c091af1260dba6f P bd1dd4e479844edb99bac9cd8aa02be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1dd4e479844edb99bac9cd8aa02be6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40229 } } peers { permanent_uuid: "0c52f3b292e84243bd61a5cb61f0fcea" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41937 } } peers { permanent_uuid: "bc85ed485bb24332a07e1090217c2aed" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45901 } }
I20260809 05:32:24.165102 20186 consensus_queue.cc:260] T 8c394936f58b40f88c091af1260dba6f P bc85ed485bb24332a07e1090217c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1dd4e479844edb99bac9cd8aa02be6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40229 } } peers { permanent_uuid: "0c52f3b292e84243bd61a5cb61f0fcea" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41937 } } peers { permanent_uuid: "bc85ed485bb24332a07e1090217c2aed" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45901 } }
I20260809 05:32:24.166684 20159 heartbeater.cc:503] Master 127.26.185.62:44243 was elected leader, sending a full tablet report...
I20260809 05:32:24.167196 19938 heartbeater.cc:503] Master 127.26.185.62:44243 was elected leader, sending a full tablet report...
I20260809 05:32:24.167567 20186 ts_tablet_manager.cc:1428] T 8c394936f58b40f88c091af1260dba6f P bc85ed485bb24332a07e1090217c2aed: Time spent starting tablet: real 0.013s user 0.005s sys 0.010s
I20260809 05:32:24.167587 20187 ts_tablet_manager.cc:1428] T 8c394936f58b40f88c091af1260dba6f P bd1dd4e479844edb99bac9cd8aa02be6: Time spent starting tablet: real 0.013s user 0.004s sys 0.010s
W20260809 05:32:24.238003 20160 tablet.cc:2369] T 8c394936f58b40f88c091af1260dba6f P bd1dd4e479844edb99bac9cd8aa02be6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 05:32:24.249176 19718 tablet.cc:2369] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:32:24.276250 20185 raft_consensus.cc:482] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:32:24.276743 20185 raft_consensus.cc:504] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1dd4e479844edb99bac9cd8aa02be6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40229 } } peers { permanent_uuid: "0c52f3b292e84243bd61a5cb61f0fcea" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41937 } } peers { permanent_uuid: "bc85ed485bb24332a07e1090217c2aed" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45901 } }
I20260809 05:32:24.278976 20185 leader_election.cc:288] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd1dd4e479844edb99bac9cd8aa02be6 (127.26.185.3:40229), bc85ed485bb24332a07e1090217c2aed (127.26.185.2:45901)
I20260809 05:32:24.286787 20179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:24.279607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:43153 (local address 127.26.185.3:40229)
0809 05:32:24.279876 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0809 05:32:24.279883 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:32:24.280628 (+ 745us) server_negotiation.cc:407] Connection header received
0809 05:32:24.280910 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:32:24.280922 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:32:24.281036 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:32:24.281109 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:32:24.281944 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.283178 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.284971 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.285802 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.285995 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:24.286096 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 05:32:24.286347 (+ 251us) server_negotiation.cc:299] Negotiation successful
0809 05:32:24.286490 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260809 05:32:24.286935 20195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:24.279561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:40229 (local address 127.26.185.1:43153)
0809 05:32:24.280385 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:24.280409 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 05:32:24.280628 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:32:24.281382 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:32:24.281386 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:32:24.281412 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:32:24.281785 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:32:24.281796 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.283306 (+ 1510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.283310 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:32:24.284804 (+ 1494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:32:24.284817 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.285995 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.286001 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:32:24.286180 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:24.286207 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 05:32:24.286317 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 05:32:24.286468 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":681,"mutex_wait_us":1,"thread_start_us":511,"threads_started":1}
I20260809 05:32:24.287192 20182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:24.280857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:48747 (local address 127.26.185.2:45901)
0809 05:32:24.281172 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0809 05:32:24.281180 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:32:24.281505 (+ 325us) server_negotiation.cc:407] Connection header received
0809 05:32:24.281829 (+ 324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:32:24.281837 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:32:24.281939 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:32:24.282059 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:32:24.282625 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.283616 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.285341 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.286177 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.286397 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:24.286475 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 05:32:24.286766 (+ 291us) server_negotiation.cc:299] Negotiation successful
0809 05:32:24.286901 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260809 05:32:24.287654 20197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:24.280586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:45901 (local address 127.26.185.1:48747)
0809 05:32:24.281371 (+ 785us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:24.281386 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 05:32:24.281657 (+ 271us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:32:24.282066 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:32:24.282069 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:32:24.282088 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:32:24.282452 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:32:24.282461 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.283749 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.283755 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:32:24.285187 (+ 1432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:32:24.285199 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.286421 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.286428 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:32:24.286611 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:24.286636 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 05:32:24.286739 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 05:32:24.286876 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":656,"spinlock_wait_cycles":31616,"thread_start_us":367,"threads_started":1}
I20260809 05:32:24.288560 20077 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c394936f58b40f88c091af1260dba6f" candidate_uuid: "0c52f3b292e84243bd61a5cb61f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1dd4e479844edb99bac9cd8aa02be6" is_pre_election: true
I20260809 05:32:24.288823 19861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c394936f58b40f88c091af1260dba6f" candidate_uuid: "0c52f3b292e84243bd61a5cb61f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc85ed485bb24332a07e1090217c2aed" is_pre_election: true
I20260809 05:32:24.289402 19861 raft_consensus.cc:2454] T 8c394936f58b40f88c091af1260dba6f P bc85ed485bb24332a07e1090217c2aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c52f3b292e84243bd61a5cb61f0fcea in term 0.
I20260809 05:32:24.289387 20077 raft_consensus.cc:2454] T 8c394936f58b40f88c091af1260dba6f P bd1dd4e479844edb99bac9cd8aa02be6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c52f3b292e84243bd61a5cb61f0fcea in term 0.
I20260809 05:32:24.290202 19542 leader_election.cc:302] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c52f3b292e84243bd61a5cb61f0fcea, bc85ed485bb24332a07e1090217c2aed; no voters:
I20260809 05:32:24.290637 20185 raft_consensus.cc:2781] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:32:24.290818 20185 raft_consensus.cc:482] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:32:24.290935 20185 raft_consensus.cc:3037] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:32:24.293784 20185 raft_consensus.cc:504] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1dd4e479844edb99bac9cd8aa02be6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40229 } } peers { permanent_uuid: "0c52f3b292e84243bd61a5cb61f0fcea" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41937 } } peers { permanent_uuid: "bc85ed485bb24332a07e1090217c2aed" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45901 } }
I20260809 05:32:24.294585 20185 leader_election.cc:288] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea [CANDIDATE]: Term 1 election: Requested vote from peers bd1dd4e479844edb99bac9cd8aa02be6 (127.26.185.3:40229), bc85ed485bb24332a07e1090217c2aed (127.26.185.2:45901)
I20260809 05:32:24.295248 19861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c394936f58b40f88c091af1260dba6f" candidate_uuid: "0c52f3b292e84243bd61a5cb61f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc85ed485bb24332a07e1090217c2aed"
I20260809 05:32:24.295353 20077 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c394936f58b40f88c091af1260dba6f" candidate_uuid: "0c52f3b292e84243bd61a5cb61f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1dd4e479844edb99bac9cd8aa02be6"
I20260809 05:32:24.295491 19861 raft_consensus.cc:3037] T 8c394936f58b40f88c091af1260dba6f P bc85ed485bb24332a07e1090217c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:32:24.295644 20077 raft_consensus.cc:3037] T 8c394936f58b40f88c091af1260dba6f P bd1dd4e479844edb99bac9cd8aa02be6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:32:24.298178 20077 raft_consensus.cc:2454] T 8c394936f58b40f88c091af1260dba6f P bd1dd4e479844edb99bac9cd8aa02be6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c52f3b292e84243bd61a5cb61f0fcea in term 1.
I20260809 05:32:24.298170 19861 raft_consensus.cc:2454] T 8c394936f58b40f88c091af1260dba6f P bc85ed485bb24332a07e1090217c2aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c52f3b292e84243bd61a5cb61f0fcea in term 1.
I20260809 05:32:24.298655 19542 leader_election.cc:302] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c52f3b292e84243bd61a5cb61f0fcea, bc85ed485bb24332a07e1090217c2aed; no voters:
I20260809 05:32:24.299042 20185 raft_consensus.cc:2781] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:32:24.299583 20185 raft_consensus.cc:686] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea [term 1 LEADER]: Becoming Leader. State: Replica: 0c52f3b292e84243bd61a5cb61f0fcea, State: Running, Role: LEADER
I20260809 05:32:24.300130 20185 consensus_queue.cc:237] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1dd4e479844edb99bac9cd8aa02be6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40229 } } peers { permanent_uuid: "0c52f3b292e84243bd61a5cb61f0fcea" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41937 } } peers { permanent_uuid: "bc85ed485bb24332a07e1090217c2aed" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45901 } }
I20260809 05:32:24.305426 19425 catalog_manager.cc:5495] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c52f3b292e84243bd61a5cb61f0fcea (127.26.185.1). New cstate: current_term: 1 leader_uuid: "0c52f3b292e84243bd61a5cb61f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1dd4e479844edb99bac9cd8aa02be6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c52f3b292e84243bd61a5cb61f0fcea" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 41937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc85ed485bb24332a07e1090217c2aed" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45901 } health_report { overall_health: UNKNOWN } } }
I20260809 05:32:24.358023 20206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:24.350433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46244 (local address 127.26.185.1:41937)
0809 05:32:24.351183 (+ 750us) server_negotiation.cc:206] Beginning negotiation
0809 05:32:24.351188 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:32:24.351212 (+ 24us) server_negotiation.cc:407] Connection header received
0809 05:32:24.351335 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:32:24.351339 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:32:24.351431 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:32:24.351604 (+ 173us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:32:24.352117 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.352990 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.354758 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.355538 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.355663 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:24.356284 (+ 621us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:32:24.357217 (+ 933us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:32:24.357398 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0809 05:32:24.357505 (+ 107us) server_negotiation.cc:299] Negotiation successful
0809 05:32:24.357608 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":611,"thread_start_us":414,"threads_started":1}
W20260809 05:32:24.359462 19939 tablet.cc:2369] T 8c394936f58b40f88c091af1260dba6f P bc85ed485bb24332a07e1090217c2aed: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:32:24.366397 19861 raft_consensus.cc:1261] T 8c394936f58b40f88c091af1260dba6f P bc85ed485bb24332a07e1090217c2aed [term 1 FOLLOWER]: Refusing update from remote peer 0c52f3b292e84243bd61a5cb61f0fcea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:32:24.366493 20077 raft_consensus.cc:1261] T 8c394936f58b40f88c091af1260dba6f P bd1dd4e479844edb99bac9cd8aa02be6 [term 1 FOLLOWER]: Refusing update from remote peer 0c52f3b292e84243bd61a5cb61f0fcea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:32:24.367702 20200 consensus_queue.cc:1035] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc85ed485bb24332a07e1090217c2aed" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 45901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:32:24.368222 20185 consensus_queue.cc:1035] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd1dd4e479844edb99bac9cd8aa02be6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 40229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:32:24.385603 20209 mvcc.cc:205] Tried to move back new op lower bound from 7316494517712474112 to 7316494517458366464. Current Snapshot: MvccSnapshot[applied={T|T < 7316494517712474112}]
I20260809 05:32:24.402644 19425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49730:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:32:24.403069 19425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49730:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:32:24.407600 19425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d: Sending DeleteTablet for 3 replicas of tablet 8c394936f58b40f88c091af1260dba6f
I20260809 05:32:24.408871 19615 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c394936f58b40f88c091af1260dba6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:32:24 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:46230
I20260809 05:32:24.408985 20045 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c394936f58b40f88c091af1260dba6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:32:24 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:50570
I20260809 05:32:24.409646 19828 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c394936f58b40f88c091af1260dba6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:32:24 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:36734
I20260809 05:32:24.409778 20226 tablet_replica.cc:330] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea: stopping tablet replica
I20260809 05:32:24.410037 20226 raft_consensus.cc:2229] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea [term 1 LEADER]: Raft consensus shutting down.
I20260809 05:32:24.410774 20226 raft_consensus.cc:2258] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:32:24.411573 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 19485
I20260809 05:32:24.415901 20230 tablet_replica.cc:330] T 8c394936f58b40f88c091af1260dba6f P bc85ed485bb24332a07e1090217c2aed: stopping tablet replica
I20260809 05:32:24.416354 20226 ts_tablet_manager.cc:1905] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:32:24.418948 20230 raft_consensus.cc:2229] T 8c394936f58b40f88c091af1260dba6f P bc85ed485bb24332a07e1090217c2aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:32:24.419930 20230 raft_consensus.cc:2258] T 8c394936f58b40f88c091af1260dba6f P bc85ed485bb24332a07e1090217c2aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:32:24.422850 20227 tablet_replica.cc:330] T 8c394936f58b40f88c091af1260dba6f P bd1dd4e479844edb99bac9cd8aa02be6: stopping tablet replica
I20260809 05:32:24.423629 20226 ts_tablet_manager.cc:1918] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:32:24.423848 20226 log.cc:1196] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/wal/wals/8c394936f58b40f88c091af1260dba6f
I20260809 05:32:24.424573 20226 ts_tablet_manager.cc:1939] T 8c394936f58b40f88c091af1260dba6f P 0c52f3b292e84243bd61a5cb61f0fcea: Deleting consensus metadata
I20260809 05:32:24.425279 20227 raft_consensus.cc:2229] T 8c394936f58b40f88c091af1260dba6f P bd1dd4e479844edb99bac9cd8aa02be6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:32:24.426172 19404 catalog_manager.cc:4841] TS 0c52f3b292e84243bd61a5cb61f0fcea (127.26.185.1:41937): tablet 8c394936f58b40f88c091af1260dba6f (table test-table [id=8f1cb58a83054fd4b41f4529fe2e5e89]) successfully deleted
I20260809 05:32:24.427587 20230 ts_tablet_manager.cc:1905] T 8c394936f58b40f88c091af1260dba6f P bc85ed485bb24332a07e1090217c2aed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:32:24.432260 20227 raft_consensus.cc:2258] T 8c394936f58b40f88c091af1260dba6f P bd1dd4e479844edb99bac9cd8aa02be6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:32:24.434372 20230 ts_tablet_manager.cc:1918] T 8c394936f58b40f88c091af1260dba6f P bc85ed485bb24332a07e1090217c2aed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:32:24.434651 20230 log.cc:1196] T 8c394936f58b40f88c091af1260dba6f P bc85ed485bb24332a07e1090217c2aed: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/wal/wals/8c394936f58b40f88c091af1260dba6f
I20260809 05:32:24.434947 20206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:24.412819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46254 (local address 127.26.185.1:41937)
0809 05:32:24.413102 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0809 05:32:24.413113 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:32:24.413268 (+ 155us) server_negotiation.cc:407] Connection header received
0809 05:32:24.413533 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:32:24.413541 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:32:24.413664 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:32:24.413827 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:32:24.416520 (+ 2693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.418177 (+ 1657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.420328 (+ 2151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.421416 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.421600 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:24.425838 (+ 4238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:32:24.425853 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:32:24.425876 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:32:24.425927 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:32:24.430643 (+ 4716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:32:24.431854 (+ 1211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:32:24.431865 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:32:24.431870 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:32:24.432083 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:32:24.432700 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:32:24.432706 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:32:24.432709 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:32:24.433325 (+ 616us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:32:24.433697 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0809 05:32:24.434088 (+ 391us) server_negotiation.cc:299] Negotiation successful
0809 05:32:24.434437 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260809 05:32:24.435473 20230 ts_tablet_manager.cc:1939] T 8c394936f58b40f88c091af1260dba6f P bc85ed485bb24332a07e1090217c2aed: Deleting consensus metadata
I20260809 05:32:24.435839 19709 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:32:24.438023 19404 catalog_manager.cc:4841] TS bc85ed485bb24332a07e1090217c2aed (127.26.185.2:45901): tablet 8c394936f58b40f88c091af1260dba6f (table test-table [id=8f1cb58a83054fd4b41f4529fe2e5e89]) successfully deleted
I20260809 05:32:24.438618 20227 ts_tablet_manager.cc:1905] T 8c394936f58b40f88c091af1260dba6f P bd1dd4e479844edb99bac9cd8aa02be6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:32:24.447443 20227 ts_tablet_manager.cc:1918] T 8c394936f58b40f88c091af1260dba6f P bd1dd4e479844edb99bac9cd8aa02be6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:32:24.447682 20227 log.cc:1196] T 8c394936f58b40f88c091af1260dba6f P bd1dd4e479844edb99bac9cd8aa02be6: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/wal/wals/8c394936f58b40f88c091af1260dba6f
I20260809 05:32:24.448343 20227 ts_tablet_manager.cc:1939] T 8c394936f58b40f88c091af1260dba6f P bd1dd4e479844edb99bac9cd8aa02be6: Deleting consensus metadata
I20260809 05:32:24.450963 19404 catalog_manager.cc:4841] TS bd1dd4e479844edb99bac9cd8aa02be6 (127.26.185.3:40229): tablet 8c394936f58b40f88c091af1260dba6f (table test-table [id=8f1cb58a83054fd4b41f4529fe2e5e89]) successfully deleted
I20260809 05:32:24.553375 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 19485
I20260809 05:32:24.591318 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 19726
I20260809 05:32:24.608290 20182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:24.592259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36736 (local address 127.26.185.2:45901)
0809 05:32:24.592459 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 05:32:24.592464 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:32:24.592487 (+ 23us) server_negotiation.cc:407] Connection header received
0809 05:32:24.592699 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:32:24.592704 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:32:24.592812 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:32:24.592913 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:32:24.594615 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.595701 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.597175 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.597680 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.597786 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:24.600869 (+ 3083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:32:24.600895 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:32:24.600921 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:32:24.600964 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:32:24.604741 (+ 3777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:32:24.605589 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:32:24.605598 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:32:24.605600 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:32:24.605761 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:32:24.606134 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:32:24.606158 (+ 24us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:32:24.606163 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:32:24.606844 (+ 681us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:32:24.607255 (+ 411us) server_negotiation.cc:1035] Waiting for connection context
0809 05:32:24.607694 (+ 439us) server_negotiation.cc:299] Negotiation successful
0809 05:32:24.607967 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 05:32:24.609165 19931 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:32:24.710717 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 19726
I20260809 05:32:24.739490 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 19945
I20260809 05:32:24.757709 20179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:24.740511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50580 (local address 127.26.185.3:40229)
0809 05:32:24.740769 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0809 05:32:24.740775 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:32:24.740799 (+ 24us) server_negotiation.cc:407] Connection header received
0809 05:32:24.740875 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:32:24.740879 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:32:24.740973 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:32:24.741068 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:32:24.742826 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.743893 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.745686 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:32:24.746261 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:32:24.746397 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:32:24.749982 (+ 3585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:32:24.750010 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:32:24.750036 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:32:24.750092 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:32:24.754073 (+ 3981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:32:24.755132 (+ 1059us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:32:24.755143 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:32:24.755146 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:32:24.755333 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:32:24.755772 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:32:24.755776 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:32:24.755779 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:32:24.756274 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:32:24.756578 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0809 05:32:24.756972 (+ 394us) server_negotiation.cc:299] Negotiation successful
0809 05:32:24.757222 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 05:32:24.758589 20148 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:32:24.864964 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 19945
I20260809 05:32:24.898380 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 19379
I20260809 05:32:24.900025 19473 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:32:25.035509 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 19379
I20260809 05:32:45.079203 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:44243
--webserver_interface=127.26.185.62
--webserver_port=35617
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:33389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:44243
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:32:45.519732 20237 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:32:45.520196 20237 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:32:45.520381 20237 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:32:45.528391 20237 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 05:32:45.528568 20237 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 05:32:45.528669 20237 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 05:32:45.528766 20237 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:32:45.528882 20237 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:32:45.529014 20237 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:32:45.529104 20237 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:32:45.529194 20237 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:32:45.540462 20237 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:33389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:44243
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:44243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=35617
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:32:45.542377 20237 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:32:45.544217 20237 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:32:45.558723 20243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:32:45.558617 20244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:32:45.558670 20246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:32:45.559849 20237 server_base.cc:1034] running on GCE node
I20260809 05:32:45.560802 20237 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:32:45.562542 20237 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:32:45.563791 20237 hybrid_clock.cc:648] HybridClock initialized: now 1786253565563606 us; error 163 us; skew 500 ppm
I20260809 05:32:45.564177 20237 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:32:45 dist-test-slave-h3ft krb5kdc[18547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253565, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:32:45.573815 20237 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:32:45.575919 20237 webserver.cc:460] Webserver started at http://127.26.185.62:35617/ using document root <none> and password file <none>
I20260809 05:32:45.576871 20237 fs_manager.cc:359] Metadata directory not provided
I20260809 05:32:45.577021 20237 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:32:45.584352 20237 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.000s
I20260809 05:32:45.587975 20258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:32:45.589596 20237 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 05:32:45.589816 20237 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "77850d510ea14382984bfcfefe74dc4d"
format_stamp: "Formatted at 2026-08-09 05:31:58 on dist-test-slave-h3ft"
server_key: "69088751a9974ad7b023f55aaab64db2"
server_key_iv: "bcd68203300b421bfd0648ebd532c11f"
server_key_version: "encryptionkey@0"
I20260809 05:32:45.591038 20237 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:32:45.615553 20237 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:32:45.621238 20237 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:32:45.621621 20237 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:32:45.646844 20237 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:44243
I20260809 05:32:45.646859 20338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:44243 every 8 connection(s)
I20260809 05:32:45.648874 20237 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:32:45.655057 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 20237
I20260809 05:32:45.656154 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:41937
--local_ip_for_outbound_sockets=127.26.185.1
--tserver_master_addrs=127.26.185.62:44243
--webserver_port=37531
--webserver_interface=127.26.185.1
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:33389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:32:45.658456 20339 sys_catalog.cc:263] Verifying existing consensus state
I20260809 05:32:45.662772 20339 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d: Bootstrap starting.
I20260809 05:32:45.696044 20339 log.cc:824] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d: Log is configured to *not* fsync() on all Append() calls
I20260809 05:32:45.725232 20339 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 05:32:45.726229 20339 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d: Bootstrap complete.
I20260809 05:32:45.743173 20339 raft_consensus.cc:348] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77850d510ea14382984bfcfefe74dc4d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44243 } }
I20260809 05:32:45.744880 20339 raft_consensus.cc:729] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77850d510ea14382984bfcfefe74dc4d, State: Initialized, Role: FOLLOWER
I20260809 05:32:45.745939 20339 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77850d510ea14382984bfcfefe74dc4d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44243 } }
I20260809 05:32:45.746315 20339 raft_consensus.cc:388] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:32:45.746487 20339 raft_consensus.cc:482] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:32:45.746740 20339 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [term 2 FOLLOWER]: Advancing to term 3
I20260809 05:32:45.754812 20339 raft_consensus.cc:504] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77850d510ea14382984bfcfefe74dc4d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44243 } }
I20260809 05:32:45.755746 20339 leader_election.cc:302] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77850d510ea14382984bfcfefe74dc4d; no voters:
I20260809 05:32:45.756947 20339 leader_election.cc:288] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 05:32:45.757184 20345 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [term 3 FOLLOWER]: Leader election won for term 3
I20260809 05:32:45.759104 20345 raft_consensus.cc:686] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [term 3 LEADER]: Becoming Leader. State: Replica: 77850d510ea14382984bfcfefe74dc4d, State: Running, Role: LEADER
I20260809 05:32:45.759918 20345 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77850d510ea14382984bfcfefe74dc4d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44243 } }
I20260809 05:32:45.760426 20339 sys_catalog.cc:564] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:32:45.763231 20348 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77850d510ea14382984bfcfefe74dc4d. Latest consensus state: current_term: 3 leader_uuid: "77850d510ea14382984bfcfefe74dc4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77850d510ea14382984bfcfefe74dc4d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44243 } } }
I20260809 05:32:45.763733 20348 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [sys.catalog]: This master's current role is: LEADER
I20260809 05:32:45.764508 20347 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "77850d510ea14382984bfcfefe74dc4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77850d510ea14382984bfcfefe74dc4d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44243 } } }
I20260809 05:32:45.764994 20347 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d [sys.catalog]: This master's current role is: LEADER
I20260809 05:32:45.772828 20353 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:32:45.789323 20353 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:32:45.791493 20353 catalog_manager.cc:1259] Loaded cluster ID: 6956b73c13be46e9bbce413195b0b1f8
I20260809 05:32:45.791659 20353 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:32:45.797056 20353 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:32:45.799037 20353 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d: Loaded TSK: 0
I20260809 05:32:45.799223 20353 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 77850d510ea14382984bfcfefe74dc4d: Loaded TSK: 1
F20260809 05:32:45.800640 20353 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f3cd9aa99ad google::LogMessage::Fail() at ??:0
@ 0x7f3cd9aac88a google::LogMessage::SendToLog() at ??:0
@ 0x7f3cd9aa94de google::LogMessage::Flush() at ??:0
@ 0x7f3cd9aaaa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f3cdd80d7d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f3cdd7fc73e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f3cef4d81c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f3cef4d7783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f3cef5632a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f3cef5630c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f3cef5ad5e9 std::function<>::operator()() at ??:0
@ 0x7f3cef4dbcdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f3cef4d9c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f3cef561610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f3cef561439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f3cdc6f5345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f3cdc6f891c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f3cdc6f8799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f3cdc6d3eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f3cdf9ad6db start_thread at ??:0
@ 0x7f3cd894361f clone at ??:0
W20260809 05:32:46.230147 20341 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:32:46.230538 20341 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:32:46.230679 20341 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:32:46.238858 20341 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:32:46.239111 20341 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:32:46.239313 20341 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:32:46.251303 20341 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:33389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:41937
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=37531
--tserver_master_addrs=127.26.185.62:44243
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:32:46.253180 20341 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:32:46.254971 20341 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:32:46.271402 20414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:32:46.271368 20418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:32:46.271512 20416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:32:46.273062 20341 server_base.cc:1034] running on GCE node
I20260809 05:32:46.273970 20341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:32:46.275259 20341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:32:46.276530 20341 hybrid_clock.cc:648] HybridClock initialized: now 1786253566276437 us; error 77 us; skew 500 ppm
I20260809 05:32:46.276930 20341 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:32:46 dist-test-slave-h3ft krb5kdc[18547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253566, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:32:46.281111 20341 init.cc:377] Logged in from keytab as kudu/127.26.185.1@KRBTEST.COM (short username kudu)
I20260809 05:32:46.283143 20341 webserver.cc:460] Webserver started at http://127.26.185.1:37531/ using document root <none> and password file <none>
I20260809 05:32:46.284049 20341 fs_manager.cc:359] Metadata directory not provided
I20260809 05:32:46.284214 20341 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:32:46.291078 20341 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 05:32:46.294643 20425 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:32:46.296451 20341 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:32:46.296674 20341 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "0c52f3b292e84243bd61a5cb61f0fcea"
format_stamp: "Formatted at 2026-08-09 05:31:58 on dist-test-slave-h3ft"
server_key: "4a77e4cfc3be81d51672dc430879f7fa"
server_key_iv: "a8472cbc63d5dd3fc7632e6a450f722a"
server_key_version: "encryptionkey@0"
I20260809 05:32:46.297887 20341 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:32:46.334118 20341 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:32:46.339838 20341 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:32:46.340194 20341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:32:46.341543 20341 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:32:46.343349 20341 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:32:46.343494 20341 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:32:46.343652 20341 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:32:46.343750 20341 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:32:46.385188 20341 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:41937
I20260809 05:32:46.385263 20623 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:41937 every 8 connection(s)
I20260809 05:32:46.387234 20341 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:32:46.393405 20627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:46.391146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.1:50185)
0809 05:32:46.392019 (+ 873us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:46.392322 (+ 303us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":329,"threads_started":1}
I20260809 05:32:46.393541 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 20341
W20260809 05:32:46.394402 20624 heartbeater.cc:644] Failed to heartbeat to 127.26.185.62:44243 (0 consecutive failures): Network error: Failed to ping master at 127.26.185.62:44243: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
I20260809 05:32:46.394572 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:45901
--local_ip_for_outbound_sockets=127.26.185.2
--tserver_master_addrs=127.26.185.62:44243
--webserver_port=43755
--webserver_interface=127.26.185.2
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:33389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:32:46.395527 20627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:46.395145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.1:53007)
0809 05:32:46.395312 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:46.395401 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 05:32:46.396580 20627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:46.396245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.1:43209)
0809 05:32:46.396379 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:46.396457 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 05:32:46.396925 20624 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 05:32:46.818138 20629 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:32:46.818560 20629 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:32:46.818755 20629 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:32:46.826815 20629 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:32:46.826963 20629 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:32:46.827230 20629 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:32:46.838410 20629 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:33389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:45901
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=43755
--tserver_master_addrs=127.26.185.62:44243
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:32:46.840322 20629 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:32:46.842130 20629 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:32:46.861982 20639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:32:46.861982 20635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:32:46.862197 20634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:32:46.863050 20629 server_base.cc:1034] running on GCE node
I20260809 05:32:46.863874 20629 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:32:46.865115 20629 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:32:46.866338 20629 hybrid_clock.cc:648] HybridClock initialized: now 1786253566866262 us; error 84 us; skew 500 ppm
I20260809 05:32:46.866695 20629 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:32:46 dist-test-slave-h3ft krb5kdc[18547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253566, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:32:46.870910 20629 init.cc:377] Logged in from keytab as kudu/127.26.185.2@KRBTEST.COM (short username kudu)
I20260809 05:32:46.872993 20629 webserver.cc:460] Webserver started at http://127.26.185.2:43755/ using document root <none> and password file <none>
I20260809 05:32:46.873939 20629 fs_manager.cc:359] Metadata directory not provided
I20260809 05:32:46.874066 20629 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:32:46.881369 20629 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 05:32:46.885123 20648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:32:46.887153 20629 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.001s
I20260809 05:32:46.887387 20629 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "bc85ed485bb24332a07e1090217c2aed"
format_stamp: "Formatted at 2026-08-09 05:31:59 on dist-test-slave-h3ft"
server_key: "bb6487fa0b3660c3dd257458f5126b68"
server_key_iv: "a75b6bed2c44ce9f0dbec077dfe7dc60"
server_key_version: "encryptionkey@0"
I20260809 05:32:46.888717 20629 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:32:46.910697 20629 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:32:46.916401 20629 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:32:46.916776 20629 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:32:46.918114 20629 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:32:46.919989 20629 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:32:46.920130 20629 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:32:46.920286 20629 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:32:46.920383 20629 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:32:46.960465 20629 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:45901
I20260809 05:32:46.960520 20832 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:45901 every 8 connection(s)
I20260809 05:32:46.962366 20629 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:32:46.967450 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 20629
I20260809 05:32:46.968369 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:40229
--local_ip_for_outbound_sockets=127.26.185.3
--tserver_master_addrs=127.26.185.62:44243
--webserver_port=40541
--webserver_interface=127.26.185.3
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:33389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:32:46.968725 20835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:46.966157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.2:54607)
0809 05:32:46.967213 (+ 1056us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:46.967457 (+ 244us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":676,"thread_start_us":473,"threads_started":1}
W20260809 05:32:46.969511 20833 heartbeater.cc:644] Failed to heartbeat to 127.26.185.62:44243 (0 consecutive failures): Network error: Failed to ping master at 127.26.185.62:44243: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
I20260809 05:32:46.970541 20835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:46.970170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.2:53309)
0809 05:32:46.970336 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:46.970410 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 05:32:46.971582 20835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:46.971208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.2:57205)
0809 05:32:46.971363 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:46.971456 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260809 05:32:46.971822 20833 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 05:32:47.389858 20838 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:32:47.390226 20838 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:32:47.390401 20838 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260809 05:32:47.398911 20842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:47.397756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.1:33555)
0809 05:32:47.398484 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:47.398611 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":385,"threads_started":1}
W20260809 05:32:47.398911 20838 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:32:47.399158 20838 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:32:47.399423 20838 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:32:47.411563 20838 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:33389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:40229
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=40541
--tserver_master_addrs=127.26.185.62:44243
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:32:47.413498 20838 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:32:47.415409 20838 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:32:47.433362 20846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:32:47.433405 20848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:32:47.433468 20845 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:32:47.439756 20838 server_base.cc:1034] running on GCE node
I20260809 05:32:47.440742 20838 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:32:47.442150 20838 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:32:47.443385 20838 hybrid_clock.cc:648] HybridClock initialized: now 1786253567443325 us; error 59 us; skew 500 ppm
I20260809 05:32:47.443821 20838 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:32:47 dist-test-slave-h3ft krb5kdc[18547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253567, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:32:47.448007 20838 init.cc:377] Logged in from keytab as kudu/127.26.185.3@KRBTEST.COM (short username kudu)
I20260809 05:32:47.450145 20838 webserver.cc:460] Webserver started at http://127.26.185.3:40541/ using document root <none> and password file <none>
I20260809 05:32:47.451206 20838 fs_manager.cc:359] Metadata directory not provided
I20260809 05:32:47.451331 20838 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:32:47.458215 20838 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 05:32:47.461908 20860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:32:47.463882 20838 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:32:47.464099 20838 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "bd1dd4e479844edb99bac9cd8aa02be6"
format_stamp: "Formatted at 2026-08-09 05:32:00 on dist-test-slave-h3ft"
server_key: "60ce4833fea28e93297a552c4622caca"
server_key_iv: "f8c538005c712a664b366e2f614d6358"
server_key_version: "encryptionkey@0"
I20260809 05:32:47.465324 20838 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:32:47.502640 20838 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:32:47.508389 20838 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:32:47.508775 20838 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:32:47.510116 20838 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:32:47.512040 20838 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:32:47.512178 20838 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:32:47.512334 20838 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:32:47.512429 20838 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:32:47.554364 20838 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:40229
I20260809 05:32:47.554438 21035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:40229 every 8 connection(s)
I20260809 05:32:47.556346 20838 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:32:47.562676 21041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:47.560420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.3:51475)
0809 05:32:47.561329 (+ 909us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:47.561610 (+ 281us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":373,"threads_started":1}
I20260809 05:32:47.563476 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 20838
W20260809 05:32:47.563781 21036 heartbeater.cc:644] Failed to heartbeat to 127.26.185.62:44243 (0 consecutive failures): Network error: Failed to ping master at 127.26.185.62:44243: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
I20260809 05:32:47.564983 21041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:47.564478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.3:55001)
0809 05:32:47.564684 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:47.564789 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260809 05:32:47.566184 21041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:47.565719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.3:46477)
0809 05:32:47.565909 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:47.566020 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260809 05:32:47.566457 21036 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 05:32:47.973686 21043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:47.972675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.2:38881)
0809 05:32:47.973254 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:47.973390 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":272,"threads_started":1}
I20260809 05:32:48.401363 21044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:48.400279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.1:45739)
0809 05:32:48.401016 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:48.401133 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":591,"thread_start_us":418,"threads_started":1}
I20260809 05:32:48.568140 21045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:48.567143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.3:52097)
0809 05:32:48.567716 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:48.567833 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":291,"threads_started":1}
I20260809 05:32:48.976001 21048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:48.974981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.2:33849)
0809 05:32:48.975635 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:48.975760 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":295,"threads_started":1}
I20260809 05:32:49.403681 21049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:49.402715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.1:32911)
0809 05:32:49.403342 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:49.403452 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":368,"threads_started":1}
I20260809 05:32:49.570580 21050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:49.569384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.3:41123)
0809 05:32:49.570201 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:49.570323 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":675,"thread_start_us":503,"threads_started":1}
I20260809 05:32:49.978204 21051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:49.977223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.2:49841)
0809 05:32:49.977835 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:49.977962 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":326,"threads_started":1}
I20260809 05:32:50.405876 21052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:50.404843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.1:50437)
0809 05:32:50.405483 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:50.405599 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":344,"threads_started":1}
I20260809 05:32:50.572873 21053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:50.571899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.3:52147)
0809 05:32:50.572513 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:50.572642 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":310,"threads_started":1}
I20260809 05:32:50.980520 21054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:50.979443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.2:42005)
0809 05:32:50.980169 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:50.980279 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":596,"thread_start_us":436,"threads_started":1}
I20260809 05:32:51.408360 21057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:51.407229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.1:59397)
0809 05:32:51.408013 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:51.408125 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":631,"thread_start_us":472,"threads_started":1}
I20260809 05:32:51.575167 21060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:51.574184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.3:35669)
0809 05:32:51.574754 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:51.574866 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":317,"threads_started":1}
I20260809 05:32:51.982864 21064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:51.981859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.2:46353)
0809 05:32:51.982523 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:51.982638 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":380,"threads_started":1}
I20260809 05:32:52.410568 21065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:52.409617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.1:45873)
0809 05:32:52.410203 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:52.410325 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":308,"threads_started":1}
I20260809 05:32:52.577257 21066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:52.576249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.3:52155)
0809 05:32:52.576877 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:52.577000 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":321,"threads_started":1}
I20260809 05:32:52.985278 21068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:52.984267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.2:48299)
0809 05:32:52.984903 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:52.985055 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":351,"threads_started":1}
I20260809 05:32:53.413393 21071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:53.412253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.1:32793)
0809 05:32:53.412983 (+ 730us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:53.413110 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":329,"threads_started":1}
I20260809 05:32:53.579926 21073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:53.578754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.3:50279)
0809 05:32:53.579501 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:53.579636 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":418,"threads_started":1}
I20260809 05:32:53.988039 21075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:53.986687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.2:42835)
0809 05:32:53.987600 (+ 913us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:53.987729 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":751,"thread_start_us":518,"threads_started":1}
I20260809 05:32:54.415704 21076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:54.414676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.1:58161)
0809 05:32:54.415381 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:54.415484 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":454,"threads_started":1}
I20260809 05:32:54.582361 21078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:54.581141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.3:45673)
0809 05:32:54.581951 (+ 810us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:54.582081 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":303,"threads_started":1}
I20260809 05:32:54.990415 21083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:54.989455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.2:40669)
0809 05:32:54.990058 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:54.990167 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":319,"threads_started":1}
I20260809 05:32:55.417987 21084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:55.416901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.1:57697)
0809 05:32:55.417588 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:55.417740 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":348,"threads_started":1}
I20260809 05:32:55.584497 21085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:55.583571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.3:46737)
0809 05:32:55.584151 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:55.584261 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":300,"threads_started":1}
I20260809 05:32:55.992712 21087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:55.991660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.2:46721)
0809 05:32:55.992274 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:55.992381 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":320,"threads_started":1}
I20260809 05:32:56.420571 21088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:56.419516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.1:56373)
0809 05:32:56.420224 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:56.420343 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":564,"thread_start_us":401,"threads_started":1}
I20260809 05:32:56.587220 21089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:56.585937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.3:52775)
0809 05:32:56.586702 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:56.586882 (+ 180us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":611,"thread_start_us":419,"threads_started":1}
I20260809 05:32:56.995214 21094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:56.994108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.2:44579)
0809 05:32:56.994729 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:56.994844 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":339,"threads_started":1}
I20260809 05:32:57.423486 21095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:57.422317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.1:43881)
0809 05:32:57.423070 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:57.423247 (+ 177us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":309,"threads_started":1}
I20260809 05:32:57.589711 21099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:57.588600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.3:37363)
0809 05:32:57.589360 (+ 760us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:57.589479 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":467,"threads_started":1}
I20260809 05:32:57.997627 21101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:57.996639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.2:60583)
0809 05:32:57.997236 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:57.997363 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":301,"threads_started":1}
I20260809 05:32:58.425850 21103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:58.424907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.1:53417)
0809 05:32:58.425504 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:58.425619 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":295,"threads_started":1}
I20260809 05:32:58.592254 21104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:58.591148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.3:60887)
0809 05:32:58.591828 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:58.591992 (+ 164us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":302,"threads_started":1}
I20260809 05:32:59.000134 21105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:58.999089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.2:60537)
0809 05:32:58.999750 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:58.999868 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":342,"threads_started":1}
I20260809 05:32:59.428188 21106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:59.426995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.1:35001)
0809 05:32:59.427750 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:59.427899 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":340,"threads_started":1}
I20260809 05:32:59.594950 21108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:32:59.593979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.3:54521)
0809 05:32:59.594582 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0809 05:32:59.594700 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":293,"threads_started":1}
I20260809 05:33:00.003090 21109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:00.001795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.2:48315)
0809 05:33:00.002579 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:00.002727 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":399,"threads_started":1}
I20260809 05:33:00.430591 21110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:00.429534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.1:38681)
0809 05:33:00.430182 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:00.430310 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":337,"threads_started":1}
I20260809 05:33:00.597937 21112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:00.596665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.3:44599)
0809 05:33:00.597481 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:00.597645 (+ 164us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":645,"thread_start_us":390,"threads_started":1}
I20260809 05:33:01.006237 21113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:01.005115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.2:36533)
0809 05:33:01.005821 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:01.005970 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":391,"threads_started":1}
I20260809 05:33:01.433370 21114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:01.432330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.1:34389)
0809 05:33:01.432989 (+ 659us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:01.433112 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":332,"threads_started":1}
I20260809 05:33:01.600283 21115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:01.599258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.3:37813)
0809 05:33:01.599835 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:01.599979 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":291,"threads_started":1}
I20260809 05:33:02.009078 21116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:02.007920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.2:34919)
0809 05:33:02.008677 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:02.008828 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":581,"thread_start_us":400,"threads_started":1}
I20260809 05:33:02.435734 21117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:02.434683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.1:57361)
0809 05:33:02.435388 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:02.435524 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":418,"threads_started":1}
I20260809 05:33:02.570515 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 20341
I20260809 05:33:02.593918 21118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:02.572242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56260 (local address 127.26.185.1:41937)
0809 05:33:02.573097 (+ 855us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:02.573119 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:02.573177 (+ 58us) server_negotiation.cc:407] Connection header received
0809 05:33:02.575343 (+ 2166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:02.575357 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:02.575947 (+ 590us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:02.576422 (+ 475us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:02.578323 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:02.579889 (+ 1566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:02.581435 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:02.582280 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:02.582525 (+ 245us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:02.586009 (+ 3484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:02.586027 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:02.586052 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:02.586107 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:02.589654 (+ 3547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:02.590548 (+ 894us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:02.590557 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:02.590567 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:02.590776 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:02.591277 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:02.591282 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:02.591286 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:02.591995 (+ 709us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:02.592367 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:02.592983 (+ 616us) server_negotiation.cc:299] Negotiation successful
0809 05:33:02.593562 (+ 579us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":600,"thread_start_us":723,"threads_started":1}
I20260809 05:33:02.595856 20618 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:33:02.602833 21122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:02.601748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44243 (local address 127.26.185.3:58005)
0809 05:33:02.602457 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:02.602585 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.62:44243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":398,"threads_started":1}
I20260809 05:33:02.692273 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 20341
I20260809 05:33:02.731560 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 20629
I20260809 05:33:02.754637 21124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:02.732850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53652 (local address 127.26.185.2:45901)
0809 05:33:02.733579 (+ 729us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:02.733599 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:02.733649 (+ 50us) server_negotiation.cc:407] Connection header received
0809 05:33:02.735744 (+ 2095us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:02.735758 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:02.736379 (+ 621us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:02.736778 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:02.738557 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:02.740141 (+ 1584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:02.741637 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:02.742475 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:02.742630 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:02.746003 (+ 3373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:02.746013 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:02.746035 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:02.746092 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:02.750115 (+ 4023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:02.751082 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:02.751098 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:02.751108 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:02.751433 (+ 325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:02.751915 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:02.751923 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:02.751927 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:02.752685 (+ 758us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:02.753092 (+ 407us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:02.753664 (+ 572us) server_negotiation.cc:299] Negotiation successful
0809 05:33:02.754272 (+ 608us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":517,"thread_start_us":332,"threads_started":1}
I20260809 05:33:02.756618 20826 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:33:02.854415 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 20629
I20260809 05:33:02.886636 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 20838
I20260809 05:33:02.909452 21127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:02.888171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38962 (local address 127.26.185.3:40229)
0809 05:33:02.888970 (+ 799us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:02.889016 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:02.889074 (+ 58us) server_negotiation.cc:407] Connection header received
0809 05:33:02.891063 (+ 1989us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:02.891083 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:02.891701 (+ 618us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:02.892141 (+ 440us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:02.893934 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:02.895427 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:02.896890 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:02.897685 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:02.897911 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:02.901307 (+ 3396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:02.901316 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:02.901338 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:02.901386 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:02.905004 (+ 3618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:02.905950 (+ 946us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:02.905966 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:02.905976 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:02.906222 (+ 246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:02.906691 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:02.906697 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:02.906702 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:02.907535 (+ 833us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:02.907899 (+ 364us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:02.908455 (+ 556us) server_negotiation.cc:299] Negotiation successful
0809 05:33:02.909074 (+ 619us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":597,"thread_start_us":411,"threads_started":1}
I20260809 05:33:02.911425 21026 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:33:03.007175 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 20838
2026-08-09T05:33:03Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (67179 ms)
[----------] 30 tests from SecurityITest (348857 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:33:03 dist-test-slave-h3ft krb5kdc[21132](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:33:03 dist-test-slave-h3ft krb5kdc[21132](info): set up 2 sockets
Aug 09 05:33:03 dist-test-slave-h3ft krb5kdc[21132](info): commencing operation
krb5kdc: starting...
W20260809 05:33:04.445466 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.378s user 0.000s sys 0.060s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:33:04 dist-test-slave-h3ft krb5kdc[21132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:33:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:33:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
I20260809 05:33:04.868994 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:33277
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:32877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:33277
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:33:05.318876 21147 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:05.319535 21147 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:05.319746 21147 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:05.331496 21147 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:33:05.331694 21147 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:05.331785 21147 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:05.331909 21147 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:33:05.332007 21147 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:33:05.344043 21147 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:32877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:33277
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:33277
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:05.346004 21147 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:05.347961 21147 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:05.363665 21153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:05.363732 21157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:05.363757 21154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:05.364985 21147 server_base.cc:1034] running on GCE node
I20260809 05:33:05.366130 21147 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:05.368287 21147 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:05.369549 21147 hybrid_clock.cc:648] HybridClock initialized: now 1786253585369461 us; error 63 us; skew 500 ppm
I20260809 05:33:05.370097 21147 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:33:05 dist-test-slave-h3ft krb5kdc[21132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253585, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:33:05.378269 21147 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:33:05.380496 21147 webserver.cc:460] Webserver started at http://127.26.185.62:34329/ using document root <none> and password file <none>
I20260809 05:33:05.381484 21147 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:05.381662 21147 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:05.382069 21147 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:05.385941 21147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "fbd1ca8cc3be43a6bf3b748e0361370e"
format_stamp: "Formatted at 2026-08-09 05:33:05 on dist-test-slave-h3ft"
server_key: "a7feab97ba18e3dd0bfe986fdbe3b8f5"
server_key_iv: "cb85cb628c98456e2c10d2ca9595645a"
server_key_version: "encryptionkey@0"
I20260809 05:33:05.386889 21147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "fbd1ca8cc3be43a6bf3b748e0361370e"
format_stamp: "Formatted at 2026-08-09 05:33:05 on dist-test-slave-h3ft"
server_key: "a7feab97ba18e3dd0bfe986fdbe3b8f5"
server_key_iv: "cb85cb628c98456e2c10d2ca9595645a"
server_key_version: "encryptionkey@0"
I20260809 05:33:05.393363 21147 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.003s
I20260809 05:33:05.397626 21164 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:05.399487 21147 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:33:05.399715 21147 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "fbd1ca8cc3be43a6bf3b748e0361370e"
format_stamp: "Formatted at 2026-08-09 05:33:05 on dist-test-slave-h3ft"
server_key: "a7feab97ba18e3dd0bfe986fdbe3b8f5"
server_key_iv: "cb85cb628c98456e2c10d2ca9595645a"
server_key_version: "encryptionkey@0"
I20260809 05:33:05.399999 21147 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:05.414727 21147 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:05.420159 21147 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:05.420534 21147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:05.444032 21147 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:33277
I20260809 05:33:05.444108 21247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:33277 every 8 connection(s)
I20260809 05:33:05.445858 21147 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:33:05.450928 21248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:05.454854 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 21147
I20260809 05:33:05.455210 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:33:05.456223 27364 external_mini_cluster.cc:1428] Setting key 8dd481bd9032c9f721d4b245f1c992df
I20260809 05:33:05.467049 21248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbd1ca8cc3be43a6bf3b748e0361370e: Bootstrap starting.
I20260809 05:33:05.471350 21248 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fbd1ca8cc3be43a6bf3b748e0361370e: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:05.472726 21248 log.cc:824] T 00000000000000000000000000000000 P fbd1ca8cc3be43a6bf3b748e0361370e: Log is configured to *not* fsync() on all Append() calls
Aug 09 05:33:05 dist-test-slave-h3ft krb5kdc[21132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:33:05.477196 21248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbd1ca8cc3be43a6bf3b748e0361370e: No bootstrap required, opened a new log
I20260809 05:33:05.486923 21248 raft_consensus.cc:348] T 00000000000000000000000000000000 P fbd1ca8cc3be43a6bf3b748e0361370e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbd1ca8cc3be43a6bf3b748e0361370e" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33277 } }
I20260809 05:33:05.487519 21248 raft_consensus.cc:374] T 00000000000000000000000000000000 P fbd1ca8cc3be43a6bf3b748e0361370e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:05.487543 21255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:05.459221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40180 (local address 127.26.185.62:33277)
0809 05:33:05.460334 (+ 1113us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:05.460353 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:05.460413 (+ 60us) server_negotiation.cc:407] Connection header received
0809 05:33:05.462607 (+ 2194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:05.462641 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:05.463396 (+ 755us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:05.463999 (+ 603us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:05.466207 (+ 2208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:05.468137 (+ 1930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:05.469831 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:05.470703 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:05.470970 (+ 267us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:05.477192 (+ 6222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:05.477205 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:05.477226 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:05.477277 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:05.481584 (+ 4307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:05.482655 (+ 1071us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:05.482666 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:05.482676 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:05.482959 (+ 283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:05.483512 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:05.483520 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:05.483529 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:05.484369 (+ 840us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:05.484794 (+ 425us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:05.485388 (+ 594us) server_negotiation.cc:299] Negotiation successful
0809 05:33:05.486005 (+ 617us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":823,"thread_start_us":519,"threads_started":1}
I20260809 05:33:05.487668 21248 raft_consensus.cc:729] T 00000000000000000000000000000000 P fbd1ca8cc3be43a6bf3b748e0361370e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbd1ca8cc3be43a6bf3b748e0361370e, State: Initialized, Role: FOLLOWER
I20260809 05:33:05.488582 21248 consensus_queue.cc:260] T 00000000000000000000000000000000 P fbd1ca8cc3be43a6bf3b748e0361370e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbd1ca8cc3be43a6bf3b748e0361370e" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33277 } }
I20260809 05:33:05.488930 21248 raft_consensus.cc:388] T 00000000000000000000000000000000 P fbd1ca8cc3be43a6bf3b748e0361370e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:33:05.489096 21248 raft_consensus.cc:482] T 00000000000000000000000000000000 P fbd1ca8cc3be43a6bf3b748e0361370e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:33:05.489318 21248 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fbd1ca8cc3be43a6bf3b748e0361370e [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:05.492456 21248 raft_consensus.cc:504] T 00000000000000000000000000000000 P fbd1ca8cc3be43a6bf3b748e0361370e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbd1ca8cc3be43a6bf3b748e0361370e" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33277 } }
I20260809 05:33:05.493072 21248 leader_election.cc:302] T 00000000000000000000000000000000 P fbd1ca8cc3be43a6bf3b748e0361370e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fbd1ca8cc3be43a6bf3b748e0361370e; no voters:
I20260809 05:33:05.493904 21248 leader_election.cc:288] T 00000000000000000000000000000000 P fbd1ca8cc3be43a6bf3b748e0361370e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:33:05.494072 21258 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fbd1ca8cc3be43a6bf3b748e0361370e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:33:05.495082 21258 raft_consensus.cc:686] T 00000000000000000000000000000000 P fbd1ca8cc3be43a6bf3b748e0361370e [term 1 LEADER]: Becoming Leader. State: Replica: fbd1ca8cc3be43a6bf3b748e0361370e, State: Running, Role: LEADER
I20260809 05:33:05.495790 21258 consensus_queue.cc:237] T 00000000000000000000000000000000 P fbd1ca8cc3be43a6bf3b748e0361370e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbd1ca8cc3be43a6bf3b748e0361370e" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33277 } }
I20260809 05:33:05.496609 21248 sys_catalog.cc:564] T 00000000000000000000000000000000 P fbd1ca8cc3be43a6bf3b748e0361370e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:33:05.499500 21260 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbd1ca8cc3be43a6bf3b748e0361370e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fbd1ca8cc3be43a6bf3b748e0361370e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbd1ca8cc3be43a6bf3b748e0361370e" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33277 } } }
I20260809 05:33:05.499508 21263 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbd1ca8cc3be43a6bf3b748e0361370e [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbd1ca8cc3be43a6bf3b748e0361370e. Latest consensus state: current_term: 1 leader_uuid: "fbd1ca8cc3be43a6bf3b748e0361370e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbd1ca8cc3be43a6bf3b748e0361370e" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 33277 } } }
I20260809 05:33:05.500057 21263 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbd1ca8cc3be43a6bf3b748e0361370e [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:05.500057 21260 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbd1ca8cc3be43a6bf3b748e0361370e [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:05.501178 21273 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:33:05.511435 21273 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:33:05.521828 21273 catalog_manager.cc:1347] Generated new cluster ID: ebbf967d932a4f70ad9db9ac5a0dfc48
I20260809 05:33:05.521996 21273 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:33:05.538039 21273 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:33:05.540395 21273 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:33:05.556227 21273 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fbd1ca8cc3be43a6bf3b748e0361370e: Generated new TSK 0
I20260809 05:33:05.557443 21273 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.185.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
I20260809 05:33:05.672641 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:0
--local_ip_for_outbound_sockets=127.26.185.1
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:33277
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:32877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:33:06.128357 21298 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:06.128861 21298 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:06.128988 21298 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:06.137260 21298 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:06.137439 21298 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:06.137574 21298 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:33:06.148909 21298 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:32877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:33277
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:06.150774 21298 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:06.152565 21298 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:06.169757 21305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:06.169771 21307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:06.169589 21310 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:06.170763 21298 server_base.cc:1034] running on GCE node
I20260809 05:33:06.171623 21298 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:06.172869 21298 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:06.174136 21298 hybrid_clock.cc:648] HybridClock initialized: now 1786253586174050 us; error 78 us; skew 500 ppm
I20260809 05:33:06.174531 21298 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:33:06 dist-test-slave-h3ft krb5kdc[21132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253586, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:33:06.178830 21298 init.cc:377] Logged in from keytab as kudu/127.26.185.1@KRBTEST.COM (short username kudu)
I20260809 05:33:06.180943 21298 webserver.cc:460] Webserver started at http://127.26.185.1:43653/ using document root <none> and password file <none>
I20260809 05:33:06.181847 21298 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:06.181977 21298 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:06.182314 21298 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:06.186193 21298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-0/data/instance:
uuid: "553035d9fe0e43f68016f1f233b6bfc2"
format_stamp: "Formatted at 2026-08-09 05:33:06 on dist-test-slave-h3ft"
server_key: "082a5d195381f2d3a2dca9d0b08ab970"
server_key_iv: "54880fb17657482ceb07d959ecbd214f"
server_key_version: "encryptionkey@0"
I20260809 05:33:06.187244 21298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance:
uuid: "553035d9fe0e43f68016f1f233b6bfc2"
format_stamp: "Formatted at 2026-08-09 05:33:06 on dist-test-slave-h3ft"
server_key: "082a5d195381f2d3a2dca9d0b08ab970"
server_key_iv: "54880fb17657482ceb07d959ecbd214f"
server_key_version: "encryptionkey@0"
I20260809 05:33:06.194121 21298 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260809 05:33:06.198765 21318 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:06.200678 21298 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260809 05:33:06.200892 21298 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "553035d9fe0e43f68016f1f233b6bfc2"
format_stamp: "Formatted at 2026-08-09 05:33:06 on dist-test-slave-h3ft"
server_key: "082a5d195381f2d3a2dca9d0b08ab970"
server_key_iv: "54880fb17657482ceb07d959ecbd214f"
server_key_version: "encryptionkey@0"
I20260809 05:33:06.201174 21298 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:06.223340 21298 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:06.229431 21298 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:06.229851 21298 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:06.231361 21298 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:33:06.233312 21298 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:33:06.233412 21298 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:06.233574 21298 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:33:06.233646 21298 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:06.275774 21298 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:35621
I20260809 05:33:06.275935 21496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:35621 every 8 connection(s)
I20260809 05:33:06.277489 21298 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:33:06.282641 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 21298
I20260809 05:33:06.283077 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance
I20260809 05:33:06.284133 27364 external_mini_cluster.cc:1428] Setting key 2200773379abd8f988f683fa9aa0935a
Aug 09 05:33:06 dist-test-slave-h3ft krb5kdc[21132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253586, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:33:06.308686 21500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:06.281304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:53099 (local address 127.26.185.62:33277)
0809 05:33:06.281961 (+ 657us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:06.281970 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:06.283696 (+ 1726us) server_negotiation.cc:407] Connection header received
0809 05:33:06.286381 (+ 2685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:06.286387 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:06.286492 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:06.286659 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:06.289333 (+ 2674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:06.290347 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:06.293168 (+ 2821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:06.293652 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:06.293783 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:06.299702 (+ 5919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:06.299713 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:06.299721 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:06.299784 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:06.304193 (+ 4409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:06.305446 (+ 1253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:06.305456 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:06.305463 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:06.305655 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:06.306274 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:06.306278 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:06.306280 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:06.306726 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:06.306861 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:06.308118 (+ 1257us) server_negotiation.cc:299] Negotiation successful
0809 05:33:06.308354 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":476,"thread_start_us":295,"threads_started":1}
I20260809 05:33:06.310791 21501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:06.282220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33277 (local address 127.26.185.1:53099)
0809 05:33:06.283457 (+ 1237us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:06.283525 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:06.286046 (+ 2521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:06.286996 (+ 950us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:06.287012 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:06.287987 (+ 975us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:33:06.289049 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:06.289084 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:06.290577 (+ 1493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:06.290585 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:06.292979 (+ 2394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:06.293000 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:06.293956 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:06.293967 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:06.294395 (+ 428us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:06.295584 (+ 1189us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:33:06.295625 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:33:06.299308 (+ 3683us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:33:06.304481 (+ 5173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:33:06.304499 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:33:06.304522 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:33:06.305270 (+ 748us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:33:06.305781 (+ 511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:33:06.305784 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:33:06.305786 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:33:06.306125 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:33:06.306873 (+ 748us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:33:06.306887 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:33:06.307554 (+ 667us) client_negotiation.cc:769] Sending connection context
0809 05:33:06.307990 (+ 436us) client_negotiation.cc:240] Negotiation successful
0809 05:33:06.308774 (+ 784us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":782,"thread_start_us":453,"threads_started":1}
I20260809 05:33:06.313189 21498 heartbeater.cc:347] Connected to a master server at 127.26.185.62:33277
I20260809 05:33:06.313651 21498 heartbeater.cc:464] Registering TS with master...
I20260809 05:33:06.314847 21498 heartbeater.cc:511] Master 127.26.185.62:33277 requested a full tablet report, sending...
I20260809 05:33:06.318120 21193 ts_manager.cc:194] Registered new tserver with Master: 553035d9fe0e43f68016f1f233b6bfc2 (127.26.185.1:35621)
I20260809 05:33:06.320076 21193 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.1@KRBTEST.COM'} at 127.26.185.1:53099
WARNING: no policy specified for kudu/127.26.185.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
I20260809 05:33:06.384071 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:0
--local_ip_for_outbound_sockets=127.26.185.2
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:33277
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:32877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:33:06.826509 21507 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:06.826918 21507 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:06.827157 21507 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:06.835122 21507 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:06.835268 21507 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:06.835485 21507 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:33:06.850986 21507 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:32877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:33277
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:06.853451 21507 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:06.855479 21507 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:06.873543 21515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:06.873667 21514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:06.873785 21519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:06.874881 21507 server_base.cc:1034] running on GCE node
I20260809 05:33:06.875861 21507 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:06.877230 21507 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:06.878551 21507 hybrid_clock.cc:648] HybridClock initialized: now 1786253586878490 us; error 50 us; skew 500 ppm
I20260809 05:33:06.879164 21507 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:33:06 dist-test-slave-h3ft krb5kdc[21132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253586, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:33:06.883757 21507 init.cc:377] Logged in from keytab as kudu/127.26.185.2@KRBTEST.COM (short username kudu)
I20260809 05:33:06.886023 21507 webserver.cc:460] Webserver started at http://127.26.185.2:38155/ using document root <none> and password file <none>
I20260809 05:33:06.887154 21507 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:06.887305 21507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:06.887771 21507 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:06.892186 21507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-1/data/instance:
uuid: "a9772514a22549ea9a2a3ff02eccbf9b"
format_stamp: "Formatted at 2026-08-09 05:33:06 on dist-test-slave-h3ft"
server_key: "ce643fe1029f5c37ddfd997e9a650956"
server_key_iv: "d2b4b5b1193c25d6c6a13d9db378c691"
server_key_version: "encryptionkey@0"
I20260809 05:33:06.893404 21507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance:
uuid: "a9772514a22549ea9a2a3ff02eccbf9b"
format_stamp: "Formatted at 2026-08-09 05:33:06 on dist-test-slave-h3ft"
server_key: "ce643fe1029f5c37ddfd997e9a650956"
server_key_iv: "d2b4b5b1193c25d6c6a13d9db378c691"
server_key_version: "encryptionkey@0"
I20260809 05:33:06.901610 21507 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.009s sys 0.000s
I20260809 05:33:06.907157 21527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:06.909349 21507 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260809 05:33:06.909662 21507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "a9772514a22549ea9a2a3ff02eccbf9b"
format_stamp: "Formatted at 2026-08-09 05:33:06 on dist-test-slave-h3ft"
server_key: "ce643fe1029f5c37ddfd997e9a650956"
server_key_iv: "d2b4b5b1193c25d6c6a13d9db378c691"
server_key_version: "encryptionkey@0"
I20260809 05:33:06.910006 21507 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:06.934227 21507 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:06.941267 21507 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:06.941702 21507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:06.943094 21507 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:33:06.944999 21507 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:33:06.945125 21507 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:06.945309 21507 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:33:06.945392 21507 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:06.988173 21507 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:35957
I20260809 05:33:06.988212 21696 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:35957 every 8 connection(s)
I20260809 05:33:06.989910 21507 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:33:06.991899 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 21507
I20260809 05:33:06.992101 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance
I20260809 05:33:06.992712 27364 external_mini_cluster.cc:1428] Setting key e44e15cb28b5761df7d7b354b04f237c
Aug 09 05:33:07 dist-test-slave-h3ft krb5kdc[21132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253586, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:33:07.017242 21703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:06.994097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:58885 (local address 127.26.185.62:33277)
0809 05:33:06.994703 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:06.994710 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:06.996195 (+ 1485us) server_negotiation.cc:407] Connection header received
0809 05:33:06.998618 (+ 2423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:06.998624 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:06.998735 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:06.998870 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:07.000793 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:07.001639 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:07.003594 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:07.004175 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:07.004332 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:07.009037 (+ 4705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:07.009044 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:07.009047 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:07.009094 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:07.012299 (+ 3205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:07.013695 (+ 1396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:07.013704 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:07.013710 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:07.013937 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:07.014612 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:07.014642 (+ 30us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:07.014648 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:07.015138 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:07.015337 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:07.016593 (+ 1256us) server_negotiation.cc:299] Negotiation successful
0809 05:33:07.016881 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":461,"thread_start_us":291,"threads_started":1}
I20260809 05:33:07.019198 21704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:06.994981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33277 (local address 127.26.185.2:58885)
0809 05:33:06.996008 (+ 1027us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:06.996066 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:06.998298 (+ 2232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:06.999205 (+ 907us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:06.999216 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:06.999851 (+ 635us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:33:07.000584 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:07.000604 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:07.001829 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:07.001834 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:07.003426 (+ 1592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:07.003440 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:07.004459 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:07.004467 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:07.004791 (+ 324us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:07.005809 (+ 1018us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:33:07.005845 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:33:07.008682 (+ 2837us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:33:07.012503 (+ 3821us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:33:07.012518 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:33:07.012545 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:33:07.013471 (+ 926us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:33:07.014112 (+ 641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:33:07.014117 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:33:07.014120 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:33:07.014404 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:33:07.015293 (+ 889us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:33:07.015307 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:33:07.016017 (+ 710us) client_negotiation.cc:769] Sending connection context
0809 05:33:07.016435 (+ 418us) client_negotiation.cc:240] Negotiation successful
0809 05:33:07.017212 (+ 777us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":661,"thread_start_us":393,"threads_started":1}
I20260809 05:33:07.021474 21697 heartbeater.cc:347] Connected to a master server at 127.26.185.62:33277
I20260809 05:33:07.021947 21697 heartbeater.cc:464] Registering TS with master...
I20260809 05:33:07.023149 21697 heartbeater.cc:511] Master 127.26.185.62:33277 requested a full tablet report, sending...
I20260809 05:33:07.025352 21193 ts_manager.cc:194] Registered new tserver with Master: a9772514a22549ea9a2a3ff02eccbf9b (127.26.185.2:35957)
I20260809 05:33:07.026364 21193 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.2@KRBTEST.COM'} at 127.26.185.2:58885
WARNING: no policy specified for kudu/127.26.185.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
I20260809 05:33:07.088328 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:0
--local_ip_for_outbound_sockets=127.26.185.3
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:33277
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:32877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:33:07.325066 21498 heartbeater.cc:503] Master 127.26.185.62:33277 was elected leader, sending a full tablet report...
W20260809 05:33:07.529127 21710 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:07.529603 21710 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:07.529786 21710 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:07.538199 21710 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:07.538543 21710 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:07.538759 21710 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:33:07.550254 21710 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:32877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:33277
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:07.552202 21710 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:07.553985 21710 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:07.570820 21720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:07.570993 21718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:07.571084 21717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:07.572427 21710 server_base.cc:1034] running on GCE node
I20260809 05:33:07.573436 21710 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:07.574764 21710 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:07.576084 21710 hybrid_clock.cc:648] HybridClock initialized: now 1786253587576035 us; error 69 us; skew 500 ppm
I20260809 05:33:07.576586 21710 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:33:07 dist-test-slave-h3ft krb5kdc[21132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253587, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:33:07.581197 21710 init.cc:377] Logged in from keytab as kudu/127.26.185.3@KRBTEST.COM (short username kudu)
I20260809 05:33:07.583613 21710 webserver.cc:460] Webserver started at http://127.26.185.3:38037/ using document root <none> and password file <none>
I20260809 05:33:07.584672 21710 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:07.584877 21710 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:07.585359 21710 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:07.589677 21710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-2/data/instance:
uuid: "74f99f92d820445194457ddbbc850cf5"
format_stamp: "Formatted at 2026-08-09 05:33:07 on dist-test-slave-h3ft"
server_key: "6fca3e9e19bcda4d6906a3aad4464f64"
server_key_iv: "ce19c6cecaff72ed8dff44a3deb714a1"
server_key_version: "encryptionkey@0"
I20260809 05:33:07.590812 21710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance:
uuid: "74f99f92d820445194457ddbbc850cf5"
format_stamp: "Formatted at 2026-08-09 05:33:07 on dist-test-slave-h3ft"
server_key: "6fca3e9e19bcda4d6906a3aad4464f64"
server_key_iv: "ce19c6cecaff72ed8dff44a3deb714a1"
server_key_version: "encryptionkey@0"
I20260809 05:33:07.598462 21710 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
I20260809 05:33:07.603636 21731 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:07.605736 21710 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260809 05:33:07.605985 21710 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "74f99f92d820445194457ddbbc850cf5"
format_stamp: "Formatted at 2026-08-09 05:33:07 on dist-test-slave-h3ft"
server_key: "6fca3e9e19bcda4d6906a3aad4464f64"
server_key_iv: "ce19c6cecaff72ed8dff44a3deb714a1"
server_key_version: "encryptionkey@0"
I20260809 05:33:07.606276 21710 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:07.630256 21710 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:07.636121 21710 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:07.636511 21710 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:07.637830 21710 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:33:07.639772 21710 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:33:07.639894 21710 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:07.640074 21710 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:33:07.640156 21710 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:07.680817 21710 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:46861
I20260809 05:33:07.681031 21902 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:46861 every 8 connection(s)
I20260809 05:33:07.682633 21710 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:33:07.684597 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 21710
I20260809 05:33:07.684865 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance
I20260809 05:33:07.685509 27364 external_mini_cluster.cc:1428] Setting key 45e014b43396f067432c8980fe6c654e
Aug 09 05:33:07 dist-test-slave-h3ft krb5kdc[21132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253587, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:33:07.711970 21906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:07.686412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:58409 (local address 127.26.185.62:33277)
0809 05:33:07.687190 (+ 778us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:07.687198 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:07.688714 (+ 1516us) server_negotiation.cc:407] Connection header received
0809 05:33:07.691806 (+ 3092us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:07.691812 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:07.691966 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:07.692119 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:07.694416 (+ 2297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:07.695473 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:07.697619 (+ 2146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:07.698230 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:07.698419 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:07.703671 (+ 5252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:07.703681 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:07.703687 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:07.703744 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:07.707310 (+ 3566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:07.708389 (+ 1079us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:07.708396 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:07.708399 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:07.708597 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:07.709346 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:07.709351 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:07.709353 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:07.709727 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:07.709887 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:07.711200 (+ 1313us) server_negotiation.cc:299] Negotiation successful
0809 05:33:07.711582 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":608,"thread_start_us":339,"threads_started":1}
I20260809 05:33:07.713586 21907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:07.687251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:33277 (local address 127.26.185.3:58409)
0809 05:33:07.688506 (+ 1255us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:07.688572 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:07.691421 (+ 2849us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:07.692480 (+ 1059us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:07.692493 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:07.693288 (+ 795us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:33:07.694156 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:07.694181 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:07.695672 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:07.695677 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:07.697436 (+ 1759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:07.697452 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:07.698548 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:07.698559 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:07.698886 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:07.699837 (+ 951us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:33:07.699874 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:33:07.703332 (+ 3458us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:33:07.707525 (+ 4193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:33:07.707536 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:33:07.707558 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:33:07.708210 (+ 652us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:33:07.708785 (+ 575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:33:07.708791 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:33:07.708794 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:33:07.709175 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:33:07.709953 (+ 778us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:33:07.709963 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:33:07.710520 (+ 557us) client_negotiation.cc:769] Sending connection context
0809 05:33:07.710936 (+ 416us) client_negotiation.cc:240] Negotiation successful
0809 05:33:07.711787 (+ 851us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":809,"thread_start_us":438,"threads_started":1}
I20260809 05:33:07.715792 21904 heartbeater.cc:347] Connected to a master server at 127.26.185.62:33277
I20260809 05:33:07.716367 21904 heartbeater.cc:464] Registering TS with master...
I20260809 05:33:07.717732 21904 heartbeater.cc:511] Master 127.26.185.62:33277 requested a full tablet report, sending...
I20260809 05:33:07.720230 21193 ts_manager.cc:194] Registered new tserver with Master: 74f99f92d820445194457ddbbc850cf5 (127.26.185.3:46861)
I20260809 05:33:07.721311 21193 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.3@KRBTEST.COM'} at 127.26.185.3:58409
I20260809 05:33:07.731580 27364 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 05:33:07.756641 21906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:07.737652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40184 (local address 127.26.185.62:33277)
0809 05:33:07.737921 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:07.737931 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:07.738497 (+ 566us) server_negotiation.cc:407] Connection header received
0809 05:33:07.738849 (+ 352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:07.738858 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:07.738981 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:07.739164 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:07.740928 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:07.741777 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:07.743544 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:07.744033 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:07.744209 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:07.747889 (+ 3680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:07.747900 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:07.747906 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:07.747976 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:07.752543 (+ 4567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:07.753708 (+ 1165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:07.753714 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:07.753717 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:07.753926 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:07.754505 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:07.754511 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:07.754513 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:07.755203 (+ 690us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:07.755475 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:07.755999 (+ 524us) server_negotiation.cc:299] Negotiation successful
0809 05:33:07.756248 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260809 05:33:07.763496 21193 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40184:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 05:33:07.772626 21193 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 05:33:07.820580 21932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:07.793960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:46861 (local address 127.0.0.1:44076)
0809 05:33:07.809273 (+ 15313us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:07.809296 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:07.810069 (+ 773us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:07.810869 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:07.810874 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:07.810902 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:07.811568 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:07.811584 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:07.813770 (+ 2186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:07.813775 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:07.816377 (+ 2602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:07.816394 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:07.819484 (+ 3090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:07.819503 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:07.819726 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:07.819765 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 05:33:07.819866 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 05:33:07.820054 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15174,"mutex_wait_us":32,"thread_start_us":13967,"threads_started":1}
I20260809 05:33:07.820941 21936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:07.790003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52242 (local address 127.26.185.1:35621)
0809 05:33:07.807781 (+ 17778us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:07.807796 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:07.808197 (+ 401us) server_negotiation.cc:407] Connection header received
0809 05:33:07.808839 (+ 642us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:07.808855 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:07.809326 (+ 471us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:07.809607 (+ 281us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:07.810832 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:07.812909 (+ 2077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:07.816804 (+ 3895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:07.818701 (+ 1897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:07.818879 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:07.819242 (+ 363us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:07.820216 (+ 974us) server_negotiation.cc:299] Negotiation successful
0809 05:33:07.820465 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17549,"thread_start_us":17336,"threads_started":1}
I20260809 05:33:07.821564 21929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:07.789814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:35621 (local address 127.0.0.1:52242)
0809 05:33:07.807070 (+ 17256us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:07.807965 (+ 895us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:07.808483 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:07.810069 (+ 1586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:07.810077 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:07.810108 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:07.810499 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:07.810511 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:07.813149 (+ 2638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:07.813158 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:07.816458 (+ 3300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:07.816612 (+ 154us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:07.818980 (+ 2368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:07.818989 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:07.819264 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:07.819343 (+ 79us) client_negotiation.cc:769] Sending connection context
0809 05:33:07.819557 (+ 214us) client_negotiation.cc:240] Negotiation successful
0809 05:33:07.819818 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16723,"mutex_wait_us":6,"thread_start_us":19953,"threads_started":1}
I20260809 05:33:07.821619 21940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:07.794567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44076 (local address 127.26.185.3:46861)
0809 05:33:07.803448 (+ 8881us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:07.803466 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:07.809451 (+ 5985us) server_negotiation.cc:407] Connection header received
0809 05:33:07.810323 (+ 872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:07.810333 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:07.810582 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:07.810821 (+ 239us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:07.811811 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:07.813578 (+ 1767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:07.816667 (+ 3089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:07.818731 (+ 2064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:07.818879 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:07.819250 (+ 371us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:07.820480 (+ 1230us) server_negotiation.cc:299] Negotiation successful
0809 05:33:07.821193 (+ 713us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8530,"thread_start_us":7723,"threads_started":1}
I20260809 05:33:07.822994 21938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:07.789833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:35957 (local address 127.0.0.1:38098)
0809 05:33:07.808291 (+ 18458us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:07.808314 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:07.808479 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:07.810875 (+ 2396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:07.810883 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:07.810934 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:07.811888 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:07.811921 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:07.814021 (+ 2100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:07.814027 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:07.816593 (+ 2566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:07.816611 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:07.821632 (+ 5021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:07.821997 (+ 365us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:07.822236 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:07.822278 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 05:33:07.822367 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 05:33:07.822539 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18309,"mutex_wait_us":363,"thread_start_us":16476,"threads_started":1}
I20260809 05:33:07.823935 21937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:07.790200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38098 (local address 127.26.185.2:35957)
0809 05:33:07.810057 (+ 19857us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:07.810065 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:07.810093 (+ 28us) server_negotiation.cc:407] Connection header received
0809 05:33:07.810239 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:07.810248 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:07.810524 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:07.811365 (+ 841us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:07.812148 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:07.813809 (+ 1661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:07.819374 (+ 5565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:07.821332 (+ 1958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:07.821543 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:07.823315 (+ 1772us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:07.823451 (+ 136us) server_negotiation.cc:299] Negotiation successful
0809 05:33:07.823667 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19617,"thread_start_us":19455,"threads_started":1}
I20260809 05:33:07.826892 21399 tablet_service.cc:1467] Processing CreateTablet for tablet 8ca0424dd38d49d5b859a0e1f36a8afe (DEFAULT_TABLE table=test-table [id=3f599ff053c64c5bad57d2141f117774]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:33:07.826892 21804 tablet_service.cc:1467] Processing CreateTablet for tablet 8ca0424dd38d49d5b859a0e1f36a8afe (DEFAULT_TABLE table=test-table [id=3f599ff053c64c5bad57d2141f117774]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:33:07.827857 21599 tablet_service.cc:1467] Processing CreateTablet for tablet 8ca0424dd38d49d5b859a0e1f36a8afe (DEFAULT_TABLE table=test-table [id=3f599ff053c64c5bad57d2141f117774]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:33:07.828917 21804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ca0424dd38d49d5b859a0e1f36a8afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:07.828927 21399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ca0424dd38d49d5b859a0e1f36a8afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:07.829288 21599 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ca0424dd38d49d5b859a0e1f36a8afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:07.853471 21944 tablet_bootstrap.cc:492] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b: Bootstrap starting.
I20260809 05:33:07.857743 21946 tablet_bootstrap.cc:492] T 8ca0424dd38d49d5b859a0e1f36a8afe P 553035d9fe0e43f68016f1f233b6bfc2: Bootstrap starting.
I20260809 05:33:07.859970 21944 tablet_bootstrap.cc:654] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:07.861822 21945 tablet_bootstrap.cc:492] T 8ca0424dd38d49d5b859a0e1f36a8afe P 74f99f92d820445194457ddbbc850cf5: Bootstrap starting.
I20260809 05:33:07.862250 21944 log.cc:824] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:07.863252 21946 tablet_bootstrap.cc:654] T 8ca0424dd38d49d5b859a0e1f36a8afe P 553035d9fe0e43f68016f1f233b6bfc2: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:07.865104 21946 log.cc:824] T 8ca0424dd38d49d5b859a0e1f36a8afe P 553035d9fe0e43f68016f1f233b6bfc2: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:07.866622 21945 tablet_bootstrap.cc:654] T 8ca0424dd38d49d5b859a0e1f36a8afe P 74f99f92d820445194457ddbbc850cf5: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:07.867755 21944 tablet_bootstrap.cc:492] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b: No bootstrap required, opened a new log
I20260809 05:33:07.868232 21944 ts_tablet_manager.cc:1397] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b: Time spent bootstrapping tablet: real 0.015s user 0.010s sys 0.004s
I20260809 05:33:07.868357 21945 log.cc:824] T 8ca0424dd38d49d5b859a0e1f36a8afe P 74f99f92d820445194457ddbbc850cf5: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:07.869953 21946 tablet_bootstrap.cc:492] T 8ca0424dd38d49d5b859a0e1f36a8afe P 553035d9fe0e43f68016f1f233b6bfc2: No bootstrap required, opened a new log
I20260809 05:33:07.870385 21946 ts_tablet_manager.cc:1397] T 8ca0424dd38d49d5b859a0e1f36a8afe P 553035d9fe0e43f68016f1f233b6bfc2: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.005s
I20260809 05:33:07.873100 21945 tablet_bootstrap.cc:492] T 8ca0424dd38d49d5b859a0e1f36a8afe P 74f99f92d820445194457ddbbc850cf5: No bootstrap required, opened a new log
I20260809 05:33:07.873528 21945 ts_tablet_manager.cc:1397] T 8ca0424dd38d49d5b859a0e1f36a8afe P 74f99f92d820445194457ddbbc850cf5: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260809 05:33:07.881911 21944 raft_consensus.cc:348] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "553035d9fe0e43f68016f1f233b6bfc2" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 35621 } } peers { permanent_uuid: "a9772514a22549ea9a2a3ff02eccbf9b" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 35957 } } peers { permanent_uuid: "74f99f92d820445194457ddbbc850cf5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46861 } }
I20260809 05:33:07.882779 21944 raft_consensus.cc:374] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:07.882937 21944 raft_consensus.cc:729] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9772514a22549ea9a2a3ff02eccbf9b, State: Initialized, Role: FOLLOWER
I20260809 05:33:07.883807 21946 raft_consensus.cc:348] T 8ca0424dd38d49d5b859a0e1f36a8afe P 553035d9fe0e43f68016f1f233b6bfc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "553035d9fe0e43f68016f1f233b6bfc2" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 35621 } } peers { permanent_uuid: "a9772514a22549ea9a2a3ff02eccbf9b" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 35957 } } peers { permanent_uuid: "74f99f92d820445194457ddbbc850cf5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46861 } }
I20260809 05:33:07.884047 21944 consensus_queue.cc:260] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "553035d9fe0e43f68016f1f233b6bfc2" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 35621 } } peers { permanent_uuid: "a9772514a22549ea9a2a3ff02eccbf9b" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 35957 } } peers { permanent_uuid: "74f99f92d820445194457ddbbc850cf5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46861 } }
I20260809 05:33:07.884475 21946 raft_consensus.cc:374] T 8ca0424dd38d49d5b859a0e1f36a8afe P 553035d9fe0e43f68016f1f233b6bfc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:07.884658 21946 raft_consensus.cc:729] T 8ca0424dd38d49d5b859a0e1f36a8afe P 553035d9fe0e43f68016f1f233b6bfc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 553035d9fe0e43f68016f1f233b6bfc2, State: Initialized, Role: FOLLOWER
I20260809 05:33:07.885732 21946 consensus_queue.cc:260] T 8ca0424dd38d49d5b859a0e1f36a8afe P 553035d9fe0e43f68016f1f233b6bfc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "553035d9fe0e43f68016f1f233b6bfc2" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 35621 } } peers { permanent_uuid: "a9772514a22549ea9a2a3ff02eccbf9b" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 35957 } } peers { permanent_uuid: "74f99f92d820445194457ddbbc850cf5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46861 } }
I20260809 05:33:07.886449 21945 raft_consensus.cc:348] T 8ca0424dd38d49d5b859a0e1f36a8afe P 74f99f92d820445194457ddbbc850cf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "553035d9fe0e43f68016f1f233b6bfc2" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 35621 } } peers { permanent_uuid: "a9772514a22549ea9a2a3ff02eccbf9b" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 35957 } } peers { permanent_uuid: "74f99f92d820445194457ddbbc850cf5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46861 } }
I20260809 05:33:07.887106 21945 raft_consensus.cc:374] T 8ca0424dd38d49d5b859a0e1f36a8afe P 74f99f92d820445194457ddbbc850cf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:07.887305 21945 raft_consensus.cc:729] T 8ca0424dd38d49d5b859a0e1f36a8afe P 74f99f92d820445194457ddbbc850cf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74f99f92d820445194457ddbbc850cf5, State: Initialized, Role: FOLLOWER
I20260809 05:33:07.888273 21945 consensus_queue.cc:260] T 8ca0424dd38d49d5b859a0e1f36a8afe P 74f99f92d820445194457ddbbc850cf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "553035d9fe0e43f68016f1f233b6bfc2" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 35621 } } peers { permanent_uuid: "a9772514a22549ea9a2a3ff02eccbf9b" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 35957 } } peers { permanent_uuid: "74f99f92d820445194457ddbbc850cf5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46861 } }
I20260809 05:33:07.888775 21697 heartbeater.cc:503] Master 127.26.185.62:33277 was elected leader, sending a full tablet report...
I20260809 05:33:07.890612 21945 ts_tablet_manager.cc:1428] T 8ca0424dd38d49d5b859a0e1f36a8afe P 74f99f92d820445194457ddbbc850cf5: Time spent starting tablet: real 0.017s user 0.011s sys 0.004s
I20260809 05:33:07.891427 21944 ts_tablet_manager.cc:1428] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b: Time spent starting tablet: real 0.023s user 0.017s sys 0.004s
I20260809 05:33:07.892760 21904 heartbeater.cc:503] Master 127.26.185.62:33277 was elected leader, sending a full tablet report...
I20260809 05:33:07.893477 21946 ts_tablet_manager.cc:1428] T 8ca0424dd38d49d5b859a0e1f36a8afe P 553035d9fe0e43f68016f1f233b6bfc2: Time spent starting tablet: real 0.023s user 0.012s sys 0.006s
W20260809 05:33:07.934973 21905 tablet.cc:2369] T 8ca0424dd38d49d5b859a0e1f36a8afe P 74f99f92d820445194457ddbbc850cf5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 05:33:07.992830 21701 tablet.cc:2369] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 05:33:08.031240 21499 tablet.cc:2369] T 8ca0424dd38d49d5b859a0e1f36a8afe P 553035d9fe0e43f68016f1f233b6bfc2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:33:08.239920 21951 raft_consensus.cc:482] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:33:08.240545 21951 raft_consensus.cc:504] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "553035d9fe0e43f68016f1f233b6bfc2" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 35621 } } peers { permanent_uuid: "a9772514a22549ea9a2a3ff02eccbf9b" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 35957 } } peers { permanent_uuid: "74f99f92d820445194457ddbbc850cf5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46861 } }
I20260809 05:33:08.243621 21951 leader_election.cc:288] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 553035d9fe0e43f68016f1f233b6bfc2 (127.26.185.1:35621), 74f99f92d820445194457ddbbc850cf5 (127.26.185.3:46861)
I20260809 05:33:08.251636 21953 raft_consensus.cc:482] T 8ca0424dd38d49d5b859a0e1f36a8afe P 553035d9fe0e43f68016f1f233b6bfc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:33:08.252174 21953 raft_consensus.cc:504] T 8ca0424dd38d49d5b859a0e1f36a8afe P 553035d9fe0e43f68016f1f233b6bfc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "553035d9fe0e43f68016f1f233b6bfc2" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 35621 } } peers { permanent_uuid: "a9772514a22549ea9a2a3ff02eccbf9b" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 35957 } } peers { permanent_uuid: "74f99f92d820445194457ddbbc850cf5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46861 } }
I20260809 05:33:08.255728 21936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:08.244317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:55121 (local address 127.26.185.1:35621)
0809 05:33:08.244752 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:08.244762 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:08.246139 (+ 1377us) server_negotiation.cc:407] Connection header received
0809 05:33:08.246436 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:08.246454 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:08.246538 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:08.246647 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:08.247465 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.248973 (+ 1508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.252271 (+ 3298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.253995 (+ 1724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.254193 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:08.254286 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:08.255164 (+ 878us) server_negotiation.cc:299] Negotiation successful
0809 05:33:08.255358 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131}
I20260809 05:33:08.259423 21953 leader_election.cc:288] T 8ca0424dd38d49d5b859a0e1f36a8afe P 553035d9fe0e43f68016f1f233b6bfc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9772514a22549ea9a2a3ff02eccbf9b (127.26.185.2:35957), 74f99f92d820445194457ddbbc850cf5 (127.26.185.3:46861)
I20260809 05:33:08.264032 21955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:08.245163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:35621 (local address 127.26.185.2:55121)
0809 05:33:08.245996 (+ 833us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:08.246018 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:08.246257 (+ 239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:08.246671 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:08.246677 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:08.246710 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:08.247208 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:08.247224 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.249230 (+ 2006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.249237 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:08.252029 (+ 2792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:08.252049 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.254601 (+ 2552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.254610 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:08.254872 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:08.254918 (+ 46us) client_negotiation.cc:769] Sending connection context
0809 05:33:08.256037 (+ 1119us) client_negotiation.cc:240] Negotiation successful
0809 05:33:08.256269 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":690,"thread_start_us":725,"threads_started":1}
I20260809 05:33:08.266927 21954 raft_consensus.cc:482] T 8ca0424dd38d49d5b859a0e1f36a8afe P 74f99f92d820445194457ddbbc850cf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:33:08.267441 21954 raft_consensus.cc:504] T 8ca0424dd38d49d5b859a0e1f36a8afe P 74f99f92d820445194457ddbbc850cf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "553035d9fe0e43f68016f1f233b6bfc2" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 35621 } } peers { permanent_uuid: "a9772514a22549ea9a2a3ff02eccbf9b" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 35957 } } peers { permanent_uuid: "74f99f92d820445194457ddbbc850cf5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46861 } }
I20260809 05:33:08.268047 21940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:08.244137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:54121 (local address 127.26.185.3:46861)
0809 05:33:08.244435 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:08.244445 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:08.257623 (+ 13178us) server_negotiation.cc:407] Connection header received
0809 05:33:08.258423 (+ 800us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:08.258434 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:08.258584 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:08.258672 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:08.259828 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.261400 (+ 1572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.264735 (+ 3335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.266631 (+ 1896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.266802 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:08.266896 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:08.267600 (+ 704us) server_negotiation.cc:299] Negotiation successful
0809 05:33:08.267769 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260809 05:33:08.270311 21426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ca0424dd38d49d5b859a0e1f36a8afe" candidate_uuid: "a9772514a22549ea9a2a3ff02eccbf9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "553035d9fe0e43f68016f1f233b6bfc2" is_pre_election: true
I20260809 05:33:08.271059 21426 raft_consensus.cc:2454] T 8ca0424dd38d49d5b859a0e1f36a8afe P 553035d9fe0e43f68016f1f233b6bfc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9772514a22549ea9a2a3ff02eccbf9b in term 0.
I20260809 05:33:08.271840 21956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:08.245615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:46861 (local address 127.26.185.2:54121)
0809 05:33:08.257428 (+ 11813us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:08.257460 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:08.258170 (+ 710us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:08.258983 (+ 813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:08.259018 (+ 35us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:08.259058 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:08.259563 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:08.259582 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.261683 (+ 2101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.261693 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:08.264438 (+ 2745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:08.264464 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.267178 (+ 2714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.267187 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:08.267367 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:08.267402 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 05:33:08.271111 (+ 3709us) client_negotiation.cc:240] Negotiation successful
0809 05:33:08.271336 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11604,"thread_start_us":12047,"threads_started":1}
I20260809 05:33:08.272492 21954 leader_election.cc:288] T 8ca0424dd38d49d5b859a0e1f36a8afe P 74f99f92d820445194457ddbbc850cf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 553035d9fe0e43f68016f1f233b6bfc2 (127.26.185.1:35621), a9772514a22549ea9a2a3ff02eccbf9b (127.26.185.2:35957)
I20260809 05:33:08.273154 21529 leader_election.cc:302] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 553035d9fe0e43f68016f1f233b6bfc2, a9772514a22549ea9a2a3ff02eccbf9b; no voters:
I20260809 05:33:08.273216 21831 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ca0424dd38d49d5b859a0e1f36a8afe" candidate_uuid: "a9772514a22549ea9a2a3ff02eccbf9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74f99f92d820445194457ddbbc850cf5" is_pre_election: true
I20260809 05:33:08.273716 21951 raft_consensus.cc:2781] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:33:08.273880 21951 raft_consensus.cc:482] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:33:08.273769 21831 raft_consensus.cc:2454] T 8ca0424dd38d49d5b859a0e1f36a8afe P 74f99f92d820445194457ddbbc850cf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9772514a22549ea9a2a3ff02eccbf9b in term 0.
I20260809 05:33:08.273975 21951 raft_consensus.cc:3037] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:08.277390 21940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:08.256300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:38009 (local address 127.26.185.3:46861)
0809 05:33:08.268306 (+ 12006us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:08.268311 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:08.268332 (+ 21us) server_negotiation.cc:407] Connection header received
0809 05:33:08.268392 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:08.268396 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:08.268479 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:08.268618 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:08.269766 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.270915 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.274718 (+ 3803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.276036 (+ 1318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.276175 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:08.276259 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:08.276941 (+ 682us) server_negotiation.cc:299] Negotiation successful
0809 05:33:08.277089 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11891,"threads_started":1}
I20260809 05:33:08.277922 21951 raft_consensus.cc:504] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "553035d9fe0e43f68016f1f233b6bfc2" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 35621 } } peers { permanent_uuid: "a9772514a22549ea9a2a3ff02eccbf9b" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 35957 } } peers { permanent_uuid: "74f99f92d820445194457ddbbc850cf5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46861 } }
I20260809 05:33:08.278416 21962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:08.255989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:46861 (local address 127.26.185.1:38009)
0809 05:33:08.265575 (+ 9586us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:08.265605 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:08.265831 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:08.269009 (+ 3178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:08.269015 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:08.269064 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:08.269577 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:08.269596 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.271136 (+ 1540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.271144 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:08.274501 (+ 3357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:08.274536 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.276491 (+ 1955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.276497 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:08.276733 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:08.276772 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 05:33:08.277756 (+ 984us) client_negotiation.cc:240] Negotiation successful
0809 05:33:08.277947 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9376,"thread_start_us":12847,"threads_started":1}
I20260809 05:33:08.279845 21951 leader_election.cc:288] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b [CANDIDATE]: Term 1 election: Requested vote from peers 553035d9fe0e43f68016f1f233b6bfc2 (127.26.185.1:35621), 74f99f92d820445194457ddbbc850cf5 (127.26.185.3:46861)
I20260809 05:33:08.280373 21831 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ca0424dd38d49d5b859a0e1f36a8afe" candidate_uuid: "a9772514a22549ea9a2a3ff02eccbf9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74f99f92d820445194457ddbbc850cf5"
I20260809 05:33:08.280655 21831 raft_consensus.cc:3037] T 8ca0424dd38d49d5b859a0e1f36a8afe P 74f99f92d820445194457ddbbc850cf5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:08.283757 21426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ca0424dd38d49d5b859a0e1f36a8afe" candidate_uuid: "a9772514a22549ea9a2a3ff02eccbf9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "553035d9fe0e43f68016f1f233b6bfc2"
I20260809 05:33:08.284088 21426 raft_consensus.cc:3037] T 8ca0424dd38d49d5b859a0e1f36a8afe P 553035d9fe0e43f68016f1f233b6bfc2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:08.288642 21426 raft_consensus.cc:2454] T 8ca0424dd38d49d5b859a0e1f36a8afe P 553035d9fe0e43f68016f1f233b6bfc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9772514a22549ea9a2a3ff02eccbf9b in term 1.
I20260809 05:33:08.289260 21529 leader_election.cc:302] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 553035d9fe0e43f68016f1f233b6bfc2, a9772514a22549ea9a2a3ff02eccbf9b; no voters:
I20260809 05:33:08.289851 21951 raft_consensus.cc:2781] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:33:08.290297 21831 raft_consensus.cc:2454] T 8ca0424dd38d49d5b859a0e1f36a8afe P 74f99f92d820445194457ddbbc850cf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9772514a22549ea9a2a3ff02eccbf9b in term 1.
I20260809 05:33:08.291525 21937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:08.263147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:37711 (local address 127.26.185.2:35957)
0809 05:33:08.263401 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:08.263408 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:08.269404 (+ 5996us) server_negotiation.cc:407] Connection header received
0809 05:33:08.270189 (+ 785us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:08.270197 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:08.270282 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:08.270406 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:08.271202 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.272497 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.288303 (+ 15806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.289873 (+ 1570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.290048 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:08.290171 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:08.290962 (+ 791us) server_negotiation.cc:299] Negotiation successful
0809 05:33:08.291155 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 05:33:08.292695 21959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:08.256750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:35957 (local address 127.26.185.1:37711)
0809 05:33:08.269230 (+ 12480us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:08.269263 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:08.270014 (+ 751us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:08.270426 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:08.270432 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:08.270467 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:08.270921 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:08.270933 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.282319 (+ 11386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.282325 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:08.285226 (+ 2901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:08.285253 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.290483 (+ 5230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.290492 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:08.290720 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:08.290761 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 05:33:08.292062 (+ 1301us) client_negotiation.cc:240] Negotiation successful
0809 05:33:08.292253 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12290,"thread_start_us":8398,"threads_started":1}
I20260809 05:33:08.293874 21936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:08.280405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:36935 (local address 127.26.185.1:35621)
0809 05:33:08.280596 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:08.280603 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:08.280625 (+ 22us) server_negotiation.cc:407] Connection header received
0809 05:33:08.280699 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:08.280704 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:08.280792 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:08.280902 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:08.285787 (+ 4885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.287242 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.290182 (+ 2940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.292249 (+ 2067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.292460 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:08.292572 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:08.293292 (+ 720us) server_negotiation.cc:299] Negotiation successful
0809 05:33:08.293491 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 05:33:08.293994 21627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ca0424dd38d49d5b859a0e1f36a8afe" candidate_uuid: "553035d9fe0e43f68016f1f233b6bfc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9772514a22549ea9a2a3ff02eccbf9b" is_pre_election: true
I20260809 05:33:08.302541 21965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:08.274959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:60175 (local address 127.26.185.2:35957)
0809 05:33:08.281045 (+ 6086us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:08.281051 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:08.281078 (+ 27us) server_negotiation.cc:407] Connection header received
0809 05:33:08.281144 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:08.281149 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:08.281229 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:08.281339 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:08.283791 (+ 2452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.285064 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.296765 (+ 11701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.298761 (+ 1996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.299283 (+ 522us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:08.299431 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:08.301708 (+ 2277us) server_negotiation.cc:299] Negotiation successful
0809 05:33:08.301949 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5927,"thread_start_us":6146,"threads_started":1}
I20260809 05:33:08.294909 21963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:08.273192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:35621 (local address 127.26.185.3:36935)
0809 05:33:08.279501 (+ 6309us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:08.279535 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:08.279686 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:08.281427 (+ 1741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:08.281432 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:08.281466 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:08.282020 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:08.282037 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.287486 (+ 5449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.287492 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:08.289977 (+ 2485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:08.289995 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.292782 (+ 2787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.292790 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:08.293047 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:08.293107 (+ 60us) client_negotiation.cc:769] Sending connection context
0809 05:33:08.294076 (+ 969us) client_negotiation.cc:240] Negotiation successful
0809 05:33:08.294307 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6145,"mutex_wait_us":30,"thread_start_us":5959,"threads_started":1}
I20260809 05:33:08.305603 21426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ca0424dd38d49d5b859a0e1f36a8afe" candidate_uuid: "74f99f92d820445194457ddbbc850cf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "553035d9fe0e43f68016f1f233b6bfc2" is_pre_election: true
I20260809 05:33:08.306231 21426 raft_consensus.cc:2379] T 8ca0424dd38d49d5b859a0e1f36a8afe P 553035d9fe0e43f68016f1f233b6bfc2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f99f92d820445194457ddbbc850cf5 in current term 1: Already voted for candidate a9772514a22549ea9a2a3ff02eccbf9b in this term.
I20260809 05:33:08.302511 21964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:08.273769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:35957 (local address 127.26.185.3:60175)
0809 05:33:08.280342 (+ 6573us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:08.280365 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:08.280500 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:08.281942 (+ 1442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:08.281947 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:08.281980 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:08.283260 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:08.283279 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.285332 (+ 2053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.285338 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:08.296510 (+ 11172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:08.296545 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.301103 (+ 4558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.301115 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:08.301411 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:08.301475 (+ 64us) client_negotiation.cc:769] Sending connection context
0809 05:33:08.301613 (+ 138us) client_negotiation.cc:240] Negotiation successful
0809 05:33:08.301864 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6424,"mutex_wait_us":478,"thread_start_us":6284,"threads_started":1}
I20260809 05:33:08.303512 21830 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ca0424dd38d49d5b859a0e1f36a8afe" candidate_uuid: "553035d9fe0e43f68016f1f233b6bfc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74f99f92d820445194457ddbbc850cf5" is_pre_election: true
I20260809 05:33:08.306794 21830 raft_consensus.cc:2379] T 8ca0424dd38d49d5b859a0e1f36a8afe P 74f99f92d820445194457ddbbc850cf5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 553035d9fe0e43f68016f1f233b6bfc2 in current term 1: Already voted for candidate a9772514a22549ea9a2a3ff02eccbf9b in this term.
I20260809 05:33:08.307350 21626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ca0424dd38d49d5b859a0e1f36a8afe" candidate_uuid: "74f99f92d820445194457ddbbc850cf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9772514a22549ea9a2a3ff02eccbf9b" is_pre_election: true
I20260809 05:33:08.308549 21737 leader_election.cc:302] T 8ca0424dd38d49d5b859a0e1f36a8afe P 74f99f92d820445194457ddbbc850cf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f99f92d820445194457ddbbc850cf5; no voters: 553035d9fe0e43f68016f1f233b6bfc2, a9772514a22549ea9a2a3ff02eccbf9b
I20260809 05:33:08.309161 21954 raft_consensus.cc:2726] T 8ca0424dd38d49d5b859a0e1f36a8afe P 74f99f92d820445194457ddbbc850cf5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260809 05:33:08.312528 21951 raft_consensus.cc:686] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b [term 1 LEADER]: Becoming Leader. State: Replica: a9772514a22549ea9a2a3ff02eccbf9b, State: Running, Role: LEADER
I20260809 05:33:08.313333 21951 consensus_queue.cc:237] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "553035d9fe0e43f68016f1f233b6bfc2" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 35621 } } peers { permanent_uuid: "a9772514a22549ea9a2a3ff02eccbf9b" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 35957 } } peers { permanent_uuid: "74f99f92d820445194457ddbbc850cf5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46861 } }
I20260809 05:33:08.320689 21325 leader_election.cc:302] T 8ca0424dd38d49d5b859a0e1f36a8afe P 553035d9fe0e43f68016f1f233b6bfc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 553035d9fe0e43f68016f1f233b6bfc2; no voters: 74f99f92d820445194457ddbbc850cf5, a9772514a22549ea9a2a3ff02eccbf9b
I20260809 05:33:08.321363 21953 raft_consensus.cc:2726] T 8ca0424dd38d49d5b859a0e1f36a8afe P 553035d9fe0e43f68016f1f233b6bfc2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260809 05:33:08.321909 21191 catalog_manager.cc:5495] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b reported cstate change: term changed from 0 to 1, leader changed from <none> to a9772514a22549ea9a2a3ff02eccbf9b (127.26.185.2). New cstate: current_term: 1 leader_uuid: "a9772514a22549ea9a2a3ff02eccbf9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "553035d9fe0e43f68016f1f233b6bfc2" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 35621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9772514a22549ea9a2a3ff02eccbf9b" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 35957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f99f92d820445194457ddbbc850cf5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46861 } health_report { overall_health: UNKNOWN } } }
I20260809 05:33:08.434137 21965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:08.427216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38104 (local address 127.26.185.2:35957)
0809 05:33:08.427485 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:08.427491 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:08.427891 (+ 400us) server_negotiation.cc:407] Connection header received
0809 05:33:08.428109 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:08.428114 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:08.428218 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:08.428394 (+ 176us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:33:08.428802 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.429632 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.431473 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.431932 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.432037 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:08.432622 (+ 585us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:33:08.433327 (+ 705us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:33:08.433524 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:08.433740 (+ 216us) server_negotiation.cc:299] Negotiation successful
0809 05:33:08.433836 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260809 05:33:08.445394 21830 raft_consensus.cc:1261] T 8ca0424dd38d49d5b859a0e1f36a8afe P 74f99f92d820445194457ddbbc850cf5 [term 1 FOLLOWER]: Refusing update from remote peer a9772514a22549ea9a2a3ff02eccbf9b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:33:08.445375 21426 raft_consensus.cc:1261] T 8ca0424dd38d49d5b859a0e1f36a8afe P 553035d9fe0e43f68016f1f233b6bfc2 [term 1 FOLLOWER]: Refusing update from remote peer a9772514a22549ea9a2a3ff02eccbf9b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:33:08.446558 21951 consensus_queue.cc:1035] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f99f92d820445194457ddbbc850cf5" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:33:08.446975 21966 consensus_queue.cc:1035] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "553035d9fe0e43f68016f1f233b6bfc2" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 35621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:33:08.480948 21976 mvcc.cc:205] Tried to move back new op lower bound from 7316494698258014208 to 7316494697736867840. Current Snapshot: MvccSnapshot[applied={T|T < 7316494698258014208}]
I20260809 05:33:08.493628 21192 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40184:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:33:08.493983 21192 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40184:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:33:08.499118 21192 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fbd1ca8cc3be43a6bf3b748e0361370e: Sending DeleteTablet for 3 replicas of tablet 8ca0424dd38d49d5b859a0e1f36a8afe
I20260809 05:33:08.500833 21399 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ca0424dd38d49d5b859a0e1f36a8afe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:33:08 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:52242
I20260809 05:33:08.500829 21599 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ca0424dd38d49d5b859a0e1f36a8afe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:33:08 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:38098
I20260809 05:33:08.501199 21804 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ca0424dd38d49d5b859a0e1f36a8afe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:33:08 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:44076
I20260809 05:33:08.504854 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 21298
I20260809 05:33:08.516353 21990 tablet_replica.cc:330] T 8ca0424dd38d49d5b859a0e1f36a8afe P 553035d9fe0e43f68016f1f233b6bfc2: stopping tablet replica
I20260809 05:33:08.517227 21988 tablet_replica.cc:330] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b: stopping tablet replica
I20260809 05:33:08.517331 21991 tablet_replica.cc:330] T 8ca0424dd38d49d5b859a0e1f36a8afe P 74f99f92d820445194457ddbbc850cf5: stopping tablet replica
I20260809 05:33:08.517911 21988 raft_consensus.cc:2229] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b [term 1 LEADER]: Raft consensus shutting down.
I20260809 05:33:08.517997 21991 raft_consensus.cc:2229] T 8ca0424dd38d49d5b859a0e1f36a8afe P 74f99f92d820445194457ddbbc850cf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:33:08.518774 21991 raft_consensus.cc:2258] T 8ca0424dd38d49d5b859a0e1f36a8afe P 74f99f92d820445194457ddbbc850cf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:33:08.518882 21988 raft_consensus.cc:2258] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:33:08.519747 21990 raft_consensus.cc:2229] T 8ca0424dd38d49d5b859a0e1f36a8afe P 553035d9fe0e43f68016f1f233b6bfc2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:33:08.520475 21990 raft_consensus.cc:2258] T 8ca0424dd38d49d5b859a0e1f36a8afe P 553035d9fe0e43f68016f1f233b6bfc2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:33:08.521791 21991 ts_tablet_manager.cc:1905] T 8ca0424dd38d49d5b859a0e1f36a8afe P 74f99f92d820445194457ddbbc850cf5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:33:08.522895 21990 ts_tablet_manager.cc:1905] T 8ca0424dd38d49d5b859a0e1f36a8afe P 553035d9fe0e43f68016f1f233b6bfc2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:33:08.525053 21988 ts_tablet_manager.cc:1905] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 09 05:33:08 dist-test-slave-h3ft krb5kdc[21132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.1@KRBTEST.COM
I20260809 05:33:08.530820 21991 ts_tablet_manager.cc:1918] T 8ca0424dd38d49d5b859a0e1f36a8afe P 74f99f92d820445194457ddbbc850cf5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:33:08.531100 21991 log.cc:1196] T 8ca0424dd38d49d5b859a0e1f36a8afe P 74f99f92d820445194457ddbbc850cf5: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-2/wal/wals/8ca0424dd38d49d5b859a0e1f36a8afe
I20260809 05:33:08.531800 21991 ts_tablet_manager.cc:1939] T 8ca0424dd38d49d5b859a0e1f36a8afe P 74f99f92d820445194457ddbbc850cf5: Deleting consensus metadata
I20260809 05:33:08.534535 21166 catalog_manager.cc:4841] TS 74f99f92d820445194457ddbbc850cf5 (127.26.185.3:46861): tablet 8ca0424dd38d49d5b859a0e1f36a8afe (table test-table [id=3f599ff053c64c5bad57d2141f117774]) successfully deleted
I20260809 05:33:08.538786 21988 ts_tablet_manager.cc:1918] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:33:08.539072 21988 log.cc:1196] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-1/wal/wals/8ca0424dd38d49d5b859a0e1f36a8afe
I20260809 05:33:08.539822 21988 ts_tablet_manager.cc:1939] T 8ca0424dd38d49d5b859a0e1f36a8afe P a9772514a22549ea9a2a3ff02eccbf9b: Deleting consensus metadata
I20260809 05:33:08.540153 21990 ts_tablet_manager.cc:1918] T 8ca0424dd38d49d5b859a0e1f36a8afe P 553035d9fe0e43f68016f1f233b6bfc2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:33:08.540380 21990 log.cc:1196] T 8ca0424dd38d49d5b859a0e1f36a8afe P 553035d9fe0e43f68016f1f233b6bfc2: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786253234117492-27364-0/minicluster-data/ts-0/wal/wals/8ca0424dd38d49d5b859a0e1f36a8afe
I20260809 05:33:08.541234 21990 ts_tablet_manager.cc:1939] T 8ca0424dd38d49d5b859a0e1f36a8afe P 553035d9fe0e43f68016f1f233b6bfc2: Deleting consensus metadata
I20260809 05:33:08.541728 21936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:08.508629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52246 (local address 127.26.185.1:35621)
0809 05:33:08.508863 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:08.508870 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:08.512486 (+ 3616us) server_negotiation.cc:407] Connection header received
0809 05:33:08.512844 (+ 358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:08.512851 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:08.512969 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:08.513099 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:08.518750 (+ 5651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.520222 (+ 1472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.522749 (+ 2527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.523474 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.523613 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:08.530761 (+ 7148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:08.530788 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:08.530815 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:08.530875 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:08.536256 (+ 5381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:08.537532 (+ 1276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:08.537549 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:08.537554 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:08.537785 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:08.538389 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:08.538396 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:08.538399 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:08.539257 (+ 858us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:08.539671 (+ 414us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:08.540668 (+ 997us) server_negotiation.cc:299] Negotiation successful
0809 05:33:08.541154 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 05:33:08.542557 21173 catalog_manager.cc:4841] TS a9772514a22549ea9a2a3ff02eccbf9b (127.26.185.2:35957): tablet 8ca0424dd38d49d5b859a0e1f36a8afe (table test-table [id=3f599ff053c64c5bad57d2141f117774]) successfully deleted
I20260809 05:33:08.543888 21165 catalog_manager.cc:4841] TS 553035d9fe0e43f68016f1f233b6bfc2 (127.26.185.1:35621): tablet 8ca0424dd38d49d5b859a0e1f36a8afe (table test-table [id=3f599ff053c64c5bad57d2141f117774]) successfully deleted
I20260809 05:33:08.544098 21489 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:33:08.650787 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 21298
I20260809 05:33:08.686296 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 21507
Aug 09 05:33:08 dist-test-slave-h3ft krb5kdc[21132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.2@KRBTEST.COM
I20260809 05:33:08.712695 21965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:08.687364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50712 (local address 127.26.185.2:35957)
0809 05:33:08.687605 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:08.687614 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:08.687960 (+ 346us) server_negotiation.cc:407] Connection header received
0809 05:33:08.688201 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:08.688210 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:08.688355 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:08.688480 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:08.690609 (+ 2129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.692268 (+ 1659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.694586 (+ 2318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.695361 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.695508 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:08.702449 (+ 6941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:08.702468 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:08.702497 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:08.702580 (+ 83us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:08.707474 (+ 4894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:08.708663 (+ 1189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:08.708676 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:08.708681 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:08.708891 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:08.709465 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:08.709470 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:08.709474 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:08.710074 (+ 600us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:08.710437 (+ 363us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:08.711262 (+ 825us) server_negotiation.cc:299] Negotiation successful
0809 05:33:08.711557 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 05:33:08.713691 21689 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:33:08.855154 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 21507
I20260809 05:33:08.890899 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 21710
Aug 09 05:33:08 dist-test-slave-h3ft krb5kdc[21132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.3@KRBTEST.COM
I20260809 05:33:08.912204 21996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:08.892056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55024 (local address 127.26.185.3:46861)
0809 05:33:08.892704 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:08.892709 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:08.892729 (+ 20us) server_negotiation.cc:407] Connection header received
0809 05:33:08.892802 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:08.892806 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:08.892880 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:08.893007 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:08.894751 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.895882 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.897474 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:08.898066 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:08.898207 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:08.904004 (+ 5797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:08.904031 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:08.904056 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:08.904119 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:08.908195 (+ 4076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:08.909219 (+ 1024us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:08.909231 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:08.909233 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:08.909434 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:08.909954 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:08.909959 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:08.909961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:08.910459 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:08.910912 (+ 453us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:08.911403 (+ 491us) server_negotiation.cc:299] Negotiation successful
0809 05:33:08.911741 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":392,"threads_started":1}
I20260809 05:33:08.913187 21894 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:33:09.019616 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 21710
I20260809 05:33:09.049894 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 21147
I20260809 05:33:09.051678 21239 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:33:09.183372 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 21147
2026-08-09T05:33:09Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (6183 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-09T05:33:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:33:09Z Disabled control of system clock
I20260809 05:33:09.314200 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:41087
--webserver_interface=127.26.185.62
--webserver_port=0
--builtin_ntp_servers=127.26.185.20:42799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:41087
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 05:33:09.751067 22005 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:09.751505 22005 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:09.751601 22005 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:09.761586 22005 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:33:09.761756 22005 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:09.761798 22005 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:09.761865 22005 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:33:09.761915 22005 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:33:09.772811 22005 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:42799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:41087
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:41087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:09.774638 22005 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:09.777073 22005 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:09.791671 22012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:09.791560 22016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:09.791638 22013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:09.792760 22005 server_base.cc:1034] running on GCE node
I20260809 05:33:09.793889 22005 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:09.795849 22005 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:09.797119 22005 hybrid_clock.cc:648] HybridClock initialized: now 1786253589797042 us; error 55 us; skew 500 ppm
I20260809 05:33:09.797528 22005 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 05:33:09.800328 22005 webserver.cc:460] Webserver started at http://127.26.185.62:42913/ using document root <none> and password file <none>
I20260809 05:33:09.801229 22005 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:09.801383 22005 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:09.801808 22005 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:09.805536 22005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "9f947915495942d4ae71d52cc2f3350a"
format_stamp: "Formatted at 2026-08-09 05:33:09 on dist-test-slave-h3ft"
server_key: "93ffc578dc7a3909f6d2c4fcf6593883"
server_key_iv: "dac4a040b4796a961f421f0c4c1d130a"
server_key_version: "encryptionkey@0"
I20260809 05:33:09.806612 22005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "9f947915495942d4ae71d52cc2f3350a"
format_stamp: "Formatted at 2026-08-09 05:33:09 on dist-test-slave-h3ft"
server_key: "93ffc578dc7a3909f6d2c4fcf6593883"
server_key_iv: "dac4a040b4796a961f421f0c4c1d130a"
server_key_version: "encryptionkey@0"
I20260809 05:33:09.813297 22005 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260809 05:33:09.818087 22026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:09.820088 22005 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260809 05:33:09.820358 22005 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "9f947915495942d4ae71d52cc2f3350a"
format_stamp: "Formatted at 2026-08-09 05:33:09 on dist-test-slave-h3ft"
server_key: "93ffc578dc7a3909f6d2c4fcf6593883"
server_key_iv: "dac4a040b4796a961f421f0c4c1d130a"
server_key_version: "encryptionkey@0"
I20260809 05:33:09.820701 22005 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:09.836912 22005 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:09.838074 22005 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:09.838454 22005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:09.861665 22005 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:41087
I20260809 05:33:09.861685 22106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:41087 every 8 connection(s)
I20260809 05:33:09.863592 22005 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:33:09.867983 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 22005
I20260809 05:33:09.868211 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:33:09.868896 27364 external_mini_cluster.cc:1428] Setting key b9d5ef52f6501323dcf8eed6dc7312a9
I20260809 05:33:09.869415 22108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:09.886698 22108 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f947915495942d4ae71d52cc2f3350a: Bootstrap starting.
I20260809 05:33:09.887295 22111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:09.871658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41858 (local address 127.26.185.62:41087)
0809 05:33:09.873081 (+ 1423us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:09.873096 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:09.873159 (+ 63us) server_negotiation.cc:407] Connection header received
0809 05:33:09.875726 (+ 2567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:09.875763 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:09.876423 (+ 660us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:09.876902 (+ 479us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:09.877706 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:09.879340 (+ 1634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:09.881574 (+ 2234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:09.882418 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:09.882588 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:09.884188 (+ 1600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:09.884198 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:09.884224 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:09.884944 (+ 720us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:09.885059 (+ 115us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:09.885085 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:09.885187 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:09.885458 (+ 271us) server_negotiation.cc:299] Negotiation successful
0809 05:33:09.885930 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":845,"thread_start_us":586,"threads_started":1}
I20260809 05:33:09.891327 22108 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9f947915495942d4ae71d52cc2f3350a: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:09.892614 22108 log.cc:824] T 00000000000000000000000000000000 P 9f947915495942d4ae71d52cc2f3350a: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:09.896070 22108 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f947915495942d4ae71d52cc2f3350a: No bootstrap required, opened a new log
I20260809 05:33:09.904505 22108 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9f947915495942d4ae71d52cc2f3350a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f947915495942d4ae71d52cc2f3350a" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 41087 } }
I20260809 05:33:09.905064 22108 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9f947915495942d4ae71d52cc2f3350a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:09.905228 22108 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9f947915495942d4ae71d52cc2f3350a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f947915495942d4ae71d52cc2f3350a, State: Initialized, Role: FOLLOWER
I20260809 05:33:09.906064 22108 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9f947915495942d4ae71d52cc2f3350a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f947915495942d4ae71d52cc2f3350a" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 41087 } }
I20260809 05:33:09.906388 22108 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9f947915495942d4ae71d52cc2f3350a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:33:09.906562 22108 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9f947915495942d4ae71d52cc2f3350a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:33:09.906776 22108 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9f947915495942d4ae71d52cc2f3350a [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:09.909473 22108 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9f947915495942d4ae71d52cc2f3350a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f947915495942d4ae71d52cc2f3350a" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 41087 } }
I20260809 05:33:09.910178 22108 leader_election.cc:302] T 00000000000000000000000000000000 P 9f947915495942d4ae71d52cc2f3350a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9f947915495942d4ae71d52cc2f3350a; no voters:
I20260809 05:33:09.911073 22108 leader_election.cc:288] T 00000000000000000000000000000000 P 9f947915495942d4ae71d52cc2f3350a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:33:09.911337 22113 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9f947915495942d4ae71d52cc2f3350a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:33:09.912261 22113 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9f947915495942d4ae71d52cc2f3350a [term 1 LEADER]: Becoming Leader. State: Replica: 9f947915495942d4ae71d52cc2f3350a, State: Running, Role: LEADER
I20260809 05:33:09.913076 22113 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9f947915495942d4ae71d52cc2f3350a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f947915495942d4ae71d52cc2f3350a" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 41087 } }
I20260809 05:33:09.914239 22108 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9f947915495942d4ae71d52cc2f3350a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:33:09.916839 22116 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f947915495942d4ae71d52cc2f3350a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9f947915495942d4ae71d52cc2f3350a. Latest consensus state: current_term: 1 leader_uuid: "9f947915495942d4ae71d52cc2f3350a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f947915495942d4ae71d52cc2f3350a" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 41087 } } }
I20260809 05:33:09.916868 22115 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f947915495942d4ae71d52cc2f3350a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9f947915495942d4ae71d52cc2f3350a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f947915495942d4ae71d52cc2f3350a" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 41087 } } }
I20260809 05:33:09.917464 22115 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f947915495942d4ae71d52cc2f3350a [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:09.917460 22116 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f947915495942d4ae71d52cc2f3350a [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:09.924430 22119 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:33:09.931943 22119 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:33:09.944141 22119 catalog_manager.cc:1347] Generated new cluster ID: 99d2bb58d56642ae807007f257e072c4
I20260809 05:33:09.944317 22119 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:33:09.964326 22119 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:33:09.966395 22119 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:33:09.977901 22119 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9f947915495942d4ae71d52cc2f3350a: Generated new TSK 0
I20260809 05:33:09.979215 22119 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 05:33:09.992763 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:0
--local_ip_for_outbound_sockets=127.26.185.1
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:41087
--builtin_ntp_servers=127.26.185.20:42799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 05:33:10.435922 22146 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:10.436266 22146 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:10.436363 22146 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:10.444150 22146 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:10.444294 22146 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:10.444418 22146 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:33:10.455231 22146 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:42799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:41087
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:10.456919 22146 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:10.459149 22146 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:10.474076 22156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:10.474373 22158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:10.474670 22161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:10.475567 22146 server_base.cc:1034] running on GCE node
I20260809 05:33:10.476320 22146 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:10.477587 22146 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:10.478849 22146 hybrid_clock.cc:648] HybridClock initialized: now 1786253590478800 us; error 64 us; skew 500 ppm
I20260809 05:33:10.479332 22146 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 05:33:10.487674 22146 webserver.cc:460] Webserver started at http://127.26.185.1:39329/ using document root <none> and password file <none>
I20260809 05:33:10.488639 22146 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:10.488796 22146 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:10.489215 22146 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:10.493013 22146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-0/data/instance:
uuid: "1a14da4722614e49b1b529df51c127a2"
format_stamp: "Formatted at 2026-08-09 05:33:10 on dist-test-slave-h3ft"
server_key: "ff5db13b37c49a0f1b48dab6401dee22"
server_key_iv: "999738b4522486fc0a422777862add16"
server_key_version: "encryptionkey@0"
I20260809 05:33:10.494045 22146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance:
uuid: "1a14da4722614e49b1b529df51c127a2"
format_stamp: "Formatted at 2026-08-09 05:33:10 on dist-test-slave-h3ft"
server_key: "ff5db13b37c49a0f1b48dab6401dee22"
server_key_iv: "999738b4522486fc0a422777862add16"
server_key_version: "encryptionkey@0"
I20260809 05:33:10.500867 22146 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260809 05:33:10.505662 22170 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:10.507846 22146 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260809 05:33:10.508122 22146 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "1a14da4722614e49b1b529df51c127a2"
format_stamp: "Formatted at 2026-08-09 05:33:10 on dist-test-slave-h3ft"
server_key: "ff5db13b37c49a0f1b48dab6401dee22"
server_key_iv: "999738b4522486fc0a422777862add16"
server_key_version: "encryptionkey@0"
I20260809 05:33:10.508433 22146 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:10.534896 22146 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:10.536207 22146 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:10.536633 22146 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:10.537977 22146 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:33:10.540042 22146 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:33:10.540189 22146 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:10.540337 22146 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:33:10.540453 22146 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:10.579818 22146 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:46233
I20260809 05:33:10.579887 22345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:46233 every 8 connection(s)
I20260809 05:33:10.581509 22146 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:33:10.588349 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 22146
I20260809 05:33:10.588577 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance
I20260809 05:33:10.589289 27364 external_mini_cluster.cc:1428] Setting key d5779b111deeb0253162f09c6a37c408
I20260809 05:33:10.593361 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:0
--local_ip_for_outbound_sockets=127.26.185.2
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:41087
--builtin_ntp_servers=127.26.185.20:42799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 05:33:10.598585 22349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:10.584786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:53251 (local address 127.26.185.62:41087)
0809 05:33:10.585362 (+ 576us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:10.585367 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:10.586727 (+ 1360us) server_negotiation.cc:407] Connection header received
0809 05:33:10.589416 (+ 2689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:10.589425 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:10.589555 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:10.589699 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:10.591236 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:10.592170 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:10.594849 (+ 2679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:10.595398 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:10.595510 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:10.597646 (+ 2136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:10.597651 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:10.597655 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:10.597679 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:10.597736 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:10.597749 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:10.597831 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:10.598146 (+ 315us) server_negotiation.cc:299] Negotiation successful
0809 05:33:10.598253 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":321,"threads_started":1}
I20260809 05:33:10.600399 22351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:10.585342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:41087 (local address 127.26.185.1:53251)
0809 05:33:10.586534 (+ 1192us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:10.586592 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:10.588980 (+ 2388us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:10.590031 (+ 1051us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:10.590049 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:10.590158 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:33:10.590998 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:10.591050 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:10.592358 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:10.592364 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:10.594684 (+ 2320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:10.594706 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:10.595685 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:10.595696 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:10.596098 (+ 402us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:10.597164 (+ 1066us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 05:33:10.597170 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:33:10.597242 (+ 72us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 05:33:10.597392 (+ 150us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:33:10.597860 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:33:10.597874 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:33:10.597887 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 05:33:10.598120 (+ 233us) client_negotiation.cc:240] Negotiation successful
0809 05:33:10.598674 (+ 554us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":310,"threads_started":1}
I20260809 05:33:10.602329 22346 heartbeater.cc:347] Connected to a master server at 127.26.185.62:41087
I20260809 05:33:10.602748 22346 heartbeater.cc:464] Registering TS with master...
I20260809 05:33:10.604013 22346 heartbeater.cc:511] Master 127.26.185.62:41087 requested a full tablet report, sending...
I20260809 05:33:10.606730 22055 ts_manager.cc:194] Registered new tserver with Master: 1a14da4722614e49b1b529df51c127a2 (127.26.185.1:46233)
I20260809 05:33:10.608549 22055 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.185.1:53251
W20260809 05:33:11.030069 22352 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:11.030452 22352 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:11.030607 22352 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:11.038870 22352 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:11.039072 22352 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:11.039287 22352 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:33:11.049737 22352 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:42799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:41087
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:11.051649 22352 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:11.053999 22352 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:11.069940 22361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:11.069860 22366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:11.069839 22362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:11.071424 22352 server_base.cc:1034] running on GCE node
I20260809 05:33:11.072219 22352 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:11.073550 22352 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:11.074806 22352 hybrid_clock.cc:648] HybridClock initialized: now 1786253591074720 us; error 82 us; skew 500 ppm
I20260809 05:33:11.075268 22352 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 05:33:11.078150 22352 webserver.cc:460] Webserver started at http://127.26.185.2:41041/ using document root <none> and password file <none>
I20260809 05:33:11.079140 22352 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:11.079288 22352 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:11.079677 22352 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:11.083500 22352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-1/data/instance:
uuid: "d6f525fb0e8a49888c2944c04679e10c"
format_stamp: "Formatted at 2026-08-09 05:33:11 on dist-test-slave-h3ft"
server_key: "971f43267e1c7c4541f8096c06d6309c"
server_key_iv: "a04c0fbaafe8a0f889974b45005b2be0"
server_key_version: "encryptionkey@0"
I20260809 05:33:11.084571 22352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance:
uuid: "d6f525fb0e8a49888c2944c04679e10c"
format_stamp: "Formatted at 2026-08-09 05:33:11 on dist-test-slave-h3ft"
server_key: "971f43267e1c7c4541f8096c06d6309c"
server_key_iv: "a04c0fbaafe8a0f889974b45005b2be0"
server_key_version: "encryptionkey@0"
I20260809 05:33:11.091075 22352 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260809 05:33:11.095532 22375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:11.097383 22352 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260809 05:33:11.097632 22352 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "d6f525fb0e8a49888c2944c04679e10c"
format_stamp: "Formatted at 2026-08-09 05:33:11 on dist-test-slave-h3ft"
server_key: "971f43267e1c7c4541f8096c06d6309c"
server_key_iv: "a04c0fbaafe8a0f889974b45005b2be0"
server_key_version: "encryptionkey@0"
I20260809 05:33:11.097923 22352 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:11.126374 22352 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:11.127600 22352 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:11.127941 22352 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:11.129179 22352 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:33:11.131146 22352 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:33:11.131254 22352 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:11.131345 22352 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:33:11.131409 22352 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:11.170298 22352 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:41007
I20260809 05:33:11.170359 22561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:41007 every 8 connection(s)
I20260809 05:33:11.172039 22352 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:33:11.173184 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 22352
I20260809 05:33:11.173422 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance
I20260809 05:33:11.174122 27364 external_mini_cluster.cc:1428] Setting key bd35690c5436566f6bd223462cfc1ab6
I20260809 05:33:11.178704 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:0
--local_ip_for_outbound_sockets=127.26.185.3
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:41087
--builtin_ntp_servers=127.26.185.20:42799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 05:33:11.188637 22570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:11.175849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:41647 (local address 127.26.185.62:41087)
0809 05:33:11.176485 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:11.176489 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:11.178240 (+ 1751us) server_negotiation.cc:407] Connection header received
0809 05:33:11.180566 (+ 2326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:11.180572 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:11.180702 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:11.180844 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:11.182253 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:11.183185 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:11.185096 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:11.185540 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:11.185683 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:11.187450 (+ 1767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:11.187456 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:11.187459 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:11.187481 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:11.187533 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:11.187546 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:11.187649 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:11.187964 (+ 315us) server_negotiation.cc:299] Negotiation successful
0809 05:33:11.188104 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":510,"thread_start_us":352,"threads_started":1}
I20260809 05:33:11.189757 22577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:11.176809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:41087 (local address 127.26.185.2:41647)
0809 05:33:11.178041 (+ 1232us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:11.178097 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:11.180209 (+ 2112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:11.181148 (+ 939us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:11.181160 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:11.181288 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:33:11.182046 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:11.182068 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:11.183372 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:11.183377 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:11.184944 (+ 1567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:11.184958 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:11.185804 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:11.185811 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:11.186074 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:11.186993 (+ 919us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 05:33:11.186996 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:33:11.187108 (+ 112us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 05:33:11.187229 (+ 121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:33:11.187646 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:33:11.187659 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:33:11.187670 (+ 11us) client_negotiation.cc:769] Sending connection context
0809 05:33:11.187902 (+ 232us) client_negotiation.cc:240] Negotiation successful
0809 05:33:11.188338 (+ 436us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":664,"thread_start_us":396,"threads_started":1}
I20260809 05:33:11.191685 22565 heartbeater.cc:347] Connected to a master server at 127.26.185.62:41087
I20260809 05:33:11.192088 22565 heartbeater.cc:464] Registering TS with master...
I20260809 05:33:11.193109 22565 heartbeater.cc:511] Master 127.26.185.62:41087 requested a full tablet report, sending...
I20260809 05:33:11.195108 22055 ts_manager.cc:194] Registered new tserver with Master: d6f525fb0e8a49888c2944c04679e10c (127.26.185.2:41007)
I20260809 05:33:11.196070 22055 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.185.2:41647
W20260809 05:33:11.601518 22578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:11.601941 22578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:11.602115 22578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:11.610527 22578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:11.610672 22578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:11.610877 22578 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:33:11.612504 22346 heartbeater.cc:503] Master 127.26.185.62:41087 was elected leader, sending a full tablet report...
I20260809 05:33:11.621513 22578 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:42799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:41087
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:11.623436 22578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:11.625958 22578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:11.642818 22590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:11.643236 22594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:11.642875 22589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:11.644379 22578 server_base.cc:1034] running on GCE node
I20260809 05:33:11.645323 22578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:11.646741 22578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:11.647997 22578 hybrid_clock.cc:648] HybridClock initialized: now 1786253591647961 us; error 97 us; skew 500 ppm
I20260809 05:33:11.648444 22578 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 05:33:11.651844 22578 webserver.cc:460] Webserver started at http://127.26.185.3:38125/ using document root <none> and password file <none>
I20260809 05:33:11.652822 22578 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:11.652930 22578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:11.653317 22578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:11.657078 22578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-2/data/instance:
uuid: "56a5e6e685c04dfe8971ddd2b2659eb6"
format_stamp: "Formatted at 2026-08-09 05:33:11 on dist-test-slave-h3ft"
server_key: "78f5d43897d5040eb6f9206e10272f04"
server_key_iv: "3254322e69d4ded62cb4a268f1143ccb"
server_key_version: "encryptionkey@0"
I20260809 05:33:11.658131 22578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance:
uuid: "56a5e6e685c04dfe8971ddd2b2659eb6"
format_stamp: "Formatted at 2026-08-09 05:33:11 on dist-test-slave-h3ft"
server_key: "78f5d43897d5040eb6f9206e10272f04"
server_key_iv: "3254322e69d4ded62cb4a268f1143ccb"
server_key_version: "encryptionkey@0"
I20260809 05:33:11.665016 22578 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260809 05:33:11.669754 22600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:11.671916 22578 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260809 05:33:11.672176 22578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "56a5e6e685c04dfe8971ddd2b2659eb6"
format_stamp: "Formatted at 2026-08-09 05:33:11 on dist-test-slave-h3ft"
server_key: "78f5d43897d5040eb6f9206e10272f04"
server_key_iv: "3254322e69d4ded62cb4a268f1143ccb"
server_key_version: "encryptionkey@0"
I20260809 05:33:11.672485 22578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:11.693363 22578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:11.694634 22578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:11.695350 22578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:11.696806 22578 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:33:11.698913 22578 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:33:11.699101 22578 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260809 05:33:11.699265 22578 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:33:11.699378 22578 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:11.743047 22578 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:43365
I20260809 05:33:11.743077 22784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:43365 every 8 connection(s)
I20260809 05:33:11.744922 22578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:33:11.753965 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 22578
I20260809 05:33:11.754237 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance
I20260809 05:33:11.754941 27364 external_mini_cluster.cc:1428] Setting key 52dffe12bdff2e249cd30a443a0d052e
I20260809 05:33:11.761960 22791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:11.748595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:45097 (local address 127.26.185.62:41087)
0809 05:33:11.749219 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:11.749227 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:11.750878 (+ 1651us) server_negotiation.cc:407] Connection header received
0809 05:33:11.753083 (+ 2205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:11.753089 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:11.753194 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:11.753312 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:11.755452 (+ 2140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:11.756540 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:11.758780 (+ 2240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:11.759332 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:11.759453 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:11.761063 (+ 1610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:11.761068 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:11.761071 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:11.761092 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:11.761145 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:11.761158 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:11.761237 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:11.761484 (+ 247us) server_negotiation.cc:299] Negotiation successful
0809 05:33:11.761581 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":274,"threads_started":1}
I20260809 05:33:11.763363 22795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:11.749485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:41087 (local address 127.26.185.3:45097)
0809 05:33:11.750654 (+ 1169us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:11.750700 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:11.752731 (+ 2031us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:11.753788 (+ 1057us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:11.753803 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:11.753983 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:33:11.755192 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:11.755229 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:11.756749 (+ 1520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:11.756754 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:11.758616 (+ 1862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:11.758630 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:11.759593 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:11.759600 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:11.759834 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:11.760676 (+ 842us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 05:33:11.760679 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:33:11.760732 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 05:33:11.760845 (+ 113us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:33:11.761259 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:33:11.761268 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:33:11.761275 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 05:33:11.761467 (+ 192us) client_negotiation.cc:240] Negotiation successful
0809 05:33:11.761856 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":616,"thread_start_us":375,"threads_started":1}
I20260809 05:33:11.764950 22789 heartbeater.cc:347] Connected to a master server at 127.26.185.62:41087
I20260809 05:33:11.765302 22789 heartbeater.cc:464] Registering TS with master...
I20260809 05:33:11.766287 22789 heartbeater.cc:511] Master 127.26.185.62:41087 requested a full tablet report, sending...
I20260809 05:33:11.768661 22055 ts_manager.cc:194] Registered new tserver with Master: 56a5e6e685c04dfe8971ddd2b2659eb6 (127.26.185.3:43365)
I20260809 05:33:11.770073 22055 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.185.3:45097
I20260809 05:33:11.772632 27364 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 05:33:11.784209 22791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:11.777636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41866 (local address 127.26.185.62:41087)
0809 05:33:11.777845 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:11.777852 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:11.778478 (+ 626us) server_negotiation.cc:407] Connection header received
0809 05:33:11.778705 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:11.778710 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:11.778789 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:11.778884 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:11.779574 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:11.780327 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:11.781750 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:11.782189 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:11.782292 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:11.783550 (+ 1258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:11.783556 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:11.783559 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:11.783580 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:11.783622 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:11.783636 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:11.783712 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:11.783836 (+ 124us) server_negotiation.cc:299] Negotiation successful
0809 05:33:11.783928 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 05:33:11.789106 22055 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41866:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 05:33:11.797206 22055 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 05:33:11.827586 22813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:11.813552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:46233 (local address 127.0.0.1:45658)
0809 05:33:11.814952 (+ 1400us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:11.815039 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:11.815331 (+ 292us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:11.819502 (+ 4171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:11.819510 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:11.819542 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:11.820017 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:11.820035 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:11.821781 (+ 1746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:11.821787 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:11.824037 (+ 2250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:11.824050 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:11.826242 (+ 2192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:11.826250 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:11.826532 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:11.826647 (+ 115us) client_negotiation.cc:769] Sending connection context
0809 05:33:11.826805 (+ 158us) client_negotiation.cc:240] Negotiation successful
0809 05:33:11.827118 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":965,"mutex_wait_us":1,"thread_start_us":4614,"threads_started":1}
I20260809 05:33:11.828346 22819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:11.814515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45658 (local address 127.26.185.1:46233)
0809 05:33:11.818583 (+ 4068us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:11.818596 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:11.818647 (+ 51us) server_negotiation.cc:407] Connection header received
0809 05:33:11.818814 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:11.818827 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:11.819207 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:11.819504 (+ 297us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:11.820299 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:11.821622 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:11.824266 (+ 2644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:11.826017 (+ 1751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:11.826156 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:11.826516 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:11.827721 (+ 1205us) server_negotiation.cc:299] Negotiation successful
0809 05:33:11.827942 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3302,"thread_start_us":3016,"threads_started":1}
I20260809 05:33:11.828485 22821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:11.813689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:41007 (local address 127.0.0.1:45776)
0809 05:33:11.816396 (+ 2707us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:11.816418 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:11.816568 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:11.819936 (+ 3368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:11.819946 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:11.819982 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:11.820478 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:11.820492 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:11.822803 (+ 2311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:11.822808 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:11.824572 (+ 1764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:11.824585 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:11.827075 (+ 2490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:11.827082 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:11.827250 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:11.827286 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 05:33:11.827352 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 05:33:11.827484 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2529,"mutex_wait_us":28,"thread_start_us":3053,"threads_started":1}
I20260809 05:33:11.828557 22817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:11.813812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45776 (local address 127.26.185.2:41007)
0809 05:33:11.819225 (+ 5413us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:11.819236 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:11.819271 (+ 35us) server_negotiation.cc:407] Connection header received
0809 05:33:11.819397 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:11.819407 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:11.819673 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:11.820649 (+ 976us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:11.821017 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:11.822624 (+ 1607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:11.824826 (+ 2202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:11.826825 (+ 1999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:11.827595 (+ 770us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:11.827862 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:11.827953 (+ 91us) server_negotiation.cc:299] Negotiation successful
0809 05:33:11.828139 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5224,"thread_start_us":5027,"threads_started":1}
I20260809 05:33:11.830453 22812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:11.815532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:43365 (local address 127.0.0.1:36580)
0809 05:33:11.818491 (+ 2959us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:11.818508 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:11.818633 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:11.819865 (+ 1232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:11.819871 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:11.819902 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:11.820552 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:11.820570 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:11.822803 (+ 2233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:11.822808 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:11.826414 (+ 3606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:11.826430 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:11.828706 (+ 2276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:11.828712 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:11.829784 (+ 1072us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:11.829819 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 05:33:11.829927 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 05:33:11.830073 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2838,"mutex_wait_us":4,"thread_start_us":479,"threads_started":1}
I20260809 05:33:11.830667 22823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:11.815868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36580 (local address 127.26.185.3:43365)
0809 05:33:11.817386 (+ 1518us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:11.817412 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:11.819171 (+ 1759us) server_negotiation.cc:407] Connection header received
0809 05:33:11.819299 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:11.819306 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:11.819561 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:11.819777 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:11.820812 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:11.822624 (+ 1812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:11.826633 (+ 4009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:11.828095 (+ 1462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:11.828230 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:11.828543 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:11.830030 (+ 1487us) server_negotiation.cc:299] Negotiation successful
0809 05:33:11.830220 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1308,"thread_start_us":1147,"threads_started":1}
I20260809 05:33:11.833688 22455 tablet_service.cc:1467] Processing CreateTablet for tablet 8862239d5b4447b9a93942b4d6f09ee0 (DEFAULT_TABLE table=test-table [id=4287a34ab4e3442a8f21aec38073b2fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:33:11.833696 22248 tablet_service.cc:1467] Processing CreateTablet for tablet 8862239d5b4447b9a93942b4d6f09ee0 (DEFAULT_TABLE table=test-table [id=4287a34ab4e3442a8f21aec38073b2fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:33:11.835438 22455 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8862239d5b4447b9a93942b4d6f09ee0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:11.835448 22248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8862239d5b4447b9a93942b4d6f09ee0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:11.834849 22683 tablet_service.cc:1467] Processing CreateTablet for tablet 8862239d5b4447b9a93942b4d6f09ee0 (DEFAULT_TABLE table=test-table [id=4287a34ab4e3442a8f21aec38073b2fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:33:11.836650 22683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8862239d5b4447b9a93942b4d6f09ee0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:11.849779 22824 tablet_bootstrap.cc:492] T 8862239d5b4447b9a93942b4d6f09ee0 P d6f525fb0e8a49888c2944c04679e10c: Bootstrap starting.
I20260809 05:33:11.852449 22825 tablet_bootstrap.cc:492] T 8862239d5b4447b9a93942b4d6f09ee0 P 1a14da4722614e49b1b529df51c127a2: Bootstrap starting.
I20260809 05:33:11.855916 22826 tablet_bootstrap.cc:492] T 8862239d5b4447b9a93942b4d6f09ee0 P 56a5e6e685c04dfe8971ddd2b2659eb6: Bootstrap starting.
I20260809 05:33:11.855976 22824 tablet_bootstrap.cc:654] T 8862239d5b4447b9a93942b4d6f09ee0 P d6f525fb0e8a49888c2944c04679e10c: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:11.856729 22825 tablet_bootstrap.cc:654] T 8862239d5b4447b9a93942b4d6f09ee0 P 1a14da4722614e49b1b529df51c127a2: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:11.857787 22824 log.cc:824] T 8862239d5b4447b9a93942b4d6f09ee0 P d6f525fb0e8a49888c2944c04679e10c: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:11.858139 22825 log.cc:824] T 8862239d5b4447b9a93942b4d6f09ee0 P 1a14da4722614e49b1b529df51c127a2: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:11.859833 22826 tablet_bootstrap.cc:654] T 8862239d5b4447b9a93942b4d6f09ee0 P 56a5e6e685c04dfe8971ddd2b2659eb6: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:11.860949 22826 log.cc:824] T 8862239d5b4447b9a93942b4d6f09ee0 P 56a5e6e685c04dfe8971ddd2b2659eb6: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:11.861850 22825 tablet_bootstrap.cc:492] T 8862239d5b4447b9a93942b4d6f09ee0 P 1a14da4722614e49b1b529df51c127a2: No bootstrap required, opened a new log
I20260809 05:33:11.861858 22824 tablet_bootstrap.cc:492] T 8862239d5b4447b9a93942b4d6f09ee0 P d6f525fb0e8a49888c2944c04679e10c: No bootstrap required, opened a new log
I20260809 05:33:11.862203 22825 ts_tablet_manager.cc:1397] T 8862239d5b4447b9a93942b4d6f09ee0 P 1a14da4722614e49b1b529df51c127a2: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260809 05:33:11.862203 22824 ts_tablet_manager.cc:1397] T 8862239d5b4447b9a93942b4d6f09ee0 P d6f525fb0e8a49888c2944c04679e10c: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.000s
I20260809 05:33:11.874202 22824 raft_consensus.cc:348] T 8862239d5b4447b9a93942b4d6f09ee0 P d6f525fb0e8a49888c2944c04679e10c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f525fb0e8a49888c2944c04679e10c" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 41007 } } peers { permanent_uuid: "1a14da4722614e49b1b529df51c127a2" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 46233 } } peers { permanent_uuid: "56a5e6e685c04dfe8971ddd2b2659eb6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43365 } }
I20260809 05:33:11.875200 22824 raft_consensus.cc:374] T 8862239d5b4447b9a93942b4d6f09ee0 P d6f525fb0e8a49888c2944c04679e10c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:11.875393 22824 raft_consensus.cc:729] T 8862239d5b4447b9a93942b4d6f09ee0 P d6f525fb0e8a49888c2944c04679e10c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6f525fb0e8a49888c2944c04679e10c, State: Initialized, Role: FOLLOWER
I20260809 05:33:11.876220 22825 raft_consensus.cc:348] T 8862239d5b4447b9a93942b4d6f09ee0 P 1a14da4722614e49b1b529df51c127a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f525fb0e8a49888c2944c04679e10c" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 41007 } } peers { permanent_uuid: "1a14da4722614e49b1b529df51c127a2" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 46233 } } peers { permanent_uuid: "56a5e6e685c04dfe8971ddd2b2659eb6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43365 } }
I20260809 05:33:11.876519 22824 consensus_queue.cc:260] T 8862239d5b4447b9a93942b4d6f09ee0 P d6f525fb0e8a49888c2944c04679e10c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f525fb0e8a49888c2944c04679e10c" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 41007 } } peers { permanent_uuid: "1a14da4722614e49b1b529df51c127a2" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 46233 } } peers { permanent_uuid: "56a5e6e685c04dfe8971ddd2b2659eb6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43365 } }
I20260809 05:33:11.876906 22825 raft_consensus.cc:374] T 8862239d5b4447b9a93942b4d6f09ee0 P 1a14da4722614e49b1b529df51c127a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:11.877069 22825 raft_consensus.cc:729] T 8862239d5b4447b9a93942b4d6f09ee0 P 1a14da4722614e49b1b529df51c127a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a14da4722614e49b1b529df51c127a2, State: Initialized, Role: FOLLOWER
I20260809 05:33:11.878345 22825 consensus_queue.cc:260] T 8862239d5b4447b9a93942b4d6f09ee0 P 1a14da4722614e49b1b529df51c127a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f525fb0e8a49888c2944c04679e10c" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 41007 } } peers { permanent_uuid: "1a14da4722614e49b1b529df51c127a2" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 46233 } } peers { permanent_uuid: "56a5e6e685c04dfe8971ddd2b2659eb6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43365 } }
I20260809 05:33:11.884729 22565 heartbeater.cc:503] Master 127.26.185.62:41087 was elected leader, sending a full tablet report...
I20260809 05:33:11.886531 22824 ts_tablet_manager.cc:1428] T 8862239d5b4447b9a93942b4d6f09ee0 P d6f525fb0e8a49888c2944c04679e10c: Time spent starting tablet: real 0.024s user 0.017s sys 0.006s
I20260809 05:33:11.890046 22825 ts_tablet_manager.cc:1428] T 8862239d5b4447b9a93942b4d6f09ee0 P 1a14da4722614e49b1b529df51c127a2: Time spent starting tablet: real 0.028s user 0.018s sys 0.004s
I20260809 05:33:11.894874 22826 tablet_bootstrap.cc:492] T 8862239d5b4447b9a93942b4d6f09ee0 P 56a5e6e685c04dfe8971ddd2b2659eb6: No bootstrap required, opened a new log
I20260809 05:33:11.895340 22826 ts_tablet_manager.cc:1397] T 8862239d5b4447b9a93942b4d6f09ee0 P 56a5e6e685c04dfe8971ddd2b2659eb6: Time spent bootstrapping tablet: real 0.040s user 0.015s sys 0.021s
I20260809 05:33:11.904227 22826 raft_consensus.cc:348] T 8862239d5b4447b9a93942b4d6f09ee0 P 56a5e6e685c04dfe8971ddd2b2659eb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f525fb0e8a49888c2944c04679e10c" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 41007 } } peers { permanent_uuid: "1a14da4722614e49b1b529df51c127a2" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 46233 } } peers { permanent_uuid: "56a5e6e685c04dfe8971ddd2b2659eb6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43365 } }
I20260809 05:33:11.904793 22826 raft_consensus.cc:374] T 8862239d5b4447b9a93942b4d6f09ee0 P 56a5e6e685c04dfe8971ddd2b2659eb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:11.904927 22826 raft_consensus.cc:729] T 8862239d5b4447b9a93942b4d6f09ee0 P 56a5e6e685c04dfe8971ddd2b2659eb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a5e6e685c04dfe8971ddd2b2659eb6, State: Initialized, Role: FOLLOWER
I20260809 05:33:11.905674 22826 consensus_queue.cc:260] T 8862239d5b4447b9a93942b4d6f09ee0 P 56a5e6e685c04dfe8971ddd2b2659eb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f525fb0e8a49888c2944c04679e10c" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 41007 } } peers { permanent_uuid: "1a14da4722614e49b1b529df51c127a2" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 46233 } } peers { permanent_uuid: "56a5e6e685c04dfe8971ddd2b2659eb6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43365 } }
I20260809 05:33:11.907140 22789 heartbeater.cc:503] Master 127.26.185.62:41087 was elected leader, sending a full tablet report...
I20260809 05:33:11.907958 22826 ts_tablet_manager.cc:1428] T 8862239d5b4447b9a93942b4d6f09ee0 P 56a5e6e685c04dfe8971ddd2b2659eb6: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
W20260809 05:33:11.924908 22566 tablet.cc:2369] T 8862239d5b4447b9a93942b4d6f09ee0 P d6f525fb0e8a49888c2944c04679e10c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 05:33:11.997355 22790 tablet.cc:2369] T 8862239d5b4447b9a93942b4d6f09ee0 P 56a5e6e685c04dfe8971ddd2b2659eb6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 05:33:12.084913 22347 tablet.cc:2369] T 8862239d5b4447b9a93942b4d6f09ee0 P 1a14da4722614e49b1b529df51c127a2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:33:12.126559 22836 raft_consensus.cc:482] T 8862239d5b4447b9a93942b4d6f09ee0 P 1a14da4722614e49b1b529df51c127a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:33:12.127035 22836 raft_consensus.cc:504] T 8862239d5b4447b9a93942b4d6f09ee0 P 1a14da4722614e49b1b529df51c127a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f525fb0e8a49888c2944c04679e10c" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 41007 } } peers { permanent_uuid: "1a14da4722614e49b1b529df51c127a2" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 46233 } } peers { permanent_uuid: "56a5e6e685c04dfe8971ddd2b2659eb6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43365 } }
I20260809 05:33:12.129318 22836 leader_election.cc:288] T 8862239d5b4447b9a93942b4d6f09ee0 P 1a14da4722614e49b1b529df51c127a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6f525fb0e8a49888c2944c04679e10c (127.26.185.2:41007), 56a5e6e685c04dfe8971ddd2b2659eb6 (127.26.185.3:43365)
I20260809 05:33:12.140652 22817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:12.129941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:44585 (local address 127.26.185.2:41007)
0809 05:33:12.130232 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:12.130240 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:12.131196 (+ 956us) server_negotiation.cc:407] Connection header received
0809 05:33:12.131442 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:12.131448 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:12.131551 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:12.131670 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:12.132787 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:12.134137 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:12.137925 (+ 3788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:12.139348 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:12.139564 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:12.139654 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:12.140144 (+ 490us) server_negotiation.cc:299] Negotiation successful
0809 05:33:12.140307 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 05:33:12.140657 22823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:12.130256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:40061 (local address 127.26.185.3:43365)
0809 05:33:12.130506 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:12.130515 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:12.131299 (+ 784us) server_negotiation.cc:407] Connection header received
0809 05:33:12.131441 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:12.131446 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:12.131551 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:12.131671 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:12.132803 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:12.134137 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:12.137936 (+ 3799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:12.139359 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:12.139564 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:12.139654 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:12.140144 (+ 490us) server_negotiation.cc:299] Negotiation successful
0809 05:33:12.140306 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 05:33:12.140858 22842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:12.129841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:41007 (local address 127.26.185.1:44585)
0809 05:33:12.130989 (+ 1148us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:12.131046 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:12.131269 (+ 223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:12.131730 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:12.131736 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:12.131771 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:12.132519 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:12.132545 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:12.134331 (+ 1786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:12.134338 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:12.137575 (+ 3237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:12.137602 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:12.139666 (+ 2064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:12.139675 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:12.139903 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:12.139999 (+ 96us) client_negotiation.cc:769] Sending connection context
0809 05:33:12.140084 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 05:33:12.140314 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":967,"mutex_wait_us":332,"thread_start_us":641,"threads_started":1}
I20260809 05:33:12.140812 22844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:12.129855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:43365 (local address 127.26.185.1:40061)
0809 05:33:12.131152 (+ 1297us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:12.131167 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:12.131272 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:12.131729 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:12.131736 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:12.131851 (+ 115us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:12.132551 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:12.132560 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:12.134331 (+ 1771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:12.134338 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:12.137575 (+ 3237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:12.137602 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:12.139681 (+ 2079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:12.139688 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:12.139910 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:12.139947 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 05:33:12.140072 (+ 125us) client_negotiation.cc:240] Negotiation successful
0809 05:33:12.140314 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1159,"mutex_wait_us":662,"spinlock_wait_cycles":35712,"thread_start_us":644,"threads_started":1}
I20260809 05:33:12.142424 22719 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8862239d5b4447b9a93942b4d6f09ee0" candidate_uuid: "1a14da4722614e49b1b529df51c127a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a5e6e685c04dfe8971ddd2b2659eb6" is_pre_election: true
I20260809 05:33:12.142422 22493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8862239d5b4447b9a93942b4d6f09ee0" candidate_uuid: "1a14da4722614e49b1b529df51c127a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6f525fb0e8a49888c2944c04679e10c" is_pre_election: true
I20260809 05:33:12.143154 22493 raft_consensus.cc:2454] T 8862239d5b4447b9a93942b4d6f09ee0 P d6f525fb0e8a49888c2944c04679e10c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a14da4722614e49b1b529df51c127a2 in term 0.
I20260809 05:33:12.143154 22719 raft_consensus.cc:2454] T 8862239d5b4447b9a93942b4d6f09ee0 P 56a5e6e685c04dfe8971ddd2b2659eb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a14da4722614e49b1b529df51c127a2 in term 0.
I20260809 05:33:12.144065 22173 leader_election.cc:302] T 8862239d5b4447b9a93942b4d6f09ee0 P 1a14da4722614e49b1b529df51c127a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1a14da4722614e49b1b529df51c127a2, 56a5e6e685c04dfe8971ddd2b2659eb6, d6f525fb0e8a49888c2944c04679e10c; no voters:
I20260809 05:33:12.144598 22836 raft_consensus.cc:2781] T 8862239d5b4447b9a93942b4d6f09ee0 P 1a14da4722614e49b1b529df51c127a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:33:12.144773 22836 raft_consensus.cc:482] T 8862239d5b4447b9a93942b4d6f09ee0 P 1a14da4722614e49b1b529df51c127a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:33:12.144908 22836 raft_consensus.cc:3037] T 8862239d5b4447b9a93942b4d6f09ee0 P 1a14da4722614e49b1b529df51c127a2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:12.149082 22836 raft_consensus.cc:504] T 8862239d5b4447b9a93942b4d6f09ee0 P 1a14da4722614e49b1b529df51c127a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f525fb0e8a49888c2944c04679e10c" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 41007 } } peers { permanent_uuid: "1a14da4722614e49b1b529df51c127a2" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 46233 } } peers { permanent_uuid: "56a5e6e685c04dfe8971ddd2b2659eb6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43365 } }
I20260809 05:33:12.150038 22836 leader_election.cc:288] T 8862239d5b4447b9a93942b4d6f09ee0 P 1a14da4722614e49b1b529df51c127a2 [CANDIDATE]: Term 1 election: Requested vote from peers d6f525fb0e8a49888c2944c04679e10c (127.26.185.2:41007), 56a5e6e685c04dfe8971ddd2b2659eb6 (127.26.185.3:43365)
I20260809 05:33:12.150687 22493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8862239d5b4447b9a93942b4d6f09ee0" candidate_uuid: "1a14da4722614e49b1b529df51c127a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6f525fb0e8a49888c2944c04679e10c"
I20260809 05:33:12.150975 22493 raft_consensus.cc:3037] T 8862239d5b4447b9a93942b4d6f09ee0 P d6f525fb0e8a49888c2944c04679e10c [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:12.150941 22719 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8862239d5b4447b9a93942b4d6f09ee0" candidate_uuid: "1a14da4722614e49b1b529df51c127a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a5e6e685c04dfe8971ddd2b2659eb6"
I20260809 05:33:12.151309 22719 raft_consensus.cc:3037] T 8862239d5b4447b9a93942b4d6f09ee0 P 56a5e6e685c04dfe8971ddd2b2659eb6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:12.154006 22493 raft_consensus.cc:2454] T 8862239d5b4447b9a93942b4d6f09ee0 P d6f525fb0e8a49888c2944c04679e10c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a14da4722614e49b1b529df51c127a2 in term 1.
I20260809 05:33:12.154592 22719 raft_consensus.cc:2454] T 8862239d5b4447b9a93942b4d6f09ee0 P 56a5e6e685c04dfe8971ddd2b2659eb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a14da4722614e49b1b529df51c127a2 in term 1.
I20260809 05:33:12.154810 22175 leader_election.cc:302] T 8862239d5b4447b9a93942b4d6f09ee0 P 1a14da4722614e49b1b529df51c127a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a14da4722614e49b1b529df51c127a2, d6f525fb0e8a49888c2944c04679e10c; no voters:
I20260809 05:33:12.155380 22836 raft_consensus.cc:2781] T 8862239d5b4447b9a93942b4d6f09ee0 P 1a14da4722614e49b1b529df51c127a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:33:12.156059 22836 raft_consensus.cc:686] T 8862239d5b4447b9a93942b4d6f09ee0 P 1a14da4722614e49b1b529df51c127a2 [term 1 LEADER]: Becoming Leader. State: Replica: 1a14da4722614e49b1b529df51c127a2, State: Running, Role: LEADER
I20260809 05:33:12.156792 22836 consensus_queue.cc:237] T 8862239d5b4447b9a93942b4d6f09ee0 P 1a14da4722614e49b1b529df51c127a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f525fb0e8a49888c2944c04679e10c" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 41007 } } peers { permanent_uuid: "1a14da4722614e49b1b529df51c127a2" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 46233 } } peers { permanent_uuid: "56a5e6e685c04dfe8971ddd2b2659eb6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43365 } }
I20260809 05:33:12.162904 22055 catalog_manager.cc:5495] T 8862239d5b4447b9a93942b4d6f09ee0 P 1a14da4722614e49b1b529df51c127a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a14da4722614e49b1b529df51c127a2 (127.26.185.1). New cstate: current_term: 1 leader_uuid: "1a14da4722614e49b1b529df51c127a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f525fb0e8a49888c2944c04679e10c" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 41007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a14da4722614e49b1b529df51c127a2" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 46233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a5e6e685c04dfe8971ddd2b2659eb6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43365 } health_report { overall_health: UNKNOWN } } }
I20260809 05:33:12.203565 22819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:12.196957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45668 (local address 127.26.185.1:46233)
0809 05:33:12.197199 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:12.197204 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:12.197229 (+ 25us) server_negotiation.cc:407] Connection header received
0809 05:33:12.197355 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:12.197360 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:12.197478 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:12.197647 (+ 169us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:33:12.198132 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:12.198916 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:12.200787 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:12.201259 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:12.201361 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:12.201963 (+ 602us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:33:12.202802 (+ 839us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:33:12.203068 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:12.203122 (+ 54us) server_negotiation.cc:299] Negotiation successful
0809 05:33:12.203206 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260809 05:33:12.215507 22493 raft_consensus.cc:1261] T 8862239d5b4447b9a93942b4d6f09ee0 P d6f525fb0e8a49888c2944c04679e10c [term 1 FOLLOWER]: Refusing update from remote peer 1a14da4722614e49b1b529df51c127a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:33:12.215507 22719 raft_consensus.cc:1261] T 8862239d5b4447b9a93942b4d6f09ee0 P 56a5e6e685c04dfe8971ddd2b2659eb6 [term 1 FOLLOWER]: Refusing update from remote peer 1a14da4722614e49b1b529df51c127a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:33:12.217034 22845 consensus_queue.cc:1035] T 8862239d5b4447b9a93942b4d6f09ee0 P 1a14da4722614e49b1b529df51c127a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a5e6e685c04dfe8971ddd2b2659eb6" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 43365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:33:12.217533 22836 consensus_queue.cc:1035] T 8862239d5b4447b9a93942b4d6f09ee0 P 1a14da4722614e49b1b529df51c127a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6f525fb0e8a49888c2944c04679e10c" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 41007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:33:12.233418 22850 mvcc.cc:205] Tried to move back new op lower bound from 7316494713698328576 to 7316494713479008256. Current Snapshot: MvccSnapshot[applied={T|T < 7316494713698328576}]
I20260809 05:33:12.234189 22851 mvcc.cc:205] Tried to move back new op lower bound from 7316494713698328576 to 7316494713479008256. Current Snapshot: MvccSnapshot[applied={T|T < 7316494713698328576}]
I20260809 05:33:12.251775 22054 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:33:12.252157 22054 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:33:12.257139 22054 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9f947915495942d4ae71d52cc2f3350a: Sending DeleteTablet for 3 replicas of tablet 8862239d5b4447b9a93942b4d6f09ee0
I20260809 05:33:12.258841 22455 tablet_service.cc:1514] Processing DeleteTablet for tablet 8862239d5b4447b9a93942b4d6f09ee0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:33:12 UTC) from {username='slave'} at 127.0.0.1:45776
I20260809 05:33:12.259346 22683 tablet_service.cc:1514] Processing DeleteTablet for tablet 8862239d5b4447b9a93942b4d6f09ee0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:33:12 UTC) from {username='slave'} at 127.0.0.1:36580
I20260809 05:33:12.259939 22248 tablet_service.cc:1514] Processing DeleteTablet for tablet 8862239d5b4447b9a93942b4d6f09ee0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:33:12 UTC) from {username='slave'} at 127.0.0.1:45658
I20260809 05:33:12.260426 22866 tablet_replica.cc:330] T 8862239d5b4447b9a93942b4d6f09ee0 P 56a5e6e685c04dfe8971ddd2b2659eb6: stopping tablet replica
I20260809 05:33:12.260452 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 22146
I20260809 05:33:12.261024 22866 raft_consensus.cc:2229] T 8862239d5b4447b9a93942b4d6f09ee0 P 56a5e6e685c04dfe8971ddd2b2659eb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:33:12.261729 22866 raft_consensus.cc:2258] T 8862239d5b4447b9a93942b4d6f09ee0 P 56a5e6e685c04dfe8971ddd2b2659eb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:33:12.264971 22866 ts_tablet_manager.cc:1905] T 8862239d5b4447b9a93942b4d6f09ee0 P 56a5e6e685c04dfe8971ddd2b2659eb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:33:12.276389 22865 tablet_replica.cc:330] T 8862239d5b4447b9a93942b4d6f09ee0 P d6f525fb0e8a49888c2944c04679e10c: stopping tablet replica
I20260809 05:33:12.276719 22866 ts_tablet_manager.cc:1918] T 8862239d5b4447b9a93942b4d6f09ee0 P 56a5e6e685c04dfe8971ddd2b2659eb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:33:12.276912 22866 log.cc:1196] T 8862239d5b4447b9a93942b4d6f09ee0 P 56a5e6e685c04dfe8971ddd2b2659eb6: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-2/wal/wals/8862239d5b4447b9a93942b4d6f09ee0
I20260809 05:33:12.277184 22865 raft_consensus.cc:2229] T 8862239d5b4447b9a93942b4d6f09ee0 P d6f525fb0e8a49888c2944c04679e10c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:33:12.277442 22868 tablet_replica.cc:330] T 8862239d5b4447b9a93942b4d6f09ee0 P 1a14da4722614e49b1b529df51c127a2: stopping tablet replica
I20260809 05:33:12.277585 22866 ts_tablet_manager.cc:1939] T 8862239d5b4447b9a93942b4d6f09ee0 P 56a5e6e685c04dfe8971ddd2b2659eb6: Deleting consensus metadata
I20260809 05:33:12.277971 22865 raft_consensus.cc:2258] T 8862239d5b4447b9a93942b4d6f09ee0 P d6f525fb0e8a49888c2944c04679e10c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:33:12.278482 22868 raft_consensus.cc:2229] T 8862239d5b4447b9a93942b4d6f09ee0 P 1a14da4722614e49b1b529df51c127a2 [term 1 LEADER]: Raft consensus shutting down.
I20260809 05:33:12.279369 22868 raft_consensus.cc:2258] T 8862239d5b4447b9a93942b4d6f09ee0 P 1a14da4722614e49b1b529df51c127a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:33:12.280290 22032 catalog_manager.cc:4841] TS 56a5e6e685c04dfe8971ddd2b2659eb6 (127.26.185.3:43365): tablet 8862239d5b4447b9a93942b4d6f09ee0 (table test-table [id=4287a34ab4e3442a8f21aec38073b2fb]) successfully deleted
I20260809 05:33:12.282079 22865 ts_tablet_manager.cc:1905] T 8862239d5b4447b9a93942b4d6f09ee0 P d6f525fb0e8a49888c2944c04679e10c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:33:12.284484 22868 ts_tablet_manager.cc:1905] T 8862239d5b4447b9a93942b4d6f09ee0 P 1a14da4722614e49b1b529df51c127a2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:33:12.287398 22819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:12.262846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45678 (local address 127.26.185.1:46233)
0809 05:33:12.263115 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:12.263125 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:12.275665 (+ 12540us) server_negotiation.cc:407] Connection header received
0809 05:33:12.276068 (+ 403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:12.276075 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:12.276745 (+ 670us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:12.276889 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:12.277880 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:12.279277 (+ 1397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:12.281634 (+ 2357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:12.282419 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:12.282580 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:12.284474 (+ 1894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:12.284488 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:12.284512 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:12.285563 (+ 1051us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:12.285646 (+ 83us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:12.285690 (+ 44us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:12.285809 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:12.286698 (+ 889us) server_negotiation.cc:299] Negotiation successful
0809 05:33:12.286851 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 05:33:12.288632 22337 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:33:12.290886 22865 ts_tablet_manager.cc:1918] T 8862239d5b4447b9a93942b4d6f09ee0 P d6f525fb0e8a49888c2944c04679e10c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:33:12.291133 22865 log.cc:1196] T 8862239d5b4447b9a93942b4d6f09ee0 P d6f525fb0e8a49888c2944c04679e10c: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786253234117492-27364-0/minicluster-data/ts-1/wal/wals/8862239d5b4447b9a93942b4d6f09ee0
I20260809 05:33:12.291805 22865 ts_tablet_manager.cc:1939] T 8862239d5b4447b9a93942b4d6f09ee0 P d6f525fb0e8a49888c2944c04679e10c: Deleting consensus metadata
I20260809 05:33:12.294757 22035 catalog_manager.cc:4841] TS d6f525fb0e8a49888c2944c04679e10c (127.26.185.2:41007): tablet 8862239d5b4447b9a93942b4d6f09ee0 (table test-table [id=4287a34ab4e3442a8f21aec38073b2fb]) successfully deleted
I20260809 05:33:12.399904 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 22146
I20260809 05:33:12.435235 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 22352
W20260809 05:33:12.435153 22028 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.185.1:46233 (error 108)
I20260809 05:33:12.437705 22873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:12.436687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:46233 (local address 127.0.0.1:45690)
0809 05:33:12.437265 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:12.437431 (+ 166us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.1:46233: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":317,"threads_started":1}
W20260809 05:33:12.438054 22028 catalog_manager.cc:4584] TS 1a14da4722614e49b1b529df51c127a2 (127.26.185.1:46233): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8862239d5b4447b9a93942b4d6f09ee0: Network error: Client connection negotiation failed: client connection to 127.26.185.1:46233: connect: Connection refused (error 111)
I20260809 05:33:12.444023 22817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:12.436305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45784 (local address 127.26.185.2:41007)
0809 05:33:12.436552 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:12.436560 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:12.436639 (+ 79us) server_negotiation.cc:407] Connection header received
0809 05:33:12.436901 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:12.436909 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:12.437061 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:12.437200 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:12.437722 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:12.438704 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:12.440257 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:12.440730 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:12.440886 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:12.442228 (+ 1342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:12.442241 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:12.442261 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:12.443103 (+ 842us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:12.443169 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:12.443193 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:12.443344 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:12.443475 (+ 131us) server_negotiation.cc:299] Negotiation successful
0809 05:33:12.443626 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260809 05:33:12.444809 22554 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:33:12.492197 22873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:12.491560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:46233 (local address 127.0.0.1:45706)
0809 05:33:12.491848 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:12.491994 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.1:46233: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260809 05:33:12.493597 22873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:12.493127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:46233 (local address 127.0.0.1:45708)
0809 05:33:12.493343 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:12.493426 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.1:46233: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260809 05:33:12.545665 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 22352
I20260809 05:33:12.556013 22873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:12.555431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:46233 (local address 127.0.0.1:45712)
0809 05:33:12.555711 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:12.555818 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.1:46233: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260809 05:33:12.557334 22873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:12.556910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:46233 (local address 127.0.0.1:45728)
0809 05:33:12.557072 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:12.557155 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.1:46233: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260809 05:33:12.577407 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 22578
I20260809 05:33:12.586004 22823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:12.578579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36582 (local address 127.26.185.3:43365)
0809 05:33:12.578794 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:12.578800 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:12.578824 (+ 24us) server_negotiation.cc:407] Connection header received
0809 05:33:12.579121 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:12.579129 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:12.579288 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:12.579388 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:12.579888 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:12.580682 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:12.582100 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:12.582542 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:12.582642 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:12.584208 (+ 1566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:12.584219 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:12.584240 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:12.585055 (+ 815us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:12.585120 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:12.585144 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:12.585242 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:12.585400 (+ 158us) server_negotiation.cc:299] Negotiation successful
0809 05:33:12.585519 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 05:33:12.586803 22778 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:33:12.638756 22873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:12.637997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:46233 (local address 127.0.0.1:45738)
0809 05:33:12.638320 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:12.638487 (+ 167us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.1:46233: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117}
I20260809 05:33:12.640424 22873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:12.639755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:46233 (local address 127.0.0.1:45750)
0809 05:33:12.640051 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:12.640165 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.1:46233: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152}
I20260809 05:33:12.686757 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 22578
I20260809 05:33:12.719306 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 22005
I20260809 05:33:12.720944 22100 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:33:12.855849 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 22005
2026-08-09T05:33:12Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (3668 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:33:13 dist-test-slave-h3ft krb5kdc[22884](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:33:13 dist-test-slave-h3ft krb5kdc[22884](info): set up 2 sockets
Aug 09 05:33:13 dist-test-slave-h3ft krb5kdc[22884](info): commencing operation
krb5kdc: starting...
W20260809 05:33:14.306530 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.387s user 0.003s sys 0.059s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:33:14 dist-test-slave-h3ft krb5kdc[22884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253594, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:33:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:33:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
I20260809 05:33:14.730681 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:40217
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:37981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:40217
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:33:15.180866 22899 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:15.181380 22899 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:15.181568 22899 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:15.189841 22899 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:33:15.190074 22899 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:15.190204 22899 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:15.190320 22899 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:33:15.190405 22899 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:33:15.202280 22899 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:37981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:40217
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:40217
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:15.204471 22899 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:15.206307 22899 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:15.222259 22912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:15.222200 22916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:15.222848 22909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:15.223487 22899 server_base.cc:1034] running on GCE node
I20260809 05:33:15.224690 22899 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:15.226711 22899 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:15.227993 22899 hybrid_clock.cc:648] HybridClock initialized: now 1786253595227939 us; error 50 us; skew 500 ppm
I20260809 05:33:15.228469 22899 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:33:15 dist-test-slave-h3ft krb5kdc[22884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253595, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:33:15.232892 22899 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:33:15.234963 22899 webserver.cc:460] Webserver started at http://127.26.185.62:36687/ using document root <none> and password file <none>
I20260809 05:33:15.236014 22899 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:15.236196 22899 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:15.236604 22899 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:15.240756 22899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "a394644efdf14c5f83d68a635cd47ee7"
format_stamp: "Formatted at 2026-08-09 05:33:15 on dist-test-slave-h3ft"
server_key: "8946e7001c5815ccd936812ac60f9e65"
server_key_iv: "be470b2c16b7c2de796a1a2abd497c2f"
server_key_version: "encryptionkey@0"
I20260809 05:33:15.241842 22899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "a394644efdf14c5f83d68a635cd47ee7"
format_stamp: "Formatted at 2026-08-09 05:33:15 on dist-test-slave-h3ft"
server_key: "8946e7001c5815ccd936812ac60f9e65"
server_key_iv: "be470b2c16b7c2de796a1a2abd497c2f"
server_key_version: "encryptionkey@0"
I20260809 05:33:15.249493 22899 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.003s
I20260809 05:33:15.254900 22929 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:15.257141 22899 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.002s
I20260809 05:33:15.257484 22899 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "a394644efdf14c5f83d68a635cd47ee7"
format_stamp: "Formatted at 2026-08-09 05:33:15 on dist-test-slave-h3ft"
server_key: "8946e7001c5815ccd936812ac60f9e65"
server_key_iv: "be470b2c16b7c2de796a1a2abd497c2f"
server_key_version: "encryptionkey@0"
I20260809 05:33:15.257830 22899 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:15.297369 22899 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:15.303390 22899 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:15.303797 22899 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:15.328209 22899 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:40217
I20260809 05:33:15.328214 23008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:40217 every 8 connection(s)
I20260809 05:33:15.330273 22899 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:33:15.335985 23010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:15.337044 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 22899
I20260809 05:33:15.337320 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:33:15.337992 27364 external_mini_cluster.cc:1428] Setting key a36ccd2a36723fe6f31cab00ec25b44f
I20260809 05:33:15.357088 23010 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a394644efdf14c5f83d68a635cd47ee7: Bootstrap starting.
I20260809 05:33:15.362738 23010 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a394644efdf14c5f83d68a635cd47ee7: Neither blocks nor log segments found. Creating new log.
Aug 09 05:33:15 dist-test-slave-h3ft krb5kdc[22884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253594, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:33:15.364673 23010 log.cc:824] T 00000000000000000000000000000000 P a394644efdf14c5f83d68a635cd47ee7: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:15.369616 23010 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a394644efdf14c5f83d68a635cd47ee7: No bootstrap required, opened a new log
I20260809 05:33:15.377173 23016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:15.340920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58964 (local address 127.26.185.62:40217)
0809 05:33:15.342084 (+ 1164us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:15.342109 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:15.342193 (+ 84us) server_negotiation.cc:407] Connection header received
0809 05:33:15.345271 (+ 3078us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:15.345331 (+ 60us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:15.346207 (+ 876us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:15.346919 (+ 712us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:15.349455 (+ 2536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:15.352398 (+ 2943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:15.354760 (+ 2362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:15.356745 (+ 1985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:15.357080 (+ 335us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:15.365995 (+ 8915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:15.366014 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:15.366048 (+ 34us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:15.366128 (+ 80us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:15.370870 (+ 4742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:15.372271 (+ 1401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:15.372280 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:15.372290 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:15.372519 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:15.373078 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:15.373083 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:15.373085 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:15.373857 (+ 772us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:15.374185 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:15.374884 (+ 699us) server_negotiation.cc:299] Negotiation successful
0809 05:33:15.375614 (+ 730us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":809,"thread_start_us":484,"threads_started":1}
I20260809 05:33:15.380520 23010 raft_consensus.cc:348] T 00000000000000000000000000000000 P a394644efdf14c5f83d68a635cd47ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a394644efdf14c5f83d68a635cd47ee7" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 40217 } }
I20260809 05:33:15.381021 23010 raft_consensus.cc:374] T 00000000000000000000000000000000 P a394644efdf14c5f83d68a635cd47ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:15.381166 23010 raft_consensus.cc:729] T 00000000000000000000000000000000 P a394644efdf14c5f83d68a635cd47ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a394644efdf14c5f83d68a635cd47ee7, State: Initialized, Role: FOLLOWER
I20260809 05:33:15.381918 23010 consensus_queue.cc:260] T 00000000000000000000000000000000 P a394644efdf14c5f83d68a635cd47ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a394644efdf14c5f83d68a635cd47ee7" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 40217 } }
I20260809 05:33:15.382215 23010 raft_consensus.cc:388] T 00000000000000000000000000000000 P a394644efdf14c5f83d68a635cd47ee7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:33:15.382360 23010 raft_consensus.cc:482] T 00000000000000000000000000000000 P a394644efdf14c5f83d68a635cd47ee7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:33:15.382567 23010 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a394644efdf14c5f83d68a635cd47ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:15.385208 23010 raft_consensus.cc:504] T 00000000000000000000000000000000 P a394644efdf14c5f83d68a635cd47ee7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a394644efdf14c5f83d68a635cd47ee7" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 40217 } }
I20260809 05:33:15.385885 23010 leader_election.cc:302] T 00000000000000000000000000000000 P a394644efdf14c5f83d68a635cd47ee7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a394644efdf14c5f83d68a635cd47ee7; no voters:
I20260809 05:33:15.386742 23010 leader_election.cc:288] T 00000000000000000000000000000000 P a394644efdf14c5f83d68a635cd47ee7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:33:15.386924 23019 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a394644efdf14c5f83d68a635cd47ee7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:33:15.388561 23019 raft_consensus.cc:686] T 00000000000000000000000000000000 P a394644efdf14c5f83d68a635cd47ee7 [term 1 LEADER]: Becoming Leader. State: Replica: a394644efdf14c5f83d68a635cd47ee7, State: Running, Role: LEADER
I20260809 05:33:15.389202 23019 consensus_queue.cc:237] T 00000000000000000000000000000000 P a394644efdf14c5f83d68a635cd47ee7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a394644efdf14c5f83d68a635cd47ee7" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 40217 } }
I20260809 05:33:15.389802 23010 sys_catalog.cc:564] T 00000000000000000000000000000000 P a394644efdf14c5f83d68a635cd47ee7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:33:15.393362 23023 sys_catalog.cc:455] T 00000000000000000000000000000000 P a394644efdf14c5f83d68a635cd47ee7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a394644efdf14c5f83d68a635cd47ee7. Latest consensus state: current_term: 1 leader_uuid: "a394644efdf14c5f83d68a635cd47ee7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a394644efdf14c5f83d68a635cd47ee7" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 40217 } } }
I20260809 05:33:15.393455 23020 sys_catalog.cc:455] T 00000000000000000000000000000000 P a394644efdf14c5f83d68a635cd47ee7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a394644efdf14c5f83d68a635cd47ee7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a394644efdf14c5f83d68a635cd47ee7" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 40217 } } }
I20260809 05:33:15.393920 23020 sys_catalog.cc:458] T 00000000000000000000000000000000 P a394644efdf14c5f83d68a635cd47ee7 [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:15.393920 23023 sys_catalog.cc:458] T 00000000000000000000000000000000 P a394644efdf14c5f83d68a635cd47ee7 [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:15.398703 23027 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:33:15.404770 23027 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:33:15.416524 23027 catalog_manager.cc:1347] Generated new cluster ID: 89e881c4f9a643f887d138786c5b2da0
I20260809 05:33:15.416694 23027 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:33:15.428725 23027 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:33:15.430519 23027 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:33:15.439478 23027 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a394644efdf14c5f83d68a635cd47ee7: Generated new TSK 0
I20260809 05:33:15.441001 23027 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.185.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
I20260809 05:33:15.547051 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:0
--local_ip_for_outbound_sockets=127.26.185.1
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:40217
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:37981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:33:16.003049 23057 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:16.003434 23057 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:16.003612 23057 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:16.011742 23057 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:16.011886 23057 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:16.012090 23057 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:33:16.023782 23057 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:37981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:40217
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:16.025702 23057 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:16.027526 23057 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:16.043834 23067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:16.043769 23066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:16.043888 23078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:16.045177 23057 server_base.cc:1034] running on GCE node
I20260809 05:33:16.045977 23057 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:16.047271 23057 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:16.048537 23057 hybrid_clock.cc:648] HybridClock initialized: now 1786253596048484 us; error 61 us; skew 500 ppm
I20260809 05:33:16.048933 23057 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:33:16 dist-test-slave-h3ft krb5kdc[22884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253596, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:33:16.057029 23057 init.cc:377] Logged in from keytab as kudu/127.26.185.1@KRBTEST.COM (short username kudu)
I20260809 05:33:16.059159 23057 webserver.cc:460] Webserver started at http://127.26.185.1:35643/ using document root <none> and password file <none>
I20260809 05:33:16.060089 23057 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:16.060216 23057 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:16.060568 23057 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:16.064813 23057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-0/data/instance:
uuid: "3d19864fb3e14b24bc5f168c961c5cf5"
format_stamp: "Formatted at 2026-08-09 05:33:16 on dist-test-slave-h3ft"
server_key: "d1f45ff408ffdd0317be19f846780012"
server_key_iv: "c6a83cae8eefe65c4bc7cb95220207c4"
server_key_version: "encryptionkey@0"
I20260809 05:33:16.065781 23057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance:
uuid: "3d19864fb3e14b24bc5f168c961c5cf5"
format_stamp: "Formatted at 2026-08-09 05:33:16 on dist-test-slave-h3ft"
server_key: "d1f45ff408ffdd0317be19f846780012"
server_key_iv: "c6a83cae8eefe65c4bc7cb95220207c4"
server_key_version: "encryptionkey@0"
I20260809 05:33:16.072949 23057 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260809 05:33:16.077486 23090 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:16.079337 23057 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:33:16.079517 23057 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "3d19864fb3e14b24bc5f168c961c5cf5"
format_stamp: "Formatted at 2026-08-09 05:33:16 on dist-test-slave-h3ft"
server_key: "d1f45ff408ffdd0317be19f846780012"
server_key_iv: "c6a83cae8eefe65c4bc7cb95220207c4"
server_key_version: "encryptionkey@0"
I20260809 05:33:16.079751 23057 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:16.109483 23057 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:16.115602 23057 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:16.115948 23057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:16.117192 23057 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:33:16.119052 23057 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:33:16.119143 23057 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260809 05:33:16.119246 23057 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:33:16.119297 23057 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:16.161020 23057 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:37843
I20260809 05:33:16.161096 23288 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:37843 every 8 connection(s)
I20260809 05:33:16.162958 23057 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:33:16.164718 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 23057
I20260809 05:33:16.164988 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance
I20260809 05:33:16.165643 27364 external_mini_cluster.cc:1428] Setting key fbde75de22d5f7293d9433d26c522a38
Aug 09 05:33:16 dist-test-slave-h3ft krb5kdc[22884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253596, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:33:16.193132 23293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:16.166780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:35417 (local address 127.26.185.62:40217)
0809 05:33:16.167394 (+ 614us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:16.167403 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:16.168768 (+ 1365us) server_negotiation.cc:407] Connection header received
0809 05:33:16.172210 (+ 3442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:16.172216 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:16.172327 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:16.172439 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:16.175177 (+ 2738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:16.176127 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:16.178953 (+ 2826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:16.179492 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:16.179622 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:16.185241 (+ 5619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:16.185249 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:16.185254 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:16.185365 (+ 111us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:16.188871 (+ 3506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:16.189891 (+ 1020us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:16.189896 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:16.189899 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:16.190070 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:16.190673 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:16.190677 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:16.190680 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:16.191161 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:16.191346 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:16.192311 (+ 965us) server_negotiation.cc:299] Negotiation successful
0809 05:33:16.192630 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":1130,"threads_started":1}
I20260809 05:33:16.194473 23294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:16.167514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:40217 (local address 127.26.185.1:35417)
0809 05:33:16.168553 (+ 1039us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:16.168618 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:16.171774 (+ 3156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:16.172824 (+ 1050us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:16.172842 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:16.173847 (+ 1005us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:33:16.174903 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:16.174937 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:16.176337 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:16.176345 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:16.178728 (+ 2383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:16.178749 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:16.179795 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:16.179806 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:16.180240 (+ 434us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:16.181220 (+ 980us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:33:16.181262 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:33:16.184742 (+ 3480us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:33:16.189070 (+ 4328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:33:16.189083 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:33:16.189107 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:33:16.189693 (+ 586us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:33:16.190224 (+ 531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:33:16.190229 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:33:16.190234 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:33:16.190491 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:33:16.191322 (+ 831us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:33:16.191343 (+ 21us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:33:16.191803 (+ 460us) client_negotiation.cc:769] Sending connection context
0809 05:33:16.192163 (+ 360us) client_negotiation.cc:240] Negotiation successful
0809 05:33:16.192902 (+ 739us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":664,"thread_start_us":385,"threads_started":1}
I20260809 05:33:16.196719 23290 heartbeater.cc:347] Connected to a master server at 127.26.185.62:40217
I20260809 05:33:16.197201 23290 heartbeater.cc:464] Registering TS with master...
I20260809 05:33:16.198418 23290 heartbeater.cc:511] Master 127.26.185.62:40217 requested a full tablet report, sending...
I20260809 05:33:16.201608 22960 ts_manager.cc:194] Registered new tserver with Master: 3d19864fb3e14b24bc5f168c961c5cf5 (127.26.185.1:37843)
I20260809 05:33:16.204319 22960 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.1@KRBTEST.COM'} at 127.26.185.1:35417
WARNING: no policy specified for kudu/127.26.185.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
I20260809 05:33:16.258563 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:0
--local_ip_for_outbound_sockets=127.26.185.2
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:40217
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:37981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:33:16.682379 23298 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:16.682788 23298 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:16.682899 23298 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:16.691238 23298 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:16.691393 23298 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:16.691601 23298 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:33:16.703095 23298 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:37981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:40217
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:16.704998 23298 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:16.706686 23298 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:16.723380 23303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:16.723467 23304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:16.723418 23308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:16.723963 23298 server_base.cc:1034] running on GCE node
I20260809 05:33:16.725036 23298 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:16.726274 23298 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:16.727556 23298 hybrid_clock.cc:648] HybridClock initialized: now 1786253596727471 us; error 70 us; skew 500 ppm
I20260809 05:33:16.728017 23298 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:33:16 dist-test-slave-h3ft krb5kdc[22884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253596, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:33:16.732128 23298 init.cc:377] Logged in from keytab as kudu/127.26.185.2@KRBTEST.COM (short username kudu)
I20260809 05:33:16.734050 23298 webserver.cc:460] Webserver started at http://127.26.185.2:38183/ using document root <none> and password file <none>
I20260809 05:33:16.734948 23298 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:16.735180 23298 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:16.735551 23298 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:16.739253 23298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-1/data/instance:
uuid: "9999fe8fb8ea462a9340799bb93c3b8c"
format_stamp: "Formatted at 2026-08-09 05:33:16 on dist-test-slave-h3ft"
server_key: "402daa65a4862ba4bce491d826c6ef5c"
server_key_iv: "e40b2036ccae3431f718551b1875d45a"
server_key_version: "encryptionkey@0"
I20260809 05:33:16.740159 23298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance:
uuid: "9999fe8fb8ea462a9340799bb93c3b8c"
format_stamp: "Formatted at 2026-08-09 05:33:16 on dist-test-slave-h3ft"
server_key: "402daa65a4862ba4bce491d826c6ef5c"
server_key_iv: "e40b2036ccae3431f718551b1875d45a"
server_key_version: "encryptionkey@0"
I20260809 05:33:16.747689 23298 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.003s
I20260809 05:33:16.752694 23318 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:16.754731 23298 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 05:33:16.755128 23298 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "9999fe8fb8ea462a9340799bb93c3b8c"
format_stamp: "Formatted at 2026-08-09 05:33:16 on dist-test-slave-h3ft"
server_key: "402daa65a4862ba4bce491d826c6ef5c"
server_key_iv: "e40b2036ccae3431f718551b1875d45a"
server_key_version: "encryptionkey@0"
I20260809 05:33:16.755453 23298 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:16.772282 23298 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:16.778570 23298 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:16.778939 23298 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:16.780225 23298 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:33:16.781921 23298 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:33:16.782035 23298 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:16.782199 23298 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:33:16.782274 23298 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:16.824079 23298 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:41799
I20260809 05:33:16.824162 23505 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:41799 every 8 connection(s)
I20260809 05:33:16.825747 23298 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:33:16.832937 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 23298
I20260809 05:33:16.833199 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance
I20260809 05:33:16.833786 27364 external_mini_cluster.cc:1428] Setting key 6a07804f8eac018e96cebbf20cecc576
Aug 09 05:33:16 dist-test-slave-h3ft krb5kdc[22884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253596, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:33:16.859175 23510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:16.829102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:53121 (local address 127.26.185.62:40217)
0809 05:33:16.829714 (+ 612us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:16.829720 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:16.831056 (+ 1336us) server_negotiation.cc:407] Connection header received
0809 05:33:16.833607 (+ 2551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:16.833616 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:16.833744 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:16.833894 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:16.836399 (+ 2505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:16.837400 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:16.840729 (+ 3329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:16.841223 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:16.841343 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:16.848047 (+ 6704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:16.848061 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:16.848098 (+ 37us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:16.848214 (+ 116us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:16.853265 (+ 5051us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:16.854892 (+ 1627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:16.854899 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:16.854903 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:16.855156 (+ 253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:16.855924 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:16.855931 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:16.855935 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:16.856484 (+ 549us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:16.856664 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:16.858387 (+ 1723us) server_negotiation.cc:299] Negotiation successful
0809 05:33:16.858673 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467,"thread_start_us":323,"threads_started":1}
I20260809 05:33:16.860281 23513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:16.829723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:40217 (local address 127.26.185.2:53121)
0809 05:33:16.830709 (+ 986us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:16.830772 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:16.833153 (+ 2381us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:16.834246 (+ 1093us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:16.834258 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:16.835217 (+ 959us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:33:16.836090 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:16.836116 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:16.837624 (+ 1508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:16.837630 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:16.840506 (+ 2876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:16.840542 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:16.841547 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:16.841558 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:16.841980 (+ 422us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:16.843110 (+ 1130us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:33:16.843157 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:33:16.847392 (+ 4235us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:33:16.853541 (+ 6149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:33:16.853559 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:33:16.853582 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:33:16.854599 (+ 1017us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:33:16.855301 (+ 702us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:33:16.855308 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:33:16.855312 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:33:16.855737 (+ 425us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:33:16.856642 (+ 905us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:33:16.856653 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:33:16.857148 (+ 495us) client_negotiation.cc:769] Sending connection context
0809 05:33:16.857550 (+ 402us) client_negotiation.cc:240] Negotiation successful
0809 05:33:16.858338 (+ 788us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":678,"thread_start_us":387,"threads_started":1}
I20260809 05:33:16.862239 23506 heartbeater.cc:347] Connected to a master server at 127.26.185.62:40217
I20260809 05:33:16.862700 23506 heartbeater.cc:464] Registering TS with master...
I20260809 05:33:16.863780 23506 heartbeater.cc:511] Master 127.26.185.62:40217 requested a full tablet report, sending...
I20260809 05:33:16.866015 22960 ts_manager.cc:194] Registered new tserver with Master: 9999fe8fb8ea462a9340799bb93c3b8c (127.26.185.2:41799)
I20260809 05:33:16.867638 22960 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.2@KRBTEST.COM'} at 127.26.185.2:53121
WARNING: no policy specified for kudu/127.26.185.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
I20260809 05:33:16.930851 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:0
--local_ip_for_outbound_sockets=127.26.185.3
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:40217
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:37981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:33:17.208531 23290 heartbeater.cc:503] Master 127.26.185.62:40217 was elected leader, sending a full tablet report...
W20260809 05:33:17.378172 23521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:17.378746 23521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:17.378924 23521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:17.387257 23521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:17.387414 23521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:17.387549 23521 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:33:17.399477 23521 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:37981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:40217
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:17.401290 23521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:17.402946 23521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:17.418954 23535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:17.419122 23532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:17.419603 23531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:17.420867 23521 server_base.cc:1034] running on GCE node
I20260809 05:33:17.421700 23521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:17.422947 23521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:17.424302 23521 hybrid_clock.cc:648] HybridClock initialized: now 1786253597424242 us; error 44 us; skew 500 ppm
I20260809 05:33:17.424767 23521 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:33:17 dist-test-slave-h3ft krb5kdc[22884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253597, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:33:17.429023 23521 init.cc:377] Logged in from keytab as kudu/127.26.185.3@KRBTEST.COM (short username kudu)
I20260809 05:33:17.431254 23521 webserver.cc:460] Webserver started at http://127.26.185.3:33747/ using document root <none> and password file <none>
I20260809 05:33:17.432195 23521 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:17.432320 23521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:17.432688 23521 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:17.436538 23521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-2/data/instance:
uuid: "352801d3198d4a66af91edea4ef130a7"
format_stamp: "Formatted at 2026-08-09 05:33:17 on dist-test-slave-h3ft"
server_key: "2ed3d2e5a9db21df36ebb11cd0b92a20"
server_key_iv: "6ffd5a31682bf43fa18a603365f997bc"
server_key_version: "encryptionkey@0"
I20260809 05:33:17.437441 23521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance:
uuid: "352801d3198d4a66af91edea4ef130a7"
format_stamp: "Formatted at 2026-08-09 05:33:17 on dist-test-slave-h3ft"
server_key: "2ed3d2e5a9db21df36ebb11cd0b92a20"
server_key_iv: "6ffd5a31682bf43fa18a603365f997bc"
server_key_version: "encryptionkey@0"
I20260809 05:33:17.444464 23521 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260809 05:33:17.449457 23544 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:17.451494 23521 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.001s
I20260809 05:33:17.451699 23521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "352801d3198d4a66af91edea4ef130a7"
format_stamp: "Formatted at 2026-08-09 05:33:17 on dist-test-slave-h3ft"
server_key: "2ed3d2e5a9db21df36ebb11cd0b92a20"
server_key_iv: "6ffd5a31682bf43fa18a603365f997bc"
server_key_version: "encryptionkey@0"
I20260809 05:33:17.451944 23521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:17.489993 23521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:17.495968 23521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:17.496302 23521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:17.497537 23521 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:33:17.499392 23521 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:33:17.499482 23521 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:17.499598 23521 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:33:17.499645 23521 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:17.537599 23521 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:46227
I20260809 05:33:17.537648 23734 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:46227 every 8 connection(s)
I20260809 05:33:17.539377 23521 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:33:17.547510 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 23521
I20260809 05:33:17.547780 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance
I20260809 05:33:17.548583 27364 external_mini_cluster.cc:1428] Setting key 04f9f8cf83f10bf51cc19b36fa93000a
Aug 09 05:33:17 dist-test-slave-h3ft krb5kdc[22884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253597, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:33:17.569159 23738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:17.542944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:39139 (local address 127.26.185.62:40217)
0809 05:33:17.543627 (+ 683us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:17.543636 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:17.545099 (+ 1463us) server_negotiation.cc:407] Connection header received
0809 05:33:17.548510 (+ 3411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:17.548516 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:17.548622 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:17.548807 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:17.551920 (+ 3113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:17.553074 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:17.555291 (+ 2217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:17.555794 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:17.555922 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:17.560616 (+ 4694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:17.560623 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:17.560627 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:17.560676 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:17.564751 (+ 4075us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:17.566088 (+ 1337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:17.566096 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:17.566100 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:17.566285 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:17.566829 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:17.566835 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:17.566839 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:17.567276 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:17.567463 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:17.568409 (+ 946us) server_negotiation.cc:299] Negotiation successful
0809 05:33:17.568697 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":511,"thread_start_us":280,"threads_started":1}
I20260809 05:33:17.570462 23741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:17.543902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:40217 (local address 127.26.185.3:39139)
0809 05:33:17.544831 (+ 929us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:17.544879 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:17.548027 (+ 3148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:17.549311 (+ 1284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:17.549332 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:17.550455 (+ 1123us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:33:17.551656 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:17.551691 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:17.553248 (+ 1557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:17.553253 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:17.554961 (+ 1708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:17.555104 (+ 143us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:17.556101 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:17.556107 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:17.556470 (+ 363us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:17.557386 (+ 916us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:33:17.557423 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:33:17.560296 (+ 2873us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:33:17.564936 (+ 4640us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:33:17.564946 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:33:17.564968 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:33:17.565847 (+ 879us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:33:17.566413 (+ 566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:33:17.566418 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:33:17.566422 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:33:17.566694 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:33:17.567425 (+ 731us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:33:17.567435 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:33:17.567943 (+ 508us) client_negotiation.cc:769] Sending connection context
0809 05:33:17.568279 (+ 336us) client_negotiation.cc:240] Negotiation successful
0809 05:33:17.569023 (+ 744us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":634,"thread_start_us":387,"threads_started":1}
I20260809 05:33:17.572201 23735 heartbeater.cc:347] Connected to a master server at 127.26.185.62:40217
I20260809 05:33:17.572568 23735 heartbeater.cc:464] Registering TS with master...
I20260809 05:33:17.573465 23735 heartbeater.cc:511] Master 127.26.185.62:40217 requested a full tablet report, sending...
I20260809 05:33:17.575346 22960 ts_manager.cc:194] Registered new tserver with Master: 352801d3198d4a66af91edea4ef130a7 (127.26.185.3:46227)
I20260809 05:33:17.576287 22960 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.3@KRBTEST.COM'} at 127.26.185.3:39139
I20260809 05:33:17.578980 27364 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 05:33:17.601347 23738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:17.584247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58976 (local address 127.26.185.62:40217)
0809 05:33:17.584452 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:17.584457 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:17.585020 (+ 563us) server_negotiation.cc:407] Connection header received
0809 05:33:17.585256 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:17.585264 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:17.585363 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:17.585461 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:17.587246 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:17.588202 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:17.590070 (+ 1868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:17.590764 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:17.590891 (+ 127us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:17.594217 (+ 3326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:17.594223 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:17.594227 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:17.594277 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:17.597751 (+ 3474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:17.598825 (+ 1074us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:17.598829 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:17.598832 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:17.599088 (+ 256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:17.599666 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:17.599670 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:17.599672 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:17.600111 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:17.600360 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:17.600847 (+ 487us) server_negotiation.cc:299] Negotiation successful
0809 05:33:17.601055 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 05:33:17.606845 22960 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58976:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 05:33:17.615075 22960 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 05:33:17.657675 23772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:17.632243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56484 (local address 127.26.185.2:41799)
0809 05:33:17.646523 (+ 14280us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:17.646543 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:17.646613 (+ 70us) server_negotiation.cc:407] Connection header received
0809 05:33:17.646828 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:17.646841 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:17.647340 (+ 499us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:17.649333 (+ 1993us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:17.649633 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:17.651345 (+ 1712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:17.654422 (+ 3077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:17.656117 (+ 1695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:17.656296 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:17.656603 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:17.657046 (+ 443us) server_negotiation.cc:299] Negotiation successful
0809 05:33:17.657277 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13917,"thread_start_us":15397,"threads_started":1}
I20260809 05:33:17.658247 23769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:17.631654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:41799 (local address 127.0.0.1:56484)
0809 05:33:17.633089 (+ 1435us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:17.633148 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:17.633437 (+ 289us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:17.648188 (+ 14751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:17.648205 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:17.648272 (+ 67us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:17.649044 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:17.649061 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:17.651515 (+ 2454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:17.651521 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:17.654219 (+ 2698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:17.654232 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:17.656399 (+ 2167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:17.656406 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:17.656678 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:17.656764 (+ 86us) client_negotiation.cc:769] Sending connection context
0809 05:33:17.656971 (+ 207us) client_negotiation.cc:240] Negotiation successful
0809 05:33:17.657279 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1019,"mutex_wait_us":25,"thread_start_us":2184,"threads_started":1}
I20260809 05:33:17.659663 23765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:17.631694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:37843 (local address 127.0.0.1:38018)
0809 05:33:17.634137 (+ 2443us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:17.634159 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:17.634745 (+ 586us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:17.649814 (+ 15069us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:17.649824 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:17.649874 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:17.650487 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:17.650507 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:17.653012 (+ 2505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:17.653018 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:17.655481 (+ 2463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:17.655500 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:17.657611 (+ 2111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:17.657618 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:17.658259 (+ 641us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:17.658310 (+ 51us) client_negotiation.cc:769] Sending connection context
0809 05:33:17.658535 (+ 225us) client_negotiation.cc:240] Negotiation successful
0809 05:33:17.658710 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2299,"mutex_wait_us":25,"thread_start_us":763,"threads_started":1}
I20260809 05:33:17.661237 23771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:17.632069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38018 (local address 127.26.185.1:37843)
0809 05:33:17.647452 (+ 15383us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:17.647462 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:17.647498 (+ 36us) server_negotiation.cc:407] Connection header received
0809 05:33:17.647640 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:17.647648 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:17.647904 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:17.650802 (+ 2898us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:17.651196 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:17.652820 (+ 1624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:17.655692 (+ 2872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:17.657312 (+ 1620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:17.660175 (+ 2863us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:17.660529 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:17.660624 (+ 95us) server_negotiation.cc:299] Negotiation successful
0809 05:33:17.660880 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15141,"thread_start_us":17225,"threads_started":1}
I20260809 05:33:17.664044 23774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:17.634994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:46227 (local address 127.0.0.1:41844)
0809 05:33:17.648742 (+ 13748us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:17.648777 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:17.648957 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:17.651808 (+ 2851us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:17.651813 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:17.651845 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:17.652326 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:17.652338 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:17.655554 (+ 3216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:17.655560 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:17.658537 (+ 2977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:17.658555 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:17.662682 (+ 4127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:17.662692 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:17.663118 (+ 426us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:17.663185 (+ 67us) client_negotiation.cc:769] Sending connection context
0809 05:33:17.663360 (+ 175us) client_negotiation.cc:240] Negotiation successful
0809 05:33:17.663545 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13561,"thread_start_us":13333,"threads_started":1}
I20260809 05:33:17.664237 23405 tablet_service.cc:1467] Processing CreateTablet for tablet abf9fcea48c34cbcbf140c555c600a70 (DEFAULT_TABLE table=test-table [id=d8f0263e3573473796f471c84318dbed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:33:17.665467 23776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:17.634816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41844 (local address 127.26.185.3:46227)
0809 05:33:17.651069 (+ 16253us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:17.651079 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:17.651118 (+ 39us) server_negotiation.cc:407] Connection header received
0809 05:33:17.651231 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:17.651241 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:17.651568 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:17.651817 (+ 249us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:17.652550 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:17.655370 (+ 2820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:17.658801 (+ 3431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:17.662362 (+ 3561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:17.662567 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:17.662876 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:17.663397 (+ 521us) server_negotiation.cc:299] Negotiation successful
0809 05:33:17.665075 (+ 1678us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16012,"thread_start_us":15797,"threads_started":1}
I20260809 05:33:17.666319 23405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abf9fcea48c34cbcbf140c555c600a70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:17.667253 23171 tablet_service.cc:1467] Processing CreateTablet for tablet abf9fcea48c34cbcbf140c555c600a70 (DEFAULT_TABLE table=test-table [id=d8f0263e3573473796f471c84318dbed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:33:17.668648 23171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abf9fcea48c34cbcbf140c555c600a70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:17.670261 23623 tablet_service.cc:1467] Processing CreateTablet for tablet abf9fcea48c34cbcbf140c555c600a70 (DEFAULT_TABLE table=test-table [id=d8f0263e3573473796f471c84318dbed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:33:17.672724 23623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abf9fcea48c34cbcbf140c555c600a70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:17.682621 23778 tablet_bootstrap.cc:492] T abf9fcea48c34cbcbf140c555c600a70 P 3d19864fb3e14b24bc5f168c961c5cf5: Bootstrap starting.
I20260809 05:33:17.687122 23778 tablet_bootstrap.cc:654] T abf9fcea48c34cbcbf140c555c600a70 P 3d19864fb3e14b24bc5f168c961c5cf5: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:17.688134 23779 tablet_bootstrap.cc:492] T abf9fcea48c34cbcbf140c555c600a70 P 9999fe8fb8ea462a9340799bb93c3b8c: Bootstrap starting.
I20260809 05:33:17.690089 23778 log.cc:824] T abf9fcea48c34cbcbf140c555c600a70 P 3d19864fb3e14b24bc5f168c961c5cf5: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:17.692399 23781 tablet_bootstrap.cc:492] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7: Bootstrap starting.
I20260809 05:33:17.693652 23779 tablet_bootstrap.cc:654] T abf9fcea48c34cbcbf140c555c600a70 P 9999fe8fb8ea462a9340799bb93c3b8c: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:17.695703 23779 log.cc:824] T abf9fcea48c34cbcbf140c555c600a70 P 9999fe8fb8ea462a9340799bb93c3b8c: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:17.696651 23781 tablet_bootstrap.cc:654] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:17.697926 23781 log.cc:824] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:17.699568 23778 tablet_bootstrap.cc:492] T abf9fcea48c34cbcbf140c555c600a70 P 3d19864fb3e14b24bc5f168c961c5cf5: No bootstrap required, opened a new log
I20260809 05:33:17.699982 23778 ts_tablet_manager.cc:1397] T abf9fcea48c34cbcbf140c555c600a70 P 3d19864fb3e14b24bc5f168c961c5cf5: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.006s
I20260809 05:33:17.701856 23781 tablet_bootstrap.cc:492] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7: No bootstrap required, opened a new log
I20260809 05:33:17.702219 23781 ts_tablet_manager.cc:1397] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260809 05:33:17.705309 23779 tablet_bootstrap.cc:492] T abf9fcea48c34cbcbf140c555c600a70 P 9999fe8fb8ea462a9340799bb93c3b8c: No bootstrap required, opened a new log
I20260809 05:33:17.705724 23779 ts_tablet_manager.cc:1397] T abf9fcea48c34cbcbf140c555c600a70 P 9999fe8fb8ea462a9340799bb93c3b8c: Time spent bootstrapping tablet: real 0.018s user 0.012s sys 0.000s
I20260809 05:33:17.712857 23778 raft_consensus.cc:348] T abf9fcea48c34cbcbf140c555c600a70 P 3d19864fb3e14b24bc5f168c961c5cf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d19864fb3e14b24bc5f168c961c5cf5" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 37843 } } peers { permanent_uuid: "9999fe8fb8ea462a9340799bb93c3b8c" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 41799 } } peers { permanent_uuid: "352801d3198d4a66af91edea4ef130a7" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46227 } }
I20260809 05:33:17.713608 23778 raft_consensus.cc:374] T abf9fcea48c34cbcbf140c555c600a70 P 3d19864fb3e14b24bc5f168c961c5cf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:17.713747 23778 raft_consensus.cc:729] T abf9fcea48c34cbcbf140c555c600a70 P 3d19864fb3e14b24bc5f168c961c5cf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d19864fb3e14b24bc5f168c961c5cf5, State: Initialized, Role: FOLLOWER
I20260809 05:33:17.714323 23781 raft_consensus.cc:348] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d19864fb3e14b24bc5f168c961c5cf5" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 37843 } } peers { permanent_uuid: "9999fe8fb8ea462a9340799bb93c3b8c" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 41799 } } peers { permanent_uuid: "352801d3198d4a66af91edea4ef130a7" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46227 } }
I20260809 05:33:17.714895 23781 raft_consensus.cc:374] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:17.714709 23778 consensus_queue.cc:260] T abf9fcea48c34cbcbf140c555c600a70 P 3d19864fb3e14b24bc5f168c961c5cf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d19864fb3e14b24bc5f168c961c5cf5" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 37843 } } peers { permanent_uuid: "9999fe8fb8ea462a9340799bb93c3b8c" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 41799 } } peers { permanent_uuid: "352801d3198d4a66af91edea4ef130a7" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46227 } }
I20260809 05:33:17.715049 23781 raft_consensus.cc:729] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 352801d3198d4a66af91edea4ef130a7, State: Initialized, Role: FOLLOWER
I20260809 05:33:17.714910 23779 raft_consensus.cc:348] T abf9fcea48c34cbcbf140c555c600a70 P 9999fe8fb8ea462a9340799bb93c3b8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d19864fb3e14b24bc5f168c961c5cf5" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 37843 } } peers { permanent_uuid: "9999fe8fb8ea462a9340799bb93c3b8c" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 41799 } } peers { permanent_uuid: "352801d3198d4a66af91edea4ef130a7" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46227 } }
I20260809 05:33:17.715525 23779 raft_consensus.cc:374] T abf9fcea48c34cbcbf140c555c600a70 P 9999fe8fb8ea462a9340799bb93c3b8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:17.715642 23779 raft_consensus.cc:729] T abf9fcea48c34cbcbf140c555c600a70 P 9999fe8fb8ea462a9340799bb93c3b8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9999fe8fb8ea462a9340799bb93c3b8c, State: Initialized, Role: FOLLOWER
I20260809 05:33:17.715862 23781 consensus_queue.cc:260] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d19864fb3e14b24bc5f168c961c5cf5" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 37843 } } peers { permanent_uuid: "9999fe8fb8ea462a9340799bb93c3b8c" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 41799 } } peers { permanent_uuid: "352801d3198d4a66af91edea4ef130a7" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46227 } }
I20260809 05:33:17.716348 23779 consensus_queue.cc:260] T abf9fcea48c34cbcbf140c555c600a70 P 9999fe8fb8ea462a9340799bb93c3b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d19864fb3e14b24bc5f168c961c5cf5" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 37843 } } peers { permanent_uuid: "9999fe8fb8ea462a9340799bb93c3b8c" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 41799 } } peers { permanent_uuid: "352801d3198d4a66af91edea4ef130a7" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46227 } }
I20260809 05:33:17.722779 23778 ts_tablet_manager.cc:1428] T abf9fcea48c34cbcbf140c555c600a70 P 3d19864fb3e14b24bc5f168c961c5cf5: Time spent starting tablet: real 0.023s user 0.014s sys 0.006s
I20260809 05:33:17.724160 23506 heartbeater.cc:503] Master 127.26.185.62:40217 was elected leader, sending a full tablet report...
I20260809 05:33:17.725189 23779 ts_tablet_manager.cc:1428] T abf9fcea48c34cbcbf140c555c600a70 P 9999fe8fb8ea462a9340799bb93c3b8c: Time spent starting tablet: real 0.019s user 0.016s sys 0.004s
I20260809 05:33:17.725208 23781 ts_tablet_manager.cc:1428] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7: Time spent starting tablet: real 0.023s user 0.014s sys 0.009s
I20260809 05:33:17.725684 23735 heartbeater.cc:503] Master 127.26.185.62:40217 was elected leader, sending a full tablet report...
W20260809 05:33:17.791635 23737 tablet.cc:2369] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 05:33:17.828526 23507 tablet.cc:2369] T abf9fcea48c34cbcbf140c555c600a70 P 9999fe8fb8ea462a9340799bb93c3b8c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 05:33:17.917040 23291 tablet.cc:2369] T abf9fcea48c34cbcbf140c555c600a70 P 3d19864fb3e14b24bc5f168c961c5cf5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:33:18.020083 23788 raft_consensus.cc:482] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:33:18.020558 23788 raft_consensus.cc:504] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d19864fb3e14b24bc5f168c961c5cf5" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 37843 } } peers { permanent_uuid: "9999fe8fb8ea462a9340799bb93c3b8c" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 41799 } } peers { permanent_uuid: "352801d3198d4a66af91edea4ef130a7" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46227 } }
I20260809 05:33:18.023133 23788 leader_election.cc:288] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d19864fb3e14b24bc5f168c961c5cf5 (127.26.185.1:37843), 9999fe8fb8ea462a9340799bb93c3b8c (127.26.185.2:41799)
I20260809 05:33:18.031461 23772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:18.024052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:57329 (local address 127.26.185.2:41799)
0809 05:33:18.024285 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:18.024293 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:18.024320 (+ 27us) server_negotiation.cc:407] Connection header received
0809 05:33:18.024426 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:18.024432 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:18.024529 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:18.024654 (+ 125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:18.025369 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:18.026442 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:18.028988 (+ 2546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:18.030360 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:18.030547 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:18.030645 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:18.030957 (+ 312us) server_negotiation.cc:299] Negotiation successful
0809 05:33:18.031154 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 05:33:18.031486 23741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:18.023501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:41799 (local address 127.26.185.3:57329)
0809 05:33:18.023829 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:18.023854 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:18.024044 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:18.024866 (+ 822us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:18.024873 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:18.024909 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:18.025152 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:18.025165 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:18.026604 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:18.026609 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:18.028783 (+ 2174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:18.028805 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:18.030555 (+ 1750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:18.030560 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:18.030718 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:18.030777 (+ 59us) client_negotiation.cc:769] Sending connection context
0809 05:33:18.030905 (+ 128us) client_negotiation.cc:240] Negotiation successful
0809 05:33:18.031099 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"mutex_wait_us":1}
I20260809 05:33:18.031795 23792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:18.023665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:37843 (local address 127.26.185.3:54705)
0809 05:33:18.024574 (+ 909us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:18.024595 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:18.024815 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:18.025287 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:18.025295 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:18.025325 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:18.025728 (+ 403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:18.025741 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:18.027144 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:18.027151 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:18.029132 (+ 1981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:18.029143 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:18.030910 (+ 1767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:18.030917 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:18.031118 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:18.031149 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 05:33:18.031244 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 05:33:18.031366 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":771,"thread_start_us":872,"threads_started":1}
I20260809 05:33:18.032261 23771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:18.023777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:54705 (local address 127.26.185.1:37843)
0809 05:33:18.024061 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:18.024067 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:18.024689 (+ 622us) server_negotiation.cc:407] Connection header received
0809 05:33:18.025032 (+ 343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:18.025039 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:18.025136 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:18.025251 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:18.025947 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:18.026911 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:18.029295 (+ 2384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:18.030683 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:18.030830 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:18.030935 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:18.031296 (+ 361us) server_negotiation.cc:299] Negotiation successful
0809 05:33:18.031444 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260809 05:33:18.032982 23433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abf9fcea48c34cbcbf140c555c600a70" candidate_uuid: "352801d3198d4a66af91edea4ef130a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9999fe8fb8ea462a9340799bb93c3b8c" is_pre_election: true
I20260809 05:33:18.033277 23209 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abf9fcea48c34cbcbf140c555c600a70" candidate_uuid: "352801d3198d4a66af91edea4ef130a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d19864fb3e14b24bc5f168c961c5cf5" is_pre_election: true
I20260809 05:33:18.033687 23433 raft_consensus.cc:2454] T abf9fcea48c34cbcbf140c555c600a70 P 9999fe8fb8ea462a9340799bb93c3b8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 352801d3198d4a66af91edea4ef130a7 in term 0.
I20260809 05:33:18.033947 23209 raft_consensus.cc:2454] T abf9fcea48c34cbcbf140c555c600a70 P 3d19864fb3e14b24bc5f168c961c5cf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 352801d3198d4a66af91edea4ef130a7 in term 0.
I20260809 05:33:18.034502 23550 leader_election.cc:302] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 352801d3198d4a66af91edea4ef130a7, 9999fe8fb8ea462a9340799bb93c3b8c; no voters:
I20260809 05:33:18.034986 23788 raft_consensus.cc:2781] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:33:18.035190 23788 raft_consensus.cc:482] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:33:18.035319 23788 raft_consensus.cc:3037] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:18.037921 23788 raft_consensus.cc:504] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d19864fb3e14b24bc5f168c961c5cf5" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 37843 } } peers { permanent_uuid: "9999fe8fb8ea462a9340799bb93c3b8c" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 41799 } } peers { permanent_uuid: "352801d3198d4a66af91edea4ef130a7" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46227 } }
I20260809 05:33:18.038677 23788 leader_election.cc:288] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7 [CANDIDATE]: Term 1 election: Requested vote from peers 3d19864fb3e14b24bc5f168c961c5cf5 (127.26.185.1:37843), 9999fe8fb8ea462a9340799bb93c3b8c (127.26.185.2:41799)
I20260809 05:33:18.039269 23209 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abf9fcea48c34cbcbf140c555c600a70" candidate_uuid: "352801d3198d4a66af91edea4ef130a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d19864fb3e14b24bc5f168c961c5cf5"
I20260809 05:33:18.039335 23433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abf9fcea48c34cbcbf140c555c600a70" candidate_uuid: "352801d3198d4a66af91edea4ef130a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9999fe8fb8ea462a9340799bb93c3b8c"
I20260809 05:33:18.039587 23433 raft_consensus.cc:3037] T abf9fcea48c34cbcbf140c555c600a70 P 9999fe8fb8ea462a9340799bb93c3b8c [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:18.039564 23209 raft_consensus.cc:3037] T abf9fcea48c34cbcbf140c555c600a70 P 3d19864fb3e14b24bc5f168c961c5cf5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:18.043375 23209 raft_consensus.cc:2454] T abf9fcea48c34cbcbf140c555c600a70 P 3d19864fb3e14b24bc5f168c961c5cf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 352801d3198d4a66af91edea4ef130a7 in term 1.
I20260809 05:33:18.043375 23433 raft_consensus.cc:2454] T abf9fcea48c34cbcbf140c555c600a70 P 9999fe8fb8ea462a9340799bb93c3b8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 352801d3198d4a66af91edea4ef130a7 in term 1.
I20260809 05:33:18.043946 23550 leader_election.cc:302] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 352801d3198d4a66af91edea4ef130a7, 9999fe8fb8ea462a9340799bb93c3b8c; no voters:
I20260809 05:33:18.044312 23788 raft_consensus.cc:2781] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:33:18.044898 23788 raft_consensus.cc:686] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7 [term 1 LEADER]: Becoming Leader. State: Replica: 352801d3198d4a66af91edea4ef130a7, State: Running, Role: LEADER
I20260809 05:33:18.045518 23788 consensus_queue.cc:237] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d19864fb3e14b24bc5f168c961c5cf5" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 37843 } } peers { permanent_uuid: "9999fe8fb8ea462a9340799bb93c3b8c" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 41799 } } peers { permanent_uuid: "352801d3198d4a66af91edea4ef130a7" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46227 } }
I20260809 05:33:18.051601 22958 catalog_manager.cc:5495] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 352801d3198d4a66af91edea4ef130a7 (127.26.185.3). New cstate: current_term: 1 leader_uuid: "352801d3198d4a66af91edea4ef130a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d19864fb3e14b24bc5f168c961c5cf5" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9999fe8fb8ea462a9340799bb93c3b8c" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 41799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "352801d3198d4a66af91edea4ef130a7" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46227 } health_report { overall_health: HEALTHY } } }
I20260809 05:33:18.132618 23776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:18.125407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41856 (local address 127.26.185.3:46227)
0809 05:33:18.125658 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:18.125664 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:18.126024 (+ 360us) server_negotiation.cc:407] Connection header received
0809 05:33:18.126246 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:18.126251 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:18.126367 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:18.126544 (+ 177us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:33:18.127207 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:18.128044 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:18.129706 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:18.130177 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:18.130288 (+ 111us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:18.131131 (+ 843us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:33:18.131868 (+ 737us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:33:18.132044 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:18.132271 (+ 227us) server_negotiation.cc:299] Negotiation successful
0809 05:33:18.132329 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 05:33:18.144548 23433 raft_consensus.cc:1261] T abf9fcea48c34cbcbf140c555c600a70 P 9999fe8fb8ea462a9340799bb93c3b8c [term 1 FOLLOWER]: Refusing update from remote peer 352801d3198d4a66af91edea4ef130a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:33:18.144532 23209 raft_consensus.cc:1261] T abf9fcea48c34cbcbf140c555c600a70 P 3d19864fb3e14b24bc5f168c961c5cf5 [term 1 FOLLOWER]: Refusing update from remote peer 352801d3198d4a66af91edea4ef130a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:33:18.145860 23788 consensus_queue.cc:1035] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9999fe8fb8ea462a9340799bb93c3b8c" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 41799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:33:18.146292 23794 consensus_queue.cc:1035] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d19864fb3e14b24bc5f168c961c5cf5" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:33:18.163291 23799 mvcc.cc:205] Tried to move back new op lower bound from 7316494737985609728 to 7316494737599266816. Current Snapshot: MvccSnapshot[applied={T|T < 7316494737985609728}]
I20260809 05:33:18.187582 22960 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58976:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:33:18.188000 22960 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58976:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:33:18.193378 22960 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a394644efdf14c5f83d68a635cd47ee7: Sending DeleteTablet for 3 replicas of tablet abf9fcea48c34cbcbf140c555c600a70
I20260809 05:33:18.195127 23171 tablet_service.cc:1514] Processing DeleteTablet for tablet abf9fcea48c34cbcbf140c555c600a70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:33:18 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:38018
I20260809 05:33:18.195266 23623 tablet_service.cc:1514] Processing DeleteTablet for tablet abf9fcea48c34cbcbf140c555c600a70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:33:18 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:41844
I20260809 05:33:18.196583 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 23057
I20260809 05:33:18.196573 23405 tablet_service.cc:1514] Processing DeleteTablet for tablet abf9fcea48c34cbcbf140c555c600a70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:33:18 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:56484
I20260809 05:33:18.223855 23817 tablet_replica.cc:330] T abf9fcea48c34cbcbf140c555c600a70 P 9999fe8fb8ea462a9340799bb93c3b8c: stopping tablet replica
I20260809 05:33:18.224771 23817 raft_consensus.cc:2229] T abf9fcea48c34cbcbf140c555c600a70 P 9999fe8fb8ea462a9340799bb93c3b8c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:33:18.226925 23816 tablet_replica.cc:330] T abf9fcea48c34cbcbf140c555c600a70 P 3d19864fb3e14b24bc5f168c961c5cf5: stopping tablet replica
I20260809 05:33:18.227734 23816 raft_consensus.cc:2229] T abf9fcea48c34cbcbf140c555c600a70 P 3d19864fb3e14b24bc5f168c961c5cf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:33:18.228636 23816 raft_consensus.cc:2258] T abf9fcea48c34cbcbf140c555c600a70 P 3d19864fb3e14b24bc5f168c961c5cf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:33:18.229993 23815 tablet_replica.cc:330] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7: stopping tablet replica
I20260809 05:33:18.230027 23817 raft_consensus.cc:2258] T abf9fcea48c34cbcbf140c555c600a70 P 9999fe8fb8ea462a9340799bb93c3b8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:33:18.230700 23815 raft_consensus.cc:2229] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7 [term 1 LEADER]: Raft consensus shutting down.
I20260809 05:33:18.231721 23815 raft_consensus.cc:2258] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:33:18.233106 23817 ts_tablet_manager.cc:1905] T abf9fcea48c34cbcbf140c555c600a70 P 9999fe8fb8ea462a9340799bb93c3b8c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:33:18.234359 23816 ts_tablet_manager.cc:1905] T abf9fcea48c34cbcbf140c555c600a70 P 3d19864fb3e14b24bc5f168c961c5cf5: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 09 05:33:18 dist-test-slave-h3ft krb5kdc[22884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253594, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.1@KRBTEST.COM
I20260809 05:33:18.237082 23815 ts_tablet_manager.cc:1905] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:33:18.242018 23817 ts_tablet_manager.cc:1918] T abf9fcea48c34cbcbf140c555c600a70 P 9999fe8fb8ea462a9340799bb93c3b8c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:33:18.242295 23817 log.cc:1196] T abf9fcea48c34cbcbf140c555c600a70 P 9999fe8fb8ea462a9340799bb93c3b8c: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-1/wal/wals/abf9fcea48c34cbcbf140c555c600a70
I20260809 05:33:18.243039 23817 ts_tablet_manager.cc:1939] T abf9fcea48c34cbcbf140c555c600a70 P 9999fe8fb8ea462a9340799bb93c3b8c: Deleting consensus metadata
I20260809 05:33:18.245741 22933 catalog_manager.cc:4841] TS 9999fe8fb8ea462a9340799bb93c3b8c (127.26.185.2:41799): tablet abf9fcea48c34cbcbf140c555c600a70 (table test-table [id=d8f0263e3573473796f471c84318dbed]) successfully deleted
I20260809 05:33:18.246526 23816 ts_tablet_manager.cc:1918] T abf9fcea48c34cbcbf140c555c600a70 P 3d19864fb3e14b24bc5f168c961c5cf5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:33:18.246744 23816 log.cc:1196] T abf9fcea48c34cbcbf140c555c600a70 P 3d19864fb3e14b24bc5f168c961c5cf5: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-0/wal/wals/abf9fcea48c34cbcbf140c555c600a70
I20260809 05:33:18.247387 23816 ts_tablet_manager.cc:1939] T abf9fcea48c34cbcbf140c555c600a70 P 3d19864fb3e14b24bc5f168c961c5cf5: Deleting consensus metadata
I20260809 05:33:18.249563 23815 ts_tablet_manager.cc:1918] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:33:18.249625 23771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:18.198576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38032 (local address 127.26.185.1:37843)
0809 05:33:18.198802 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:18.198810 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:18.219143 (+ 20333us) server_negotiation.cc:407] Connection header received
0809 05:33:18.221492 (+ 2349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:18.221501 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:18.221645 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:18.221807 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:18.225392 (+ 3585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:18.226673 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:18.229437 (+ 2764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:18.230242 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:18.230386 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:18.238069 (+ 7683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:18.238095 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:18.238119 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:18.238190 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:18.243421 (+ 5231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:18.244687 (+ 1266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:18.244705 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:18.244709 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:18.244916 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:18.246552 (+ 1636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:18.246558 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:18.246562 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:18.247434 (+ 872us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:18.247891 (+ 457us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:18.248658 (+ 767us) server_negotiation.cc:299] Negotiation successful
0809 05:33:18.248978 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 05:33:18.249806 23815 log.cc:1196] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786253234117492-27364-0/minicluster-data/ts-2/wal/wals/abf9fcea48c34cbcbf140c555c600a70
I20260809 05:33:18.249811 22934 catalog_manager.cc:4841] TS 3d19864fb3e14b24bc5f168c961c5cf5 (127.26.185.1:37843): tablet abf9fcea48c34cbcbf140c555c600a70 (table test-table [id=d8f0263e3573473796f471c84318dbed]) successfully deleted
I20260809 05:33:18.250481 23815 ts_tablet_manager.cc:1939] T abf9fcea48c34cbcbf140c555c600a70 P 352801d3198d4a66af91edea4ef130a7: Deleting consensus metadata
I20260809 05:33:18.251617 23281 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:33:18.252799 22933 catalog_manager.cc:4841] TS 352801d3198d4a66af91edea4ef130a7 (127.26.185.3:46227): tablet abf9fcea48c34cbcbf140c555c600a70 (table test-table [id=d8f0263e3573473796f471c84318dbed]) successfully deleted
I20260809 05:33:18.351967 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 23057
I20260809 05:33:18.389331 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 23298
Aug 09 05:33:18 dist-test-slave-h3ft krb5kdc[22884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253594, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.2@KRBTEST.COM
I20260809 05:33:18.420449 23772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:18.393231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56496 (local address 127.26.185.2:41799)
0809 05:33:18.393503 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:18.393511 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:18.393536 (+ 25us) server_negotiation.cc:407] Connection header received
0809 05:33:18.393626 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:18.393635 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:18.393741 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:18.393864 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:18.395968 (+ 2104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:18.397222 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:18.400121 (+ 2899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:18.400964 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:18.401121 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:18.407865 (+ 6744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:18.407899 (+ 34us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:18.407930 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:18.408009 (+ 79us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:18.415359 (+ 7350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:18.416796 (+ 1437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:18.416810 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:18.416815 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:18.417047 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:18.417588 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:18.417594 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:18.417597 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:18.418193 (+ 596us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:18.418575 (+ 382us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:18.419420 (+ 845us) server_negotiation.cc:299] Negotiation successful
0809 05:33:18.419730 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260809 05:33:18.421563 23499 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:33:18.549458 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 23298
I20260809 05:33:18.578351 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 23521
Aug 09 05:33:18 dist-test-slave-h3ft krb5kdc[22884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253594, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.3@KRBTEST.COM
I20260809 05:33:18.601513 23776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:18.579615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49756 (local address 127.26.185.3:46227)
0809 05:33:18.579809 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:18.579815 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:18.579838 (+ 23us) server_negotiation.cc:407] Connection header received
0809 05:33:18.580073 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:18.580077 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:18.580177 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:18.580275 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:18.582637 (+ 2362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:18.583797 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:18.586116 (+ 2319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:18.586629 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:18.586743 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:18.593743 (+ 7000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:18.593762 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:18.593785 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:18.593849 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:18.597868 (+ 4019us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:18.599051 (+ 1183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:18.599066 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:18.599069 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:18.599254 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:18.599723 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:18.599727 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:18.599729 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:18.600148 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:18.600438 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:18.600870 (+ 432us) server_negotiation.cc:299] Negotiation successful
0809 05:33:18.601114 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 05:33:18.602512 23728 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:33:18.749048 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 23521
I20260809 05:33:18.785392 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 22899
I20260809 05:33:18.786940 23001 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:33:18.923977 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 22899
2026-08-09T05:33:18Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (6068 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-09T05:33:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:33:19Z Disabled control of system clock
I20260809 05:33:19.054287 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:34287
--webserver_interface=127.26.185.62
--webserver_port=0
--builtin_ntp_servers=127.26.185.20:44887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:34287
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 05:33:19.497159 23834 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:19.497553 23834 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:19.497645 23834 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:19.505789 23834 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:33:19.505967 23834 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:19.506011 23834 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:19.506069 23834 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:33:19.506117 23834 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:33:19.517151 23834 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:44887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:34287
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:34287
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:19.519071 23834 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:19.521631 23834 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:19.536592 23848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:19.536726 23843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:19.536722 23845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:19.538194 23834 server_base.cc:1034] running on GCE node
I20260809 05:33:19.539467 23834 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:19.541522 23834 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:19.542809 23834 hybrid_clock.cc:648] HybridClock initialized: now 1786253599542732 us; error 79 us; skew 500 ppm
I20260809 05:33:19.543322 23834 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 05:33:19.546452 23834 webserver.cc:460] Webserver started at http://127.26.185.62:33033/ using document root <none> and password file <none>
I20260809 05:33:19.547497 23834 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:19.547653 23834 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:19.548060 23834 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:19.551819 23834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "b9ff640a01094ca6864568ddf78b9fb0"
format_stamp: "Formatted at 2026-08-09 05:33:19 on dist-test-slave-h3ft"
server_key: "7c2c747f30f224f0f17270c0b92b28d6"
server_key_iv: "1c6b674a439faf4775c6144047a13529"
server_key_version: "encryptionkey@0"
I20260809 05:33:19.552841 23834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "b9ff640a01094ca6864568ddf78b9fb0"
format_stamp: "Formatted at 2026-08-09 05:33:19 on dist-test-slave-h3ft"
server_key: "7c2c747f30f224f0f17270c0b92b28d6"
server_key_iv: "1c6b674a439faf4775c6144047a13529"
server_key_version: "encryptionkey@0"
I20260809 05:33:19.559634 23834 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260809 05:33:19.564359 23862 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:19.566223 23834 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260809 05:33:19.566488 23834 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "b9ff640a01094ca6864568ddf78b9fb0"
format_stamp: "Formatted at 2026-08-09 05:33:19 on dist-test-slave-h3ft"
server_key: "7c2c747f30f224f0f17270c0b92b28d6"
server_key_iv: "1c6b674a439faf4775c6144047a13529"
server_key_version: "encryptionkey@0"
I20260809 05:33:19.566780 23834 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:19.583092 23834 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:19.584172 23834 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:19.584517 23834 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:19.607293 23834 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:34287
I20260809 05:33:19.607313 23953 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:34287 every 8 connection(s)
I20260809 05:33:19.609131 23834 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:33:19.609531 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 23834
I20260809 05:33:19.609763 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:33:19.610433 27364 external_mini_cluster.cc:1428] Setting key 56065e551ad80edadb585aea930102fc
I20260809 05:33:19.615374 23954 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:19.627374 23959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:19.613075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55046 (local address 127.26.185.62:34287)
0809 05:33:19.614412 (+ 1337us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:19.614428 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:19.614484 (+ 56us) server_negotiation.cc:407] Connection header received
0809 05:33:19.616570 (+ 2086us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:19.616601 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:19.617161 (+ 560us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:19.617655 (+ 494us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:19.618420 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:19.619992 (+ 1572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:19.621545 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:19.622331 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:19.622584 (+ 253us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:19.624217 (+ 1633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:19.624225 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:19.624244 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:19.624995 (+ 751us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:19.625095 (+ 100us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:19.625122 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:19.625288 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:19.625613 (+ 325us) server_negotiation.cc:299] Negotiation successful
0809 05:33:19.626059 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":739,"thread_start_us":487,"threads_started":1}
I20260809 05:33:19.628805 23954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b9ff640a01094ca6864568ddf78b9fb0: Bootstrap starting.
I20260809 05:33:19.633198 23954 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b9ff640a01094ca6864568ddf78b9fb0: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:19.634859 23954 log.cc:824] T 00000000000000000000000000000000 P b9ff640a01094ca6864568ddf78b9fb0: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:19.638592 23954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b9ff640a01094ca6864568ddf78b9fb0: No bootstrap required, opened a new log
I20260809 05:33:19.647708 23954 raft_consensus.cc:348] T 00000000000000000000000000000000 P b9ff640a01094ca6864568ddf78b9fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9ff640a01094ca6864568ddf78b9fb0" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 34287 } }
I20260809 05:33:19.648212 23954 raft_consensus.cc:374] T 00000000000000000000000000000000 P b9ff640a01094ca6864568ddf78b9fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:19.648293 23954 raft_consensus.cc:729] T 00000000000000000000000000000000 P b9ff640a01094ca6864568ddf78b9fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9ff640a01094ca6864568ddf78b9fb0, State: Initialized, Role: FOLLOWER
I20260809 05:33:19.649047 23954 consensus_queue.cc:260] T 00000000000000000000000000000000 P b9ff640a01094ca6864568ddf78b9fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9ff640a01094ca6864568ddf78b9fb0" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 34287 } }
I20260809 05:33:19.649353 23954 raft_consensus.cc:388] T 00000000000000000000000000000000 P b9ff640a01094ca6864568ddf78b9fb0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:33:19.649483 23954 raft_consensus.cc:482] T 00000000000000000000000000000000 P b9ff640a01094ca6864568ddf78b9fb0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:33:19.649657 23954 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b9ff640a01094ca6864568ddf78b9fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:19.652674 23954 raft_consensus.cc:504] T 00000000000000000000000000000000 P b9ff640a01094ca6864568ddf78b9fb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9ff640a01094ca6864568ddf78b9fb0" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 34287 } }
I20260809 05:33:19.653299 23954 leader_election.cc:302] T 00000000000000000000000000000000 P b9ff640a01094ca6864568ddf78b9fb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b9ff640a01094ca6864568ddf78b9fb0; no voters:
I20260809 05:33:19.653988 23954 leader_election.cc:288] T 00000000000000000000000000000000 P b9ff640a01094ca6864568ddf78b9fb0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:33:19.654191 23961 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b9ff640a01094ca6864568ddf78b9fb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:33:19.655172 23961 raft_consensus.cc:686] T 00000000000000000000000000000000 P b9ff640a01094ca6864568ddf78b9fb0 [term 1 LEADER]: Becoming Leader. State: Replica: b9ff640a01094ca6864568ddf78b9fb0, State: Running, Role: LEADER
I20260809 05:33:19.655871 23961 consensus_queue.cc:237] T 00000000000000000000000000000000 P b9ff640a01094ca6864568ddf78b9fb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9ff640a01094ca6864568ddf78b9fb0" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 34287 } }
I20260809 05:33:19.656620 23954 sys_catalog.cc:564] T 00000000000000000000000000000000 P b9ff640a01094ca6864568ddf78b9fb0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:33:19.659829 23963 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9ff640a01094ca6864568ddf78b9fb0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b9ff640a01094ca6864568ddf78b9fb0. Latest consensus state: current_term: 1 leader_uuid: "b9ff640a01094ca6864568ddf78b9fb0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9ff640a01094ca6864568ddf78b9fb0" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 34287 } } }
I20260809 05:33:19.660279 23963 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9ff640a01094ca6864568ddf78b9fb0 [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:19.661523 23962 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9ff640a01094ca6864568ddf78b9fb0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b9ff640a01094ca6864568ddf78b9fb0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9ff640a01094ca6864568ddf78b9fb0" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 34287 } } }
I20260809 05:33:19.662034 23962 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9ff640a01094ca6864568ddf78b9fb0 [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:19.663410 23971 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:33:19.670361 23971 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:33:19.681560 23971 catalog_manager.cc:1347] Generated new cluster ID: 7980387c535847a3b39c35e7d0e6fa96
I20260809 05:33:19.681734 23971 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:33:19.693867 23971 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:33:19.695580 23971 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:33:19.708585 23971 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b9ff640a01094ca6864568ddf78b9fb0: Generated new TSK 0
I20260809 05:33:19.709856 23971 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 05:33:19.718325 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:0
--local_ip_for_outbound_sockets=127.26.185.1
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:34287
--builtin_ntp_servers=127.26.185.20:44887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 05:33:20.175957 23989 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:20.176394 23989 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:20.176590 23989 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:20.185148 23989 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:20.185324 23989 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:20.185536 23989 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:33:20.196718 23989 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:44887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:34287
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:20.198612 23989 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:20.201166 23989 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:20.218583 24000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:20.218528 24002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:20.218484 23999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:20.219549 23989 server_base.cc:1034] running on GCE node
I20260809 05:33:20.220376 23989 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:20.221643 23989 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:20.222959 23989 hybrid_clock.cc:648] HybridClock initialized: now 1786253600222840 us; error 66 us; skew 500 ppm
I20260809 05:33:20.223443 23989 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 05:33:20.226420 23989 webserver.cc:460] Webserver started at http://127.26.185.1:46297/ using document root <none> and password file <none>
I20260809 05:33:20.227445 23989 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:20.227593 23989 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:20.227998 23989 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:20.231709 23989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-0/data/instance:
uuid: "c6a756c02ee64c71a0466e44cf10e498"
format_stamp: "Formatted at 2026-08-09 05:33:20 on dist-test-slave-h3ft"
server_key: "a369f0def669863afd08860feac3c2b6"
server_key_iv: "41a1d769a41399b5b7a64d974e4aff38"
server_key_version: "encryptionkey@0"
I20260809 05:33:20.232748 23989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance:
uuid: "c6a756c02ee64c71a0466e44cf10e498"
format_stamp: "Formatted at 2026-08-09 05:33:20 on dist-test-slave-h3ft"
server_key: "a369f0def669863afd08860feac3c2b6"
server_key_iv: "41a1d769a41399b5b7a64d974e4aff38"
server_key_version: "encryptionkey@0"
I20260809 05:33:20.239562 23989 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260809 05:33:20.244192 24010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:20.246109 23989 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260809 05:33:20.246347 23989 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "c6a756c02ee64c71a0466e44cf10e498"
format_stamp: "Formatted at 2026-08-09 05:33:20 on dist-test-slave-h3ft"
server_key: "a369f0def669863afd08860feac3c2b6"
server_key_iv: "41a1d769a41399b5b7a64d974e4aff38"
server_key_version: "encryptionkey@0"
I20260809 05:33:20.246647 23989 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:20.264065 23989 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:20.265240 23989 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:20.265647 23989 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:20.266974 23989 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:33:20.269062 23989 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:33:20.269210 23989 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:20.269373 23989 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:33:20.269479 23989 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:20.311216 23989 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:45321
I20260809 05:33:20.311240 24184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:45321 every 8 connection(s)
I20260809 05:33:20.312999 23989 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:33:20.313655 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 23989
I20260809 05:33:20.313961 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance
I20260809 05:33:20.314778 27364 external_mini_cluster.cc:1428] Setting key 8943daf4dc43ac10d722ac25c0e9e89c
I20260809 05:33:20.318698 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:0
--local_ip_for_outbound_sockets=127.26.185.2
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:34287
--builtin_ntp_servers=127.26.185.20:44887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 05:33:20.331171 24188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:20.316639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:40461 (local address 127.26.185.62:34287)
0809 05:33:20.317263 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:20.317270 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:20.319252 (+ 1982us) server_negotiation.cc:407] Connection header received
0809 05:33:20.321588 (+ 2336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:20.321598 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:20.321721 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:20.321866 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:20.323646 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:20.324867 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:20.326875 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:20.327688 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:20.327852 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:20.329894 (+ 2042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:20.329904 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:20.329911 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:20.329948 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:20.330015 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:20.330036 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:20.330141 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:20.330446 (+ 305us) server_negotiation.cc:299] Negotiation successful
0809 05:33:20.330618 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":462,"thread_start_us":306,"threads_started":1}
I20260809 05:33:20.332526 24190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:20.317582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:34287 (local address 127.26.185.1:40461)
0809 05:33:20.319042 (+ 1460us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:20.319103 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:20.321199 (+ 2096us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:20.322229 (+ 1030us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:20.322240 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:20.322363 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:33:20.323403 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:20.323432 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:20.325099 (+ 1667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:20.325104 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:20.326686 (+ 1582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:20.326702 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:20.328000 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:20.328007 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:20.328299 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:20.329434 (+ 1135us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 05:33:20.329437 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:33:20.329497 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 05:33:20.329618 (+ 121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:33:20.330181 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:33:20.330192 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:33:20.330200 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 05:33:20.330402 (+ 202us) client_negotiation.cc:240] Negotiation successful
0809 05:33:20.330855 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":678,"thread_start_us":445,"threads_started":1}
I20260809 05:33:20.334841 24185 heartbeater.cc:347] Connected to a master server at 127.26.185.62:34287
I20260809 05:33:20.335312 24185 heartbeater.cc:464] Registering TS with master...
I20260809 05:33:20.336427 24185 heartbeater.cc:511] Master 127.26.185.62:34287 requested a full tablet report, sending...
I20260809 05:33:20.339452 23888 ts_manager.cc:194] Registered new tserver with Master: c6a756c02ee64c71a0466e44cf10e498 (127.26.185.1:45321)
I20260809 05:33:20.341308 23888 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.185.1:40461
W20260809 05:33:20.779790 24192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:20.780205 24192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:20.780377 24192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:20.788426 24192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:20.788580 24192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:20.788785 24192 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:33:20.799363 24192 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:44887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:34287
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:20.801206 24192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:20.803658 24192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:20.822604 24205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:20.822511 24208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:20.822573 24202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:20.823602 24192 server_base.cc:1034] running on GCE node
I20260809 05:33:20.824404 24192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:20.825703 24192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:20.826978 24192 hybrid_clock.cc:648] HybridClock initialized: now 1786253600826935 us; error 90 us; skew 500 ppm
I20260809 05:33:20.827445 24192 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 05:33:20.830366 24192 webserver.cc:460] Webserver started at http://127.26.185.2:43575/ using document root <none> and password file <none>
I20260809 05:33:20.831388 24192 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:20.831539 24192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:20.831941 24192 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:20.835907 24192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-1/data/instance:
uuid: "d79ce1eadafc4801a4d3c23560978031"
format_stamp: "Formatted at 2026-08-09 05:33:20 on dist-test-slave-h3ft"
server_key: "f8f6ffcdd57b9a40af8be344076de1cc"
server_key_iv: "d03fac98be6cf98b6da787415685dc98"
server_key_version: "encryptionkey@0"
I20260809 05:33:20.836993 24192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance:
uuid: "d79ce1eadafc4801a4d3c23560978031"
format_stamp: "Formatted at 2026-08-09 05:33:20 on dist-test-slave-h3ft"
server_key: "f8f6ffcdd57b9a40af8be344076de1cc"
server_key_iv: "d03fac98be6cf98b6da787415685dc98"
server_key_version: "encryptionkey@0"
I20260809 05:33:20.845024 24192 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.005s
I20260809 05:33:20.851819 24217 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:20.854270 24192 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.002s
I20260809 05:33:20.854525 24192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "d79ce1eadafc4801a4d3c23560978031"
format_stamp: "Formatted at 2026-08-09 05:33:20 on dist-test-slave-h3ft"
server_key: "f8f6ffcdd57b9a40af8be344076de1cc"
server_key_iv: "d03fac98be6cf98b6da787415685dc98"
server_key_version: "encryptionkey@0"
I20260809 05:33:20.854885 24192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:20.873868 24192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:20.875033 24192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:20.875376 24192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:20.876792 24192 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:33:20.878666 24192 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:33:20.878806 24192 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:20.878957 24192 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:33:20.879094 24192 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260809 05:33:20.918699 24192 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:40517
I20260809 05:33:20.918740 24403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:40517 every 8 connection(s)
I20260809 05:33:20.920457 24192 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:33:20.928475 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 24192
I20260809 05:33:20.928742 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance
I20260809 05:33:20.929422 27364 external_mini_cluster.cc:1428] Setting key d2dcd5e7ff51b06a85a1c96e2d47cbe6
I20260809 05:33:20.933635 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:0
--local_ip_for_outbound_sockets=127.26.185.3
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:34287
--builtin_ntp_servers=127.26.185.20:44887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 05:33:20.938004 24406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:20.923822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:50683 (local address 127.26.185.62:34287)
0809 05:33:20.924395 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:20.924400 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:20.925855 (+ 1455us) server_negotiation.cc:407] Connection header received
0809 05:33:20.928083 (+ 2228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:20.928088 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:20.928176 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:20.928298 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:20.930166 (+ 1868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:20.931362 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:20.933990 (+ 2628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:20.934785 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:20.934952 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:20.936825 (+ 1873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:20.936834 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:20.936842 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:20.936874 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:20.936940 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:20.936960 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:20.937070 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:20.937313 (+ 243us) server_negotiation.cc:299] Negotiation successful
0809 05:33:20.937451 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":434,"thread_start_us":263,"threads_started":1}
I20260809 05:33:20.939227 24407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:20.924575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:34287 (local address 127.26.185.2:50683)
0809 05:33:20.925653 (+ 1078us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:20.925707 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:20.927718 (+ 2011us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:20.928659 (+ 941us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:20.928673 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:20.928829 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:33:20.929886 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:20.929919 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:20.931549 (+ 1630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:20.931554 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:20.933753 (+ 2199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:20.933773 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:20.935217 (+ 1444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:20.935225 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:20.935477 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:20.936409 (+ 932us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 05:33:20.936412 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:33:20.936468 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 05:33:20.936580 (+ 112us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:33:20.937071 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:33:20.937081 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:33:20.937087 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 05:33:20.937267 (+ 180us) client_negotiation.cc:240] Negotiation successful
0809 05:33:20.937676 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":317,"threads_started":1}
I20260809 05:33:20.941131 24404 heartbeater.cc:347] Connected to a master server at 127.26.185.62:34287
I20260809 05:33:20.941537 24404 heartbeater.cc:464] Registering TS with master...
I20260809 05:33:20.942530 24404 heartbeater.cc:511] Master 127.26.185.62:34287 requested a full tablet report, sending...
I20260809 05:33:20.944443 23888 ts_manager.cc:194] Registered new tserver with Master: d79ce1eadafc4801a4d3c23560978031 (127.26.185.2:40517)
I20260809 05:33:20.945437 23888 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.185.2:50683
I20260809 05:33:21.346222 24185 heartbeater.cc:503] Master 127.26.185.62:34287 was elected leader, sending a full tablet report...
W20260809 05:33:21.365924 24408 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:21.366344 24408 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:21.366524 24408 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:21.375110 24408 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:21.375257 24408 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:21.375449 24408 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:33:21.387041 24408 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:44887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:34287
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:21.388850 24408 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:21.391196 24408 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:21.407330 24422 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:21.407517 24415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:21.407548 24419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:21.408201 24408 server_base.cc:1034] running on GCE node
I20260809 05:33:21.409055 24408 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:21.410280 24408 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:21.411547 24408 hybrid_clock.cc:648] HybridClock initialized: now 1786253601411484 us; error 67 us; skew 500 ppm
I20260809 05:33:21.411938 24408 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 05:33:21.419896 24408 webserver.cc:460] Webserver started at http://127.26.185.3:45761/ using document root <none> and password file <none>
I20260809 05:33:21.420854 24408 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:21.421010 24408 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:21.421402 24408 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:21.425233 24408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-2/data/instance:
uuid: "70e7a48b166c418ab7d8ce9d366b02b0"
format_stamp: "Formatted at 2026-08-09 05:33:21 on dist-test-slave-h3ft"
server_key: "a7d1a6e4b73a2926a4921a0ad5d204dc"
server_key_iv: "1bb0a5c012fe11fa35150489b9beaccc"
server_key_version: "encryptionkey@0"
I20260809 05:33:21.426220 24408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance:
uuid: "70e7a48b166c418ab7d8ce9d366b02b0"
format_stamp: "Formatted at 2026-08-09 05:33:21 on dist-test-slave-h3ft"
server_key: "a7d1a6e4b73a2926a4921a0ad5d204dc"
server_key_iv: "1bb0a5c012fe11fa35150489b9beaccc"
server_key_version: "encryptionkey@0"
I20260809 05:33:21.433030 24408 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.009s sys 0.000s
I20260809 05:33:21.437422 24430 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:21.439389 24408 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:33:21.439615 24408 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "70e7a48b166c418ab7d8ce9d366b02b0"
format_stamp: "Formatted at 2026-08-09 05:33:21 on dist-test-slave-h3ft"
server_key: "a7d1a6e4b73a2926a4921a0ad5d204dc"
server_key_iv: "1bb0a5c012fe11fa35150489b9beaccc"
server_key_version: "encryptionkey@0"
I20260809 05:33:21.439877 24408 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:21.463668 24408 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:21.464872 24408 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:21.465289 24408 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:21.466670 24408 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:33:21.468704 24408 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:33:21.468845 24408 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:21.469003 24408 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:33:21.469101 24408 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:21.510063 24408 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:39787
I20260809 05:33:21.510203 24615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:39787 every 8 connection(s)
I20260809 05:33:21.511873 24408 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:33:21.521245 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 24408
I20260809 05:33:21.521543 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance
I20260809 05:33:21.522137 27364 external_mini_cluster.cc:1428] Setting key 8dfb8cce9d10030c8eb83020fff82ef6
I20260809 05:33:21.528350 24622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:21.515559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:59711 (local address 127.26.185.62:34287)
0809 05:33:21.516146 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:21.516152 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:21.517689 (+ 1537us) server_negotiation.cc:407] Connection header received
0809 05:33:21.520071 (+ 2382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:21.520078 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:21.520208 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:21.520368 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:21.521964 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:21.523058 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:21.524916 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:21.525406 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:21.525570 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:21.527329 (+ 1759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:21.527334 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:21.527339 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:21.527360 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:21.527408 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:21.527422 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:21.527539 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:21.527794 (+ 255us) server_negotiation.cc:299] Negotiation successful
0809 05:33:21.527924 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":446,"thread_start_us":301,"threads_started":1}
I20260809 05:33:21.529688 24625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:21.516294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:34287 (local address 127.26.185.3:59711)
0809 05:33:21.517456 (+ 1162us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:21.517506 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:21.519676 (+ 2170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:21.520704 (+ 1028us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:21.520715 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:21.520841 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:33:21.521730 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:21.521753 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:21.523237 (+ 1484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:21.523243 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:21.524739 (+ 1496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:21.524754 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:21.525693 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:21.525701 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:21.525989 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:21.526852 (+ 863us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 05:33:21.526854 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:33:21.526908 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 05:33:21.527110 (+ 202us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:33:21.527530 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:33:21.527544 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:33:21.527555 (+ 11us) client_negotiation.cc:769] Sending connection context
0809 05:33:21.527782 (+ 227us) client_negotiation.cc:240] Negotiation successful
0809 05:33:21.528319 (+ 537us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"thread_start_us":343,"threads_started":1}
I20260809 05:33:21.531455 24618 heartbeater.cc:347] Connected to a master server at 127.26.185.62:34287
I20260809 05:33:21.531881 24618 heartbeater.cc:464] Registering TS with master...
I20260809 05:33:21.532914 24618 heartbeater.cc:511] Master 127.26.185.62:34287 requested a full tablet report, sending...
I20260809 05:33:21.534795 23888 ts_manager.cc:194] Registered new tserver with Master: 70e7a48b166c418ab7d8ce9d366b02b0 (127.26.185.3:39787)
I20260809 05:33:21.535877 23888 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.185.3:59711
I20260809 05:33:21.538849 27364 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 05:33:21.551563 24622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:21.544435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55052 (local address 127.26.185.62:34287)
0809 05:33:21.544641 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:21.544646 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:21.545289 (+ 643us) server_negotiation.cc:407] Connection header received
0809 05:33:21.545527 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:21.545532 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:21.545613 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:21.545711 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:21.546254 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:21.547100 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:21.548661 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:21.549134 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:21.549240 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:21.550654 (+ 1414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:21.550659 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:21.550662 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:21.550685 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:21.550722 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:21.550735 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:21.550864 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:21.551167 (+ 303us) server_negotiation.cc:299] Negotiation successful
0809 05:33:21.551228 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 05:33:21.557124 23888 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55052:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 05:33:21.566323 23888 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 05:33:21.598630 24644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:21.582714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54414 (local address 127.26.185.3:39787)
0809 05:33:21.583561 (+ 847us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:21.583579 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:21.587805 (+ 4226us) server_negotiation.cc:407] Connection header received
0809 05:33:21.588296 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:21.588304 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:21.588558 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:21.588813 (+ 255us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:21.590714 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:21.592616 (+ 1902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:21.595593 (+ 2977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:21.597193 (+ 1600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:21.597352 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:21.597773 (+ 421us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:21.598008 (+ 235us) server_negotiation.cc:299] Negotiation successful
0809 05:33:21.598215 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":641,"thread_start_us":460,"threads_started":1}
I20260809 05:33:21.598686 24643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:21.583158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:45321 (local address 127.0.0.1:51168)
0809 05:33:21.589131 (+ 5973us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:21.589149 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:21.589772 (+ 623us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:21.590526 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:21.590531 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:21.590556 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:21.590986 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:21.591041 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:21.593357 (+ 2316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:21.593362 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:21.595684 (+ 2322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:21.595698 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:21.597646 (+ 1948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:21.597653 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:21.597869 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:21.597916 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 05:33:21.597992 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 05:33:21.598171 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5819,"mutex_wait_us":11,"spinlock_wait_cycles":1114368,"thread_start_us":4028,"threads_started":1}
I20260809 05:33:21.599900 24645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:21.582453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:39787 (local address 127.0.0.1:54414)
0809 05:33:21.587598 (+ 5145us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:21.587651 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:21.587915 (+ 264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:21.588847 (+ 932us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:21.588855 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:21.589394 (+ 539us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:21.590382 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:21.590405 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:21.592773 (+ 2368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:21.592782 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:21.595374 (+ 2592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:21.595388 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:21.597415 (+ 2027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:21.597421 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:21.597651 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:21.597782 (+ 131us) client_negotiation.cc:769] Sending connection context
0809 05:33:21.597934 (+ 152us) client_negotiation.cc:240] Negotiation successful
0809 05:33:21.598172 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4874,"mutex_wait_us":446,"thread_start_us":5541,"threads_started":1}
I20260809 05:33:21.600234 24649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:21.589338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:40517 (local address 127.0.0.1:59624)
0809 05:33:21.591658 (+ 2320us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:21.591679 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:21.591813 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:21.592424 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:21.592429 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:21.592454 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:21.592919 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:21.592931 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:21.594911 (+ 1980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:21.594916 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:21.596696 (+ 1780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:21.596708 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:21.598761 (+ 2053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:21.598769 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:21.599620 (+ 851us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:21.599653 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 05:33:21.599750 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 05:33:21.599920 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2199,"thread_start_us":2064,"threads_started":1}
I20260809 05:33:21.600395 24648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:21.589613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59624 (local address 127.26.185.2:40517)
0809 05:33:21.590349 (+ 736us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:21.590377 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:21.591802 (+ 1425us) server_negotiation.cc:407] Connection header received
0809 05:33:21.591972 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:21.591979 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:21.592205 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:21.592409 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:21.593122 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:21.594757 (+ 1635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:21.596903 (+ 2146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:21.598239 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:21.598371 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:21.598614 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:21.599816 (+ 1202us) server_negotiation.cc:299] Negotiation successful
0809 05:33:21.600011 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":569,"thread_start_us":429,"threads_started":1}
I20260809 05:33:21.600983 24647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:21.583910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51168 (local address 127.26.185.1:45321)
0809 05:33:21.584605 (+ 695us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:21.584612 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:21.589734 (+ 5122us) server_negotiation.cc:407] Connection header received
0809 05:33:21.589999 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:21.590012 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:21.590290 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:21.590547 (+ 257us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:21.591207 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:21.593180 (+ 1973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:21.595902 (+ 2722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:21.597409 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:21.598944 (+ 1535us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:21.599268 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:21.599350 (+ 82us) server_negotiation.cc:299] Negotiation successful
0809 05:33:21.600594 (+ 1244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":373,"threads_started":1}
I20260809 05:33:21.604827 24508 tablet_service.cc:1467] Processing CreateTablet for tablet 8db68f522bc240638b63238b75d48e14 (DEFAULT_TABLE table=test-table [id=ec5b85415fe74608aa074b66d57e6a9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:33:21.604843 24086 tablet_service.cc:1467] Processing CreateTablet for tablet 8db68f522bc240638b63238b75d48e14 (DEFAULT_TABLE table=test-table [id=ec5b85415fe74608aa074b66d57e6a9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:33:21.604832 24293 tablet_service.cc:1467] Processing CreateTablet for tablet 8db68f522bc240638b63238b75d48e14 (DEFAULT_TABLE table=test-table [id=ec5b85415fe74608aa074b66d57e6a9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:33:21.606582 24293 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8db68f522bc240638b63238b75d48e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:21.606590 24086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8db68f522bc240638b63238b75d48e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:21.606588 24508 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8db68f522bc240638b63238b75d48e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:21.627242 24653 tablet_bootstrap.cc:492] T 8db68f522bc240638b63238b75d48e14 P 70e7a48b166c418ab7d8ce9d366b02b0: Bootstrap starting.
I20260809 05:33:21.630947 24654 tablet_bootstrap.cc:492] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031: Bootstrap starting.
I20260809 05:33:21.636430 24653 tablet_bootstrap.cc:654] T 8db68f522bc240638b63238b75d48e14 P 70e7a48b166c418ab7d8ce9d366b02b0: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:21.636544 24654 tablet_bootstrap.cc:654] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:21.638005 24654 log.cc:824] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:21.638111 24650 tablet_bootstrap.cc:492] T 8db68f522bc240638b63238b75d48e14 P c6a756c02ee64c71a0466e44cf10e498: Bootstrap starting.
I20260809 05:33:21.640166 24653 log.cc:824] T 8db68f522bc240638b63238b75d48e14 P 70e7a48b166c418ab7d8ce9d366b02b0: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:21.642982 24650 tablet_bootstrap.cc:654] T 8db68f522bc240638b63238b75d48e14 P c6a756c02ee64c71a0466e44cf10e498: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:21.643934 24654 tablet_bootstrap.cc:492] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031: No bootstrap required, opened a new log
I20260809 05:33:21.644296 24654 ts_tablet_manager.cc:1397] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.003s
I20260809 05:33:21.644403 24653 tablet_bootstrap.cc:492] T 8db68f522bc240638b63238b75d48e14 P 70e7a48b166c418ab7d8ce9d366b02b0: No bootstrap required, opened a new log
I20260809 05:33:21.644621 24650 log.cc:824] T 8db68f522bc240638b63238b75d48e14 P c6a756c02ee64c71a0466e44cf10e498: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:21.644732 24653 ts_tablet_manager.cc:1397] T 8db68f522bc240638b63238b75d48e14 P 70e7a48b166c418ab7d8ce9d366b02b0: Time spent bootstrapping tablet: real 0.018s user 0.011s sys 0.000s
I20260809 05:33:21.649060 24650 tablet_bootstrap.cc:492] T 8db68f522bc240638b63238b75d48e14 P c6a756c02ee64c71a0466e44cf10e498: No bootstrap required, opened a new log
I20260809 05:33:21.649411 24650 ts_tablet_manager.cc:1397] T 8db68f522bc240638b63238b75d48e14 P c6a756c02ee64c71a0466e44cf10e498: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.004s
I20260809 05:33:21.653736 24654 raft_consensus.cc:348] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e7a48b166c418ab7d8ce9d366b02b0" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 39787 } } peers { permanent_uuid: "d79ce1eadafc4801a4d3c23560978031" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 40517 } } peers { permanent_uuid: "c6a756c02ee64c71a0466e44cf10e498" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 45321 } }
I20260809 05:33:21.654237 24654 raft_consensus.cc:374] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:21.654381 24654 raft_consensus.cc:729] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d79ce1eadafc4801a4d3c23560978031, State: Initialized, Role: FOLLOWER
I20260809 05:33:21.655210 24654 consensus_queue.cc:260] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e7a48b166c418ab7d8ce9d366b02b0" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 39787 } } peers { permanent_uuid: "d79ce1eadafc4801a4d3c23560978031" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 40517 } } peers { permanent_uuid: "c6a756c02ee64c71a0466e44cf10e498" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 45321 } }
I20260809 05:33:21.656643 24404 heartbeater.cc:503] Master 127.26.185.62:34287 was elected leader, sending a full tablet report...
I20260809 05:33:21.656495 24653 raft_consensus.cc:348] T 8db68f522bc240638b63238b75d48e14 P 70e7a48b166c418ab7d8ce9d366b02b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e7a48b166c418ab7d8ce9d366b02b0" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 39787 } } peers { permanent_uuid: "d79ce1eadafc4801a4d3c23560978031" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 40517 } } peers { permanent_uuid: "c6a756c02ee64c71a0466e44cf10e498" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 45321 } }
I20260809 05:33:21.657112 24653 raft_consensus.cc:374] T 8db68f522bc240638b63238b75d48e14 P 70e7a48b166c418ab7d8ce9d366b02b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:21.657292 24653 raft_consensus.cc:729] T 8db68f522bc240638b63238b75d48e14 P 70e7a48b166c418ab7d8ce9d366b02b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e7a48b166c418ab7d8ce9d366b02b0, State: Initialized, Role: FOLLOWER
I20260809 05:33:21.657488 24654 ts_tablet_manager.cc:1428] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031: Time spent starting tablet: real 0.013s user 0.011s sys 0.000s
I20260809 05:33:21.658123 24653 consensus_queue.cc:260] T 8db68f522bc240638b63238b75d48e14 P 70e7a48b166c418ab7d8ce9d366b02b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e7a48b166c418ab7d8ce9d366b02b0" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 39787 } } peers { permanent_uuid: "d79ce1eadafc4801a4d3c23560978031" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 40517 } } peers { permanent_uuid: "c6a756c02ee64c71a0466e44cf10e498" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 45321 } }
I20260809 05:33:21.659583 24618 heartbeater.cc:503] Master 127.26.185.62:34287 was elected leader, sending a full tablet report...
I20260809 05:33:21.660283 24653 ts_tablet_manager.cc:1428] T 8db68f522bc240638b63238b75d48e14 P 70e7a48b166c418ab7d8ce9d366b02b0: Time spent starting tablet: real 0.015s user 0.009s sys 0.007s
I20260809 05:33:21.662607 24650 raft_consensus.cc:348] T 8db68f522bc240638b63238b75d48e14 P c6a756c02ee64c71a0466e44cf10e498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e7a48b166c418ab7d8ce9d366b02b0" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 39787 } } peers { permanent_uuid: "d79ce1eadafc4801a4d3c23560978031" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 40517 } } peers { permanent_uuid: "c6a756c02ee64c71a0466e44cf10e498" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 45321 } }
I20260809 05:33:21.663242 24650 raft_consensus.cc:374] T 8db68f522bc240638b63238b75d48e14 P c6a756c02ee64c71a0466e44cf10e498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:21.663374 24650 raft_consensus.cc:729] T 8db68f522bc240638b63238b75d48e14 P c6a756c02ee64c71a0466e44cf10e498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a756c02ee64c71a0466e44cf10e498, State: Initialized, Role: FOLLOWER
I20260809 05:33:21.664161 24650 consensus_queue.cc:260] T 8db68f522bc240638b63238b75d48e14 P c6a756c02ee64c71a0466e44cf10e498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e7a48b166c418ab7d8ce9d366b02b0" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 39787 } } peers { permanent_uuid: "d79ce1eadafc4801a4d3c23560978031" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 40517 } } peers { permanent_uuid: "c6a756c02ee64c71a0466e44cf10e498" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 45321 } }
I20260809 05:33:21.666818 24650 ts_tablet_manager.cc:1428] T 8db68f522bc240638b63238b75d48e14 P c6a756c02ee64c71a0466e44cf10e498: Time spent starting tablet: real 0.017s user 0.014s sys 0.003s
W20260809 05:33:21.673022 24405 tablet.cc:2369] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:33:21.674562 24659 raft_consensus.cc:482] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:33:21.674880 24659 raft_consensus.cc:504] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e7a48b166c418ab7d8ce9d366b02b0" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 39787 } } peers { permanent_uuid: "d79ce1eadafc4801a4d3c23560978031" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 40517 } } peers { permanent_uuid: "c6a756c02ee64c71a0466e44cf10e498" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 45321 } }
I20260809 05:33:21.677206 24659 leader_election.cc:288] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70e7a48b166c418ab7d8ce9d366b02b0 (127.26.185.3:39787), c6a756c02ee64c71a0466e44cf10e498 (127.26.185.1:45321)
I20260809 05:33:21.686480 24647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:21.677795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:34993 (local address 127.26.185.1:45321)
0809 05:33:21.678070 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:21.678079 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:21.679196 (+ 1117us) server_negotiation.cc:407] Connection header received
0809 05:33:21.679485 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:21.679497 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:21.679597 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:21.679656 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:21.680625 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:21.681725 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:21.684191 (+ 2466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:21.685358 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:21.685590 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:21.685682 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:21.685995 (+ 313us) server_negotiation.cc:299] Negotiation successful
0809 05:33:21.686185 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260809 05:33:21.686606 24667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:21.677661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:45321 (local address 127.26.185.2:34993)
0809 05:33:21.678992 (+ 1331us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:21.679050 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:21.679267 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:21.679844 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:21.679848 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:21.679949 (+ 101us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:21.680464 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:21.680473 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:21.681875 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:21.681879 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:21.683915 (+ 2036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:21.683934 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:21.685620 (+ 1686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:21.685628 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:21.685805 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:21.685835 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 05:33:21.685959 (+ 124us) client_negotiation.cc:240] Negotiation successful
0809 05:33:21.686135 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1150,"mutex_wait_us":46,"spinlock_wait_cycles":25472,"thread_start_us":799,"threads_started":1}
I20260809 05:33:21.687848 24669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:21.677665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:39787 (local address 127.26.185.2:52273)
0809 05:33:21.679179 (+ 1514us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:21.679199 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:21.679350 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:21.679743 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:21.679748 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:21.679774 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:21.680261 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:21.680275 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:21.683150 (+ 2875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:21.683158 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:21.685235 (+ 2077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:21.685254 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:21.686925 (+ 1671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:21.686933 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:21.687201 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:21.687251 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 05:33:21.687359 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 05:33:21.687518 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1370,"mutex_wait_us":119,"thread_start_us":1021,"threads_started":1}
I20260809 05:33:21.687880 24644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:21.677982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:52273 (local address 127.26.185.3:39787)
0809 05:33:21.678271 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:21.678280 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:21.679301 (+ 1021us) server_negotiation.cc:407] Connection header received
0809 05:33:21.679537 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:21.679542 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:21.679616 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:21.679726 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:21.680478 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:21.681725 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:21.685494 (+ 3769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:21.686506 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:21.686751 (+ 245us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:21.686841 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:21.687415 (+ 574us) server_negotiation.cc:299] Negotiation successful
0809 05:33:21.687574 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260809 05:33:21.688320 24115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8db68f522bc240638b63238b75d48e14" candidate_uuid: "d79ce1eadafc4801a4d3c23560978031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a756c02ee64c71a0466e44cf10e498" is_pre_election: true
I20260809 05:33:21.688963 24115 raft_consensus.cc:2454] T 8db68f522bc240638b63238b75d48e14 P c6a756c02ee64c71a0466e44cf10e498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d79ce1eadafc4801a4d3c23560978031 in term 0.
I20260809 05:33:21.689767 24220 leader_election.cc:302] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a756c02ee64c71a0466e44cf10e498, d79ce1eadafc4801a4d3c23560978031; no voters:
I20260809 05:33:21.690335 24659 raft_consensus.cc:2781] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:33:21.690572 24659 raft_consensus.cc:482] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:33:21.690707 24659 raft_consensus.cc:3037] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:21.690469 24543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8db68f522bc240638b63238b75d48e14" candidate_uuid: "d79ce1eadafc4801a4d3c23560978031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7a48b166c418ab7d8ce9d366b02b0" is_pre_election: true
I20260809 05:33:21.691270 24543 raft_consensus.cc:2454] T 8db68f522bc240638b63238b75d48e14 P 70e7a48b166c418ab7d8ce9d366b02b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d79ce1eadafc4801a4d3c23560978031 in term 0.
I20260809 05:33:21.693886 24659 raft_consensus.cc:504] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e7a48b166c418ab7d8ce9d366b02b0" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 39787 } } peers { permanent_uuid: "d79ce1eadafc4801a4d3c23560978031" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 40517 } } peers { permanent_uuid: "c6a756c02ee64c71a0466e44cf10e498" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 45321 } }
I20260809 05:33:21.694836 24659 leader_election.cc:288] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031 [CANDIDATE]: Term 1 election: Requested vote from peers 70e7a48b166c418ab7d8ce9d366b02b0 (127.26.185.3:39787), c6a756c02ee64c71a0466e44cf10e498 (127.26.185.1:45321)
I20260809 05:33:21.695243 24543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8db68f522bc240638b63238b75d48e14" candidate_uuid: "d79ce1eadafc4801a4d3c23560978031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e7a48b166c418ab7d8ce9d366b02b0"
I20260809 05:33:21.695322 24115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8db68f522bc240638b63238b75d48e14" candidate_uuid: "d79ce1eadafc4801a4d3c23560978031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a756c02ee64c71a0466e44cf10e498"
I20260809 05:33:21.695501 24543 raft_consensus.cc:3037] T 8db68f522bc240638b63238b75d48e14 P 70e7a48b166c418ab7d8ce9d366b02b0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:21.695631 24115 raft_consensus.cc:3037] T 8db68f522bc240638b63238b75d48e14 P c6a756c02ee64c71a0466e44cf10e498 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:21.698304 24543 raft_consensus.cc:2454] T 8db68f522bc240638b63238b75d48e14 P 70e7a48b166c418ab7d8ce9d366b02b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d79ce1eadafc4801a4d3c23560978031 in term 1.
I20260809 05:33:21.698305 24115 raft_consensus.cc:2454] T 8db68f522bc240638b63238b75d48e14 P c6a756c02ee64c71a0466e44cf10e498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d79ce1eadafc4801a4d3c23560978031 in term 1.
I20260809 05:33:21.698947 24219 leader_election.cc:302] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70e7a48b166c418ab7d8ce9d366b02b0, d79ce1eadafc4801a4d3c23560978031; no voters:
I20260809 05:33:21.699499 24659 raft_consensus.cc:2781] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:33:21.700088 24659 raft_consensus.cc:686] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031 [term 1 LEADER]: Becoming Leader. State: Replica: d79ce1eadafc4801a4d3c23560978031, State: Running, Role: LEADER
I20260809 05:33:21.700747 24659 consensus_queue.cc:237] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e7a48b166c418ab7d8ce9d366b02b0" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 39787 } } peers { permanent_uuid: "d79ce1eadafc4801a4d3c23560978031" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 40517 } } peers { permanent_uuid: "c6a756c02ee64c71a0466e44cf10e498" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 45321 } }
I20260809 05:33:21.707410 23886 catalog_manager.cc:5495] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031 reported cstate change: term changed from 0 to 1, leader changed from <none> to d79ce1eadafc4801a4d3c23560978031 (127.26.185.2). New cstate: current_term: 1 leader_uuid: "d79ce1eadafc4801a4d3c23560978031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70e7a48b166c418ab7d8ce9d366b02b0" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d79ce1eadafc4801a4d3c23560978031" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 40517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a756c02ee64c71a0466e44cf10e498" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 45321 } health_report { overall_health: UNKNOWN } } }
I20260809 05:33:21.760567 24648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:21.752402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59628 (local address 127.26.185.2:40517)
0809 05:33:21.752770 (+ 368us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:21.752776 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:21.752799 (+ 23us) server_negotiation.cc:407] Connection header received
0809 05:33:21.752926 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:21.752931 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:21.753113 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:21.753299 (+ 186us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:33:21.753846 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:21.754715 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:21.756677 (+ 1962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:21.757203 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:21.757429 (+ 226us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:21.758350 (+ 921us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:33:21.759219 (+ 869us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:33:21.759481 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:21.759875 (+ 394us) server_negotiation.cc:299] Negotiation successful
0809 05:33:21.759940 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175}
W20260809 05:33:21.764348 24621 tablet.cc:2369] T 8db68f522bc240638b63238b75d48e14 P 70e7a48b166c418ab7d8ce9d366b02b0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:33:21.773969 24543 raft_consensus.cc:1261] T 8db68f522bc240638b63238b75d48e14 P 70e7a48b166c418ab7d8ce9d366b02b0 [term 1 FOLLOWER]: Refusing update from remote peer d79ce1eadafc4801a4d3c23560978031: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:33:21.773969 24115 raft_consensus.cc:1261] T 8db68f522bc240638b63238b75d48e14 P c6a756c02ee64c71a0466e44cf10e498 [term 1 FOLLOWER]: Refusing update from remote peer d79ce1eadafc4801a4d3c23560978031: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:33:21.775400 24670 consensus_queue.cc:1035] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a756c02ee64c71a0466e44cf10e498" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 45321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:33:21.775812 24659 consensus_queue.cc:1035] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70e7a48b166c418ab7d8ce9d366b02b0" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:33:21.790201 24677 mvcc.cc:205] Tried to move back new op lower bound from 7316494752851218432 to 7316494752571285504. Current Snapshot: MvccSnapshot[applied={T|T < 7316494752851218432}]
I20260809 05:33:21.809778 23888 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55052:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:33:21.810233 23888 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55052:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:33:21.816396 23888 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b9ff640a01094ca6864568ddf78b9fb0: Sending DeleteTablet for 3 replicas of tablet 8db68f522bc240638b63238b75d48e14
I20260809 05:33:21.818137 24293 tablet_service.cc:1514] Processing DeleteTablet for tablet 8db68f522bc240638b63238b75d48e14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:33:21 UTC) from {username='slave'} at 127.0.0.1:59624
I20260809 05:33:21.818132 24086 tablet_service.cc:1514] Processing DeleteTablet for tablet 8db68f522bc240638b63238b75d48e14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:33:21 UTC) from {username='slave'} at 127.0.0.1:51168
I20260809 05:33:21.819475 24688 tablet_replica.cc:330] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031: stopping tablet replica
I20260809 05:33:21.819609 24508 tablet_service.cc:1514] Processing DeleteTablet for tablet 8db68f522bc240638b63238b75d48e14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:33:21 UTC) from {username='slave'} at 127.0.0.1:54414
I20260809 05:33:21.820252 24688 raft_consensus.cc:2229] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031 [term 1 LEADER]: Raft consensus shutting down.
I20260809 05:33:21.821185 24688 raft_consensus.cc:2258] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:33:21.822110 24689 tablet_replica.cc:330] T 8db68f522bc240638b63238b75d48e14 P c6a756c02ee64c71a0466e44cf10e498: stopping tablet replica
I20260809 05:33:21.822682 24689 raft_consensus.cc:2229] T 8db68f522bc240638b63238b75d48e14 P c6a756c02ee64c71a0466e44cf10e498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:33:21.823421 24689 raft_consensus.cc:2258] T 8db68f522bc240638b63238b75d48e14 P c6a756c02ee64c71a0466e44cf10e498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:33:21.824311 24688 ts_tablet_manager.cc:1905] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:33:21.824883 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 23989
I20260809 05:33:21.825011 24692 tablet_replica.cc:330] T 8db68f522bc240638b63238b75d48e14 P 70e7a48b166c418ab7d8ce9d366b02b0: stopping tablet replica
I20260809 05:33:21.825531 24692 raft_consensus.cc:2229] T 8db68f522bc240638b63238b75d48e14 P 70e7a48b166c418ab7d8ce9d366b02b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:33:21.826104 24692 raft_consensus.cc:2258] T 8db68f522bc240638b63238b75d48e14 P 70e7a48b166c418ab7d8ce9d366b02b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:33:21.826426 24689 ts_tablet_manager.cc:1905] T 8db68f522bc240638b63238b75d48e14 P c6a756c02ee64c71a0466e44cf10e498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:33:21.835624 24688 ts_tablet_manager.cc:1918] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:33:21.835937 24688 log.cc:1196] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-1/wal/wals/8db68f522bc240638b63238b75d48e14
I20260809 05:33:21.836469 24689 ts_tablet_manager.cc:1918] T 8db68f522bc240638b63238b75d48e14 P c6a756c02ee64c71a0466e44cf10e498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:33:21.836647 24688 ts_tablet_manager.cc:1939] T 8db68f522bc240638b63238b75d48e14 P d79ce1eadafc4801a4d3c23560978031: Deleting consensus metadata
I20260809 05:33:21.836773 24689 log.cc:1196] T 8db68f522bc240638b63238b75d48e14 P c6a756c02ee64c71a0466e44cf10e498: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-0/wal/wals/8db68f522bc240638b63238b75d48e14
I20260809 05:33:21.838675 24689 ts_tablet_manager.cc:1939] T 8db68f522bc240638b63238b75d48e14 P c6a756c02ee64c71a0466e44cf10e498: Deleting consensus metadata
I20260809 05:33:21.839491 24692 ts_tablet_manager.cc:1905] T 8db68f522bc240638b63238b75d48e14 P 70e7a48b166c418ab7d8ce9d366b02b0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:33:21.841436 23866 catalog_manager.cc:4841] TS c6a756c02ee64c71a0466e44cf10e498 (127.26.185.1:45321): tablet 8db68f522bc240638b63238b75d48e14 (table test-table [id=ec5b85415fe74608aa074b66d57e6a9b]) successfully deleted
I20260809 05:33:21.848418 24692 ts_tablet_manager.cc:1918] T 8db68f522bc240638b63238b75d48e14 P 70e7a48b166c418ab7d8ce9d366b02b0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:33:21.848724 24692 log.cc:1196] T 8db68f522bc240638b63238b75d48e14 P 70e7a48b166c418ab7d8ce9d366b02b0: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786253234117492-27364-0/minicluster-data/ts-2/wal/wals/8db68f522bc240638b63238b75d48e14
I20260809 05:33:21.849413 24692 ts_tablet_manager.cc:1939] T 8db68f522bc240638b63238b75d48e14 P 70e7a48b166c418ab7d8ce9d366b02b0: Deleting consensus metadata
I20260809 05:33:21.849677 23865 catalog_manager.cc:4841] TS d79ce1eadafc4801a4d3c23560978031 (127.26.185.2:40517): tablet 8db68f522bc240638b63238b75d48e14 (table test-table [id=ec5b85415fe74608aa074b66d57e6a9b]) successfully deleted
I20260809 05:33:21.850965 24647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:21.826918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51172 (local address 127.26.185.1:45321)
0809 05:33:21.827170 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:21.827181 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:21.839635 (+ 12454us) server_negotiation.cc:407] Connection header received
0809 05:33:21.840366 (+ 731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:21.840375 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:21.840532 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:21.840637 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:21.842426 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:21.843391 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:21.845153 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:21.845795 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:21.845963 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:21.847632 (+ 1669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:21.847652 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:21.847682 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:21.849017 (+ 1335us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:21.849112 (+ 95us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:21.849154 (+ 42us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:21.850042 (+ 888us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:21.850319 (+ 277us) server_negotiation.cc:299] Negotiation successful
0809 05:33:21.850492 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260809 05:33:21.852080 23865 catalog_manager.cc:4841] TS 70e7a48b166c418ab7d8ce9d366b02b0 (127.26.185.3:39787): tablet 8db68f522bc240638b63238b75d48e14 (table test-table [id=ec5b85415fe74608aa074b66d57e6a9b]) successfully deleted
I20260809 05:33:21.852319 24177 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:33:21.956281 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 23989
I20260809 05:33:22.000600 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 24192
I20260809 05:33:22.010779 24648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:22.001766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59638 (local address 127.26.185.2:40517)
0809 05:33:22.002044 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:22.002052 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:22.002077 (+ 25us) server_negotiation.cc:407] Connection header received
0809 05:33:22.002219 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:22.002225 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:22.002381 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:22.002509 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:22.003270 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:22.004597 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:22.006218 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:22.006973 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:22.007230 (+ 257us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:22.008628 (+ 1398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:22.008642 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:22.008670 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:22.009760 (+ 1090us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:22.009842 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:22.009880 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:22.010011 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:22.010189 (+ 178us) server_negotiation.cc:299] Negotiation successful
0809 05:33:22.010322 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260809 05:33:22.011824 24395 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:33:22.143998 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 24192
I20260809 05:33:22.182268 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 24408
I20260809 05:33:22.190582 24644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:22.183371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54422 (local address 127.26.185.3:39787)
0809 05:33:22.183612 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:22.183618 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:22.183740 (+ 122us) server_negotiation.cc:407] Connection header received
0809 05:33:22.183908 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:22.183912 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:22.184024 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:22.184146 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:22.184585 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:22.185472 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:22.187077 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:22.187539 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:22.187647 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:22.188920 (+ 1273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:22.188931 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:22.188953 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:22.189736 (+ 783us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:22.189800 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:22.189823 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:22.189959 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:22.190116 (+ 157us) server_negotiation.cc:299] Negotiation successful
0809 05:33:22.190239 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 05:33:22.191428 24607 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:33:22.288805 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 24408
I20260809 05:33:22.318840 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 23834
I20260809 05:33:22.320295 23943 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:33:22.448709 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 23834
2026-08-09T05:33:22Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (3522 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:33:22 dist-test-slave-h3ft krb5kdc[24716](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:33:22 dist-test-slave-h3ft krb5kdc[24716](info): set up 2 sockets
Aug 09 05:33:22 dist-test-slave-h3ft krb5kdc[24716](info): commencing operation
krb5kdc: starting...
W20260809 05:33:23.897068 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.387s user 0.007s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:33:24 dist-test-slave-h3ft krb5kdc[24716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253604, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:33:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:33:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
I20260809 05:33:24.316184 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:40291
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:44825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:40291
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:33:24.748978 24732 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:24.749387 24732 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:24.749552 24732 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:24.757681 24732 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:33:24.757825 24732 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:24.757926 24732 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:24.758029 24732 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:33:24.758102 24732 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:33:24.769548 24732 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:44825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:40291
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:40291
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:24.771539 24732 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:24.773409 24732 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:24.787974 24739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:24.788055 24746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:24.788055 24740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:24.789716 24732 server_base.cc:1034] running on GCE node
I20260809 05:33:24.790795 24732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:24.792599 24732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:24.793866 24732 hybrid_clock.cc:648] HybridClock initialized: now 1786253604793799 us; error 80 us; skew 500 ppm
I20260809 05:33:24.794287 24732 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:33:24 dist-test-slave-h3ft krb5kdc[24716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253604, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:33:24.798215 24732 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:33:24.800211 24732 webserver.cc:460] Webserver started at http://127.26.185.62:35077/ using document root <none> and password file <none>
I20260809 05:33:24.801132 24732 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:24.801298 24732 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:24.801682 24732 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:24.805433 24732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "b60866d325504f37981c10c34c471ed9"
format_stamp: "Formatted at 2026-08-09 05:33:24 on dist-test-slave-h3ft"
server_key: "56a15e96101bdaff9fe710a0ea2c51c4"
server_key_iv: "cdef8136b4846bf9af7796defa288a63"
server_key_version: "encryptionkey@0"
I20260809 05:33:24.806339 24732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "b60866d325504f37981c10c34c471ed9"
format_stamp: "Formatted at 2026-08-09 05:33:24 on dist-test-slave-h3ft"
server_key: "56a15e96101bdaff9fe710a0ea2c51c4"
server_key_iv: "cdef8136b4846bf9af7796defa288a63"
server_key_version: "encryptionkey@0"
I20260809 05:33:24.812686 24732 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260809 05:33:24.816839 24762 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:24.818456 24732 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.003s
I20260809 05:33:24.818698 24732 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "b60866d325504f37981c10c34c471ed9"
format_stamp: "Formatted at 2026-08-09 05:33:24 on dist-test-slave-h3ft"
server_key: "56a15e96101bdaff9fe710a0ea2c51c4"
server_key_iv: "cdef8136b4846bf9af7796defa288a63"
server_key_version: "encryptionkey@0"
I20260809 05:33:24.818943 24732 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:24.832759 24732 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:24.838378 24732 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:24.838732 24732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:24.864508 24732 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:40291
I20260809 05:33:24.864550 24856 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:40291 every 8 connection(s)
I20260809 05:33:24.866333 24732 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:33:24.871860 24857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:24.872480 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 24732
I20260809 05:33:24.872730 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:33:24.873483 27364 external_mini_cluster.cc:1428] Setting key 7c8b74bc3a31f0d5b5cd3a8ac0067bee
I20260809 05:33:24.889178 24857 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b60866d325504f37981c10c34c471ed9: Bootstrap starting.
Aug 09 05:33:24 dist-test-slave-h3ft krb5kdc[24716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253604, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:33:24.893971 24857 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b60866d325504f37981c10c34c471ed9: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:24.895711 24857 log.cc:824] T 00000000000000000000000000000000 P b60866d325504f37981c10c34c471ed9: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:24.900054 24857 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b60866d325504f37981c10c34c471ed9: No bootstrap required, opened a new log
I20260809 05:33:24.903398 24860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:24.875830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46762 (local address 127.26.185.62:40291)
0809 05:33:24.876848 (+ 1018us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:24.876863 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:24.876918 (+ 55us) server_negotiation.cc:407] Connection header received
0809 05:33:24.879479 (+ 2561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:24.879513 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:24.880020 (+ 507us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:24.880449 (+ 429us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:24.882641 (+ 2192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:24.884176 (+ 1535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:24.886652 (+ 2476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:24.887469 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:24.887610 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:24.893192 (+ 5582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:24.893204 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:24.893225 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:24.893274 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:24.897855 (+ 4581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:24.898670 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:24.898679 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:24.898689 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:24.898935 (+ 246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:24.899488 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:24.899494 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:24.899497 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:24.900284 (+ 787us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:24.900642 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:24.901121 (+ 479us) server_negotiation.cc:299] Negotiation successful
0809 05:33:24.901659 (+ 538us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":754,"thread_start_us":474,"threads_started":1}
I20260809 05:33:24.910243 24857 raft_consensus.cc:348] T 00000000000000000000000000000000 P b60866d325504f37981c10c34c471ed9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b60866d325504f37981c10c34c471ed9" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 40291 } }
I20260809 05:33:24.910691 24857 raft_consensus.cc:374] T 00000000000000000000000000000000 P b60866d325504f37981c10c34c471ed9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:24.910820 24857 raft_consensus.cc:729] T 00000000000000000000000000000000 P b60866d325504f37981c10c34c471ed9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b60866d325504f37981c10c34c471ed9, State: Initialized, Role: FOLLOWER
I20260809 05:33:24.911573 24857 consensus_queue.cc:260] T 00000000000000000000000000000000 P b60866d325504f37981c10c34c471ed9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b60866d325504f37981c10c34c471ed9" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 40291 } }
I20260809 05:33:24.911873 24857 raft_consensus.cc:388] T 00000000000000000000000000000000 P b60866d325504f37981c10c34c471ed9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:33:24.912034 24857 raft_consensus.cc:482] T 00000000000000000000000000000000 P b60866d325504f37981c10c34c471ed9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:33:24.912232 24857 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b60866d325504f37981c10c34c471ed9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:24.915036 24857 raft_consensus.cc:504] T 00000000000000000000000000000000 P b60866d325504f37981c10c34c471ed9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b60866d325504f37981c10c34c471ed9" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 40291 } }
I20260809 05:33:24.915649 24857 leader_election.cc:302] T 00000000000000000000000000000000 P b60866d325504f37981c10c34c471ed9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b60866d325504f37981c10c34c471ed9; no voters:
I20260809 05:33:24.916400 24857 leader_election.cc:288] T 00000000000000000000000000000000 P b60866d325504f37981c10c34c471ed9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:33:24.916603 24862 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b60866d325504f37981c10c34c471ed9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:33:24.917438 24862 raft_consensus.cc:686] T 00000000000000000000000000000000 P b60866d325504f37981c10c34c471ed9 [term 1 LEADER]: Becoming Leader. State: Replica: b60866d325504f37981c10c34c471ed9, State: Running, Role: LEADER
I20260809 05:33:24.918066 24862 consensus_queue.cc:237] T 00000000000000000000000000000000 P b60866d325504f37981c10c34c471ed9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b60866d325504f37981c10c34c471ed9" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 40291 } }
I20260809 05:33:24.919171 24857 sys_catalog.cc:564] T 00000000000000000000000000000000 P b60866d325504f37981c10c34c471ed9 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:33:24.921736 24864 sys_catalog.cc:455] T 00000000000000000000000000000000 P b60866d325504f37981c10c34c471ed9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b60866d325504f37981c10c34c471ed9. Latest consensus state: current_term: 1 leader_uuid: "b60866d325504f37981c10c34c471ed9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b60866d325504f37981c10c34c471ed9" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 40291 } } }
I20260809 05:33:24.922298 24864 sys_catalog.cc:458] T 00000000000000000000000000000000 P b60866d325504f37981c10c34c471ed9 [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:24.922812 24863 sys_catalog.cc:455] T 00000000000000000000000000000000 P b60866d325504f37981c10c34c471ed9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b60866d325504f37981c10c34c471ed9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b60866d325504f37981c10c34c471ed9" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 40291 } } }
I20260809 05:33:24.923166 24863 sys_catalog.cc:458] T 00000000000000000000000000000000 P b60866d325504f37981c10c34c471ed9 [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:24.925333 24875 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:33:24.931852 24875 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:33:24.943221 24875 catalog_manager.cc:1347] Generated new cluster ID: 3a895977edee4406834c2c3db251af88
I20260809 05:33:24.943398 24875 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:33:24.956351 24875 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:33:24.958429 24875 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:33:24.971479 24875 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b60866d325504f37981c10c34c471ed9: Generated new TSK 0
I20260809 05:33:24.972697 24875 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.185.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
Entry for principal kudu/127.26.185.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab.
W20260809 05:33:25.090317 27364 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.26.185.1: real 0.106s user 0.000s sys 0.034s
I20260809 05:33:25.091423 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:0
--local_ip_for_outbound_sockets=127.26.185.1
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:40291
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:44825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:33:25.526647 24901 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:25.527077 24901 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:25.527256 24901 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:25.535369 24901 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:25.535511 24901 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:25.535717 24901 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:33:25.546823 24901 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:44825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.1.keytab
--principal=kudu/127.26.185.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:40291
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:25.548650 24901 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:25.550486 24901 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:25.566524 24908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:25.566500 24914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:25.566579 24909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:25.568190 24901 server_base.cc:1034] running on GCE node
I20260809 05:33:25.569015 24901 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:25.570187 24901 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:25.571427 24901 hybrid_clock.cc:648] HybridClock initialized: now 1786253605571324 us; error 80 us; skew 500 ppm
I20260809 05:33:25.571841 24901 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:33:25 dist-test-slave-h3ft krb5kdc[24716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253605, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:33:25.575901 24901 init.cc:377] Logged in from keytab as kudu/127.26.185.1@KRBTEST.COM (short username kudu)
I20260809 05:33:25.577854 24901 webserver.cc:460] Webserver started at http://127.26.185.1:38291/ using document root <none> and password file <none>
I20260809 05:33:25.578781 24901 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:25.578954 24901 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:25.579397 24901 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:25.583425 24901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-0/data/instance:
uuid: "c01f58f74b344a5885c8f3e67bb0db51"
format_stamp: "Formatted at 2026-08-09 05:33:25 on dist-test-slave-h3ft"
server_key: "b364b9f838ad00d567ba74c4f854251d"
server_key_iv: "b2eafd6250cf7be5dc1fe96323ec1feb"
server_key_version: "encryptionkey@0"
I20260809 05:33:25.584430 24901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance:
uuid: "c01f58f74b344a5885c8f3e67bb0db51"
format_stamp: "Formatted at 2026-08-09 05:33:25 on dist-test-slave-h3ft"
server_key: "b364b9f838ad00d567ba74c4f854251d"
server_key_iv: "b2eafd6250cf7be5dc1fe96323ec1feb"
server_key_version: "encryptionkey@0"
I20260809 05:33:25.591346 24901 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260809 05:33:25.595826 24925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:25.597697 24901 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 05:33:25.597952 24901 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "c01f58f74b344a5885c8f3e67bb0db51"
format_stamp: "Formatted at 2026-08-09 05:33:25 on dist-test-slave-h3ft"
server_key: "b364b9f838ad00d567ba74c4f854251d"
server_key_iv: "b2eafd6250cf7be5dc1fe96323ec1feb"
server_key_version: "encryptionkey@0"
I20260809 05:33:25.598220 24901 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:25.621508 24901 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:25.626780 24901 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:25.627141 24901 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:25.628288 24901 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:33:25.629910 24901 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:33:25.629990 24901 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:25.630091 24901 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:33:25.630138 24901 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:25.673264 24901 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:43017
I20260809 05:33:25.673316 25107 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:43017 every 8 connection(s)
I20260809 05:33:25.675282 24901 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:33:25.683717 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 24901
I20260809 05:33:25.683979 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance
I20260809 05:33:25.684545 27364 external_mini_cluster.cc:1428] Setting key 994e93d212872aff4d905eeed27e0f37
Aug 09 05:33:25 dist-test-slave-h3ft krb5kdc[24716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253605, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.1@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:33:25.703804 25112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:25.678921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:51495 (local address 127.26.185.62:40291)
0809 05:33:25.679643 (+ 722us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:25.679651 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:25.680726 (+ 1075us) server_negotiation.cc:407] Connection header received
0809 05:33:25.682882 (+ 2156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:25.682888 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:25.682978 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:25.683150 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:25.685378 (+ 2228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:25.686511 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:25.688742 (+ 2231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:25.689550 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:25.689730 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:25.694997 (+ 5267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:25.695029 (+ 32us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:25.695037 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:25.695098 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:25.699092 (+ 3994us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:25.700477 (+ 1385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:25.700484 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:25.700487 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:25.700666 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:25.701271 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:25.701275 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:25.701277 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:25.701659 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:25.701796 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:25.703137 (+ 1341us) server_negotiation.cc:299] Negotiation successful
0809 05:33:25.703456 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":546,"thread_start_us":294,"threads_started":1}
I20260809 05:33:25.705765 25113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:25.679581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:40291 (local address 127.26.185.1:51495)
0809 05:33:25.680509 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:25.680567 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:25.682561 (+ 1994us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:25.683413 (+ 852us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:25.683423 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:25.684258 (+ 835us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:33:25.685128 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:25.685153 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:25.686741 (+ 1588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:25.686747 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:25.688530 (+ 1783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:25.688546 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:25.689830 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:25.689835 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:25.690089 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:25.690992 (+ 903us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:33:25.691083 (+ 91us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:33:25.694599 (+ 3516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:33:25.699336 (+ 4737us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:33:25.699352 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:33:25.699386 (+ 34us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:33:25.700286 (+ 900us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:33:25.700798 (+ 512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:33:25.700806 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:33:25.700812 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:33:25.701143 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:33:25.701806 (+ 663us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:33:25.701819 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:33:25.702485 (+ 666us) client_negotiation.cc:769] Sending connection context
0809 05:33:25.702899 (+ 414us) client_negotiation.cc:240] Negotiation successful
0809 05:33:25.703770 (+ 871us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"thread_start_us":354,"threads_started":1}
I20260809 05:33:25.708130 25110 heartbeater.cc:347] Connected to a master server at 127.26.185.62:40291
I20260809 05:33:25.708626 25110 heartbeater.cc:464] Registering TS with master...
I20260809 05:33:25.709703 25110 heartbeater.cc:511] Master 127.26.185.62:40291 requested a full tablet report, sending...
I20260809 05:33:25.712653 24799 ts_manager.cc:194] Registered new tserver with Master: c01f58f74b344a5885c8f3e67bb0db51 (127.26.185.1:43017)
I20260809 05:33:25.714567 24799 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.1@KRBTEST.COM'} at 127.26.185.1:51495
WARNING: no policy specified for kudu/127.26.185.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
Entry for principal kudu/127.26.185.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab.
I20260809 05:33:25.783130 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:0
--local_ip_for_outbound_sockets=127.26.185.2
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:40291
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:44825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:33:26.212667 25119 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:26.213048 25119 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:26.213160 25119 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:26.221325 25119 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:26.221479 25119 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:26.221613 25119 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:33:26.233023 25119 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:44825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.2.keytab
--principal=kudu/127.26.185.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:40291
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:26.234761 25119 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:26.236542 25119 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:26.252461 25127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:26.252413 25129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:26.252367 25126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:26.257166 25119 server_base.cc:1034] running on GCE node
I20260809 05:33:26.258154 25119 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:26.259539 25119 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:26.260807 25119 hybrid_clock.cc:648] HybridClock initialized: now 1786253606260755 us; error 43 us; skew 500 ppm
I20260809 05:33:26.261266 25119 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:33:26 dist-test-slave-h3ft krb5kdc[24716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253606, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:33:26.265343 25119 init.cc:377] Logged in from keytab as kudu/127.26.185.2@KRBTEST.COM (short username kudu)
I20260809 05:33:26.267374 25119 webserver.cc:460] Webserver started at http://127.26.185.2:41553/ using document root <none> and password file <none>
I20260809 05:33:26.268254 25119 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:26.268366 25119 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:26.268707 25119 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:26.272346 25119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-1/data/instance:
uuid: "0e8c79f74f0a49efa2d2a1810ce30a14"
format_stamp: "Formatted at 2026-08-09 05:33:26 on dist-test-slave-h3ft"
server_key: "207dd61589e08022a570b207a3e80789"
server_key_iv: "714ace8906ee46082fd0fd0fded32c31"
server_key_version: "encryptionkey@0"
I20260809 05:33:26.273280 25119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance:
uuid: "0e8c79f74f0a49efa2d2a1810ce30a14"
format_stamp: "Formatted at 2026-08-09 05:33:26 on dist-test-slave-h3ft"
server_key: "207dd61589e08022a570b207a3e80789"
server_key_iv: "714ace8906ee46082fd0fd0fded32c31"
server_key_version: "encryptionkey@0"
I20260809 05:33:26.279597 25119 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260809 05:33:26.283928 25141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:26.285607 25119 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 05:33:26.285776 25119 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "0e8c79f74f0a49efa2d2a1810ce30a14"
format_stamp: "Formatted at 2026-08-09 05:33:26 on dist-test-slave-h3ft"
server_key: "207dd61589e08022a570b207a3e80789"
server_key_iv: "714ace8906ee46082fd0fd0fded32c31"
server_key_version: "encryptionkey@0"
I20260809 05:33:26.286024 25119 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:26.313629 25119 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:26.319540 25119 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:26.319958 25119 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:26.321192 25119 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:33:26.322877 25119 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:33:26.322966 25119 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:26.323130 25119 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:33:26.323182 25119 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:26.362386 25119 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:38211
I20260809 05:33:26.362561 25337 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:38211 every 8 connection(s)
I20260809 05:33:26.364198 25119 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:33:26.369304 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 25119
I20260809 05:33:26.369556 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance
I20260809 05:33:26.370136 27364 external_mini_cluster.cc:1428] Setting key 0a57fc3fa3caaa088f5a982d89c22da3
Aug 09 05:33:26 dist-test-slave-h3ft krb5kdc[24716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253606, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.2@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:33:26.389050 25341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:26.367584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:51689 (local address 127.26.185.62:40291)
0809 05:33:26.368184 (+ 600us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:26.368191 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:26.369301 (+ 1110us) server_negotiation.cc:407] Connection header received
0809 05:33:26.371875 (+ 2574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:26.371882 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:26.371994 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:26.372136 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:26.374212 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:26.375094 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:26.376870 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:26.377357 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:26.377510 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:26.382185 (+ 4675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:26.382191 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:26.382195 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:26.382239 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:26.385284 (+ 3045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:26.386182 (+ 898us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:26.386188 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:26.386194 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:26.386339 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:26.386844 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:26.386850 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:26.386853 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:26.387249 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:26.387427 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:26.388298 (+ 871us) server_negotiation.cc:299] Negotiation successful
0809 05:33:26.388577 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":459,"thread_start_us":302,"threads_started":1}
I20260809 05:33:26.390516 25343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:26.368193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:40291 (local address 127.26.185.2:51689)
0809 05:33:26.369086 (+ 893us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:26.369134 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:26.371526 (+ 2392us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:26.372477 (+ 951us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:26.372491 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:26.373252 (+ 761us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:33:26.373973 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:26.374003 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:26.375269 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:26.375275 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:26.376692 (+ 1417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:26.376706 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:26.377638 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:26.377646 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:26.377929 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:26.378900 (+ 971us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:33:26.378928 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:33:26.381874 (+ 2946us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:33:26.385488 (+ 3614us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:33:26.385500 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:33:26.385530 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:33:26.386032 (+ 502us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:33:26.386466 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:33:26.386472 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:33:26.386476 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:33:26.386720 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:33:26.387399 (+ 679us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:33:26.387408 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:33:26.387853 (+ 445us) client_negotiation.cc:769] Sending connection context
0809 05:33:26.388184 (+ 331us) client_negotiation.cc:240] Negotiation successful
0809 05:33:26.388862 (+ 678us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":332,"threads_started":1}
I20260809 05:33:26.392436 25339 heartbeater.cc:347] Connected to a master server at 127.26.185.62:40291
I20260809 05:33:26.392838 25339 heartbeater.cc:464] Registering TS with master...
I20260809 05:33:26.393733 25339 heartbeater.cc:511] Master 127.26.185.62:40291 requested a full tablet report, sending...
I20260809 05:33:26.395687 24799 ts_manager.cc:194] Registered new tserver with Master: 0e8c79f74f0a49efa2d2a1810ce30a14 (127.26.185.2:38211)
I20260809 05:33:26.396657 24799 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.2@KRBTEST.COM'} at 127.26.185.2:51689
WARNING: no policy specified for kudu/127.26.185.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
Entry for principal kudu/127.26.185.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab.
I20260809 05:33:26.464319 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:0
--local_ip_for_outbound_sockets=127.26.185.3
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:40291
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:44825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:33:26.719107 25110 heartbeater.cc:503] Master 127.26.185.62:40291 was elected leader, sending a full tablet report...
W20260809 05:33:26.903530 25346 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:26.903978 25346 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:26.904186 25346 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:26.912480 25346 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:26.912694 25346 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:26.912882 25346 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:33:26.924757 25346 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:44825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.3.keytab
--principal=kudu/127.26.185.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:40291
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:26.926620 25346 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:26.928423 25346 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:26.945324 25359 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:26.945389 25362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:26.945338 25360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:26.946291 25346 server_base.cc:1034] running on GCE node
I20260809 05:33:26.947268 25346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:26.948518 25346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:26.949776 25346 hybrid_clock.cc:648] HybridClock initialized: now 1786253606949687 us; error 73 us; skew 500 ppm
I20260809 05:33:26.950294 25346 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:33:26 dist-test-slave-h3ft krb5kdc[24716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253606, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:33:26.960412 25346 init.cc:377] Logged in from keytab as kudu/127.26.185.3@KRBTEST.COM (short username kudu)
I20260809 05:33:26.962568 25346 webserver.cc:460] Webserver started at http://127.26.185.3:45031/ using document root <none> and password file <none>
I20260809 05:33:26.963615 25346 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:26.963748 25346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:26.964107 25346 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:26.968037 25346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-2/data/instance:
uuid: "9f748e2fa2f9426e83b90480ad6d0d3f"
format_stamp: "Formatted at 2026-08-09 05:33:26 on dist-test-slave-h3ft"
server_key: "fe9c5dc8057b642863895e77b7771f25"
server_key_iv: "0d16fe5c4108c70630961ea50ce8d922"
server_key_version: "encryptionkey@0"
I20260809 05:33:26.969004 25346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance:
uuid: "9f748e2fa2f9426e83b90480ad6d0d3f"
format_stamp: "Formatted at 2026-08-09 05:33:26 on dist-test-slave-h3ft"
server_key: "fe9c5dc8057b642863895e77b7771f25"
server_key_iv: "0d16fe5c4108c70630961ea50ce8d922"
server_key_version: "encryptionkey@0"
I20260809 05:33:26.975903 25346 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.002s
I20260809 05:33:26.980325 25370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:26.982458 25346 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.004s
I20260809 05:33:26.982740 25346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "9f748e2fa2f9426e83b90480ad6d0d3f"
format_stamp: "Formatted at 2026-08-09 05:33:26 on dist-test-slave-h3ft"
server_key: "fe9c5dc8057b642863895e77b7771f25"
server_key_iv: "0d16fe5c4108c70630961ea50ce8d922"
server_key_version: "encryptionkey@0"
I20260809 05:33:26.983063 25346 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:27.011881 25346 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:27.017819 25346 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:27.018239 25346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:27.019647 25346 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:33:27.021587 25346 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:33:27.021682 25346 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:27.021807 25346 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:33:27.021869 25346 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:27.063650 25346 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:46599
I20260809 05:33:27.063692 25572 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:46599 every 8 connection(s)
I20260809 05:33:27.065438 25346 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:33:27.070211 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 25346
I20260809 05:33:27.070493 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance
I20260809 05:33:27.071259 27364 external_mini_cluster.cc:1428] Setting key d4b677e22f514e0249a3745d9d5d350f
Aug 09 05:33:27 dist-test-slave-h3ft krb5kdc[24716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253606, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.3@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:33:27.091181 25577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:27.069045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:38021 (local address 127.26.185.62:40291)
0809 05:33:27.069647 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:27.069653 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:27.070792 (+ 1139us) server_negotiation.cc:407] Connection header received
0809 05:33:27.073352 (+ 2560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:27.073357 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:27.073456 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:27.073562 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:27.076009 (+ 2447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.076871 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.078753 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.079257 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.079360 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:27.083753 (+ 4393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:27.083759 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:27.083763 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:27.083803 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:27.086904 (+ 3101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:27.088091 (+ 1187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:27.088097 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:27.088100 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:27.088322 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:27.088980 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:27.088985 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:27.088987 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:27.089341 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:27.089505 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:27.090417 (+ 912us) server_negotiation.cc:299] Negotiation successful
0809 05:33:27.090720 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":302,"threads_started":1}
I20260809 05:33:27.092458 25578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:27.069541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:40291 (local address 127.26.185.3:38021)
0809 05:33:27.070537 (+ 996us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:27.070605 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:27.073011 (+ 2406us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:27.073912 (+ 901us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:27.073923 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:27.074827 (+ 904us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:33:27.075815 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:27.075847 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.077048 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.077053 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:27.078589 (+ 1536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:27.078606 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.079516 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.079522 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:27.079758 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:27.080687 (+ 929us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:33:27.080715 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:33:27.083487 (+ 2772us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:33:27.087082 (+ 3595us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:33:27.087093 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:33:27.087117 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:33:27.087941 (+ 824us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:33:27.088467 (+ 526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:33:27.088471 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:33:27.088473 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:33:27.088812 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:33:27.089479 (+ 667us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:33:27.089485 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:33:27.089900 (+ 415us) client_negotiation.cc:769] Sending connection context
0809 05:33:27.090230 (+ 330us) client_negotiation.cc:240] Negotiation successful
0809 05:33:27.090854 (+ 624us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":673,"thread_start_us":399,"threads_started":1}
I20260809 05:33:27.094115 25573 heartbeater.cc:347] Connected to a master server at 127.26.185.62:40291
I20260809 05:33:27.094451 25573 heartbeater.cc:464] Registering TS with master...
I20260809 05:33:27.095371 25573 heartbeater.cc:511] Master 127.26.185.62:40291 requested a full tablet report, sending...
I20260809 05:33:27.097187 24799 ts_manager.cc:194] Registered new tserver with Master: 9f748e2fa2f9426e83b90480ad6d0d3f (127.26.185.3:46599)
I20260809 05:33:27.098102 24799 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.185.3@KRBTEST.COM'} at 127.26.185.3:38021
I20260809 05:33:27.101603 27364 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 05:33:27.122557 25577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:27.106931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46770 (local address 127.26.185.62:40291)
0809 05:33:27.107276 (+ 345us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:27.107286 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:27.107637 (+ 351us) server_negotiation.cc:407] Connection header received
0809 05:33:27.107911 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:27.107915 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:27.107995 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:27.108109 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:27.109945 (+ 1836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.110776 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.112347 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.112828 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.112981 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:27.115903 (+ 2922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:27.115908 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:27.115912 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:27.115954 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:27.119220 (+ 3266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:27.120032 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:27.120057 (+ 25us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:27.120065 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:27.120246 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:27.120713 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:27.120719 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:27.120722 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:27.121160 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:27.121484 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:27.121857 (+ 373us) server_negotiation.cc:299] Negotiation successful
0809 05:33:27.122146 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138}
I20260809 05:33:27.127810 24799 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46770:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 05:33:27.135800 24799 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 05:33:27.178061 25600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:27.153000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59472 (local address 127.26.185.1:43017)
0809 05:33:27.161899 (+ 8899us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:27.161915 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:27.167799 (+ 5884us) server_negotiation.cc:407] Connection header received
0809 05:33:27.168267 (+ 468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:27.168279 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:27.168566 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:27.168783 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:27.170146 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.171795 (+ 1649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.175277 (+ 3482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.176805 (+ 1528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.176965 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:27.177221 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:27.177447 (+ 226us) server_negotiation.cc:299] Negotiation successful
0809 05:33:27.177650 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8579,"thread_start_us":8351,"threads_started":1}
I20260809 05:33:27.178310 25591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:27.151382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:46599 (local address 127.0.0.1:38800)
0809 05:33:27.152382 (+ 1000us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:27.152423 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:27.152652 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:27.168789 (+ 16137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:27.168800 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:27.168839 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:27.169505 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:27.169521 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.171908 (+ 2387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.171914 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:27.174813 (+ 2899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:27.174829 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.176904 (+ 2075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.176914 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:27.177113 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:27.177151 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 05:33:27.177227 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 05:33:27.177407 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":721,"mutex_wait_us":3,"spinlock_wait_cycles":16640,"thread_start_us":561,"threads_started":1}
I20260809 05:33:27.178586 25596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:27.152018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:43017 (local address 127.0.0.1:59472)
0809 05:33:27.167558 (+ 15540us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:27.167589 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:27.167996 (+ 407us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:27.169195 (+ 1199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:27.169201 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:27.169235 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:27.169910 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:27.169924 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.171952 (+ 2028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.171961 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:27.175103 (+ 3142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:27.175119 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.177057 (+ 1938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.177066 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:27.177244 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:27.177281 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 05:33:27.177379 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 05:33:27.177515 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14932,"mutex_wait_us":159,"thread_start_us":16984,"threads_started":1}
I20260809 05:33:27.177997 25595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:27.152867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:38211 (local address 127.0.0.1:58628)
0809 05:33:27.168751 (+ 15884us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:27.168770 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:27.168908 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:27.170424 (+ 1516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:27.170428 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:27.170453 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:27.170873 (+ 420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:27.170883 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.172524 (+ 1641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.172529 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:27.175114 (+ 2585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:27.175123 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.176630 (+ 1507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.176636 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:27.176830 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:27.176903 (+ 73us) client_negotiation.cc:769] Sending connection context
0809 05:33:27.177083 (+ 180us) client_negotiation.cc:240] Negotiation successful
0809 05:33:27.177311 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15731,"mutex_wait_us":7,"thread_start_us":14185,"threads_started":1}
I20260809 05:33:27.179055 25593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:27.151572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38800 (local address 127.26.185.3:46599)
0809 05:33:27.167707 (+ 16135us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:27.167723 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:27.167784 (+ 61us) server_negotiation.cc:407] Connection header received
0809 05:33:27.167992 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:27.168007 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:27.168475 (+ 468us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:27.168788 (+ 313us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:27.169776 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.171733 (+ 1957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.175021 (+ 3288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.176635 (+ 1614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.178114 (+ 1479us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:27.178399 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:27.178469 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 05:33:27.178645 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15829,"thread_start_us":17528,"threads_started":1}
I20260809 05:33:27.179319 25605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:27.153349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58628 (local address 127.26.185.2:38211)
0809 05:33:27.168576 (+ 15227us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:27.168586 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:27.169544 (+ 958us) server_negotiation.cc:407] Connection header received
0809 05:33:27.169665 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:27.169673 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:27.169911 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:27.170121 (+ 210us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:27.171082 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.172366 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.175323 (+ 2957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.176416 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.176595 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:27.176874 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:27.177910 (+ 1036us) server_negotiation.cc:299] Negotiation successful
0809 05:33:27.178138 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15031,"thread_start_us":15227,"threads_started":1}
I20260809 05:33:27.183964 25221 tablet_service.cc:1467] Processing CreateTablet for tablet 482a0b43301b41948246ee3200cef81e (DEFAULT_TABLE table=test-table [id=9f347cb1d7d14515b9b2e772fd28248d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:33:27.183969 25008 tablet_service.cc:1467] Processing CreateTablet for tablet 482a0b43301b41948246ee3200cef81e (DEFAULT_TABLE table=test-table [id=9f347cb1d7d14515b9b2e772fd28248d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:33:27.184600 25456 tablet_service.cc:1467] Processing CreateTablet for tablet 482a0b43301b41948246ee3200cef81e (DEFAULT_TABLE table=test-table [id=9f347cb1d7d14515b9b2e772fd28248d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:33:27.185708 25221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 482a0b43301b41948246ee3200cef81e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:27.185716 25008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 482a0b43301b41948246ee3200cef81e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:27.186131 25456 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 482a0b43301b41948246ee3200cef81e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:27.201503 25606 tablet_bootstrap.cc:492] T 482a0b43301b41948246ee3200cef81e P 0e8c79f74f0a49efa2d2a1810ce30a14: Bootstrap starting.
I20260809 05:33:27.205937 25606 tablet_bootstrap.cc:654] T 482a0b43301b41948246ee3200cef81e P 0e8c79f74f0a49efa2d2a1810ce30a14: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:27.207247 25606 log.cc:824] T 482a0b43301b41948246ee3200cef81e P 0e8c79f74f0a49efa2d2a1810ce30a14: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:27.208088 25608 tablet_bootstrap.cc:492] T 482a0b43301b41948246ee3200cef81e P 9f748e2fa2f9426e83b90480ad6d0d3f: Bootstrap starting.
I20260809 05:33:27.208388 25607 tablet_bootstrap.cc:492] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51: Bootstrap starting.
I20260809 05:33:27.211670 25606 tablet_bootstrap.cc:492] T 482a0b43301b41948246ee3200cef81e P 0e8c79f74f0a49efa2d2a1810ce30a14: No bootstrap required, opened a new log
I20260809 05:33:27.212005 25606 ts_tablet_manager.cc:1397] T 482a0b43301b41948246ee3200cef81e P 0e8c79f74f0a49efa2d2a1810ce30a14: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.004s
I20260809 05:33:27.213558 25608 tablet_bootstrap.cc:654] T 482a0b43301b41948246ee3200cef81e P 9f748e2fa2f9426e83b90480ad6d0d3f: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:27.213558 25607 tablet_bootstrap.cc:654] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:27.215018 25607 log.cc:824] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:27.215018 25608 log.cc:824] T 482a0b43301b41948246ee3200cef81e P 9f748e2fa2f9426e83b90480ad6d0d3f: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:27.218225 25607 tablet_bootstrap.cc:492] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51: No bootstrap required, opened a new log
I20260809 05:33:27.218531 25607 ts_tablet_manager.cc:1397] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260809 05:33:27.218561 25608 tablet_bootstrap.cc:492] T 482a0b43301b41948246ee3200cef81e P 9f748e2fa2f9426e83b90480ad6d0d3f: No bootstrap required, opened a new log
I20260809 05:33:27.218823 25608 ts_tablet_manager.cc:1397] T 482a0b43301b41948246ee3200cef81e P 9f748e2fa2f9426e83b90480ad6d0d3f: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260809 05:33:27.222353 25606 raft_consensus.cc:348] T 482a0b43301b41948246ee3200cef81e P 0e8c79f74f0a49efa2d2a1810ce30a14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f748e2fa2f9426e83b90480ad6d0d3f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46599 } } peers { permanent_uuid: "0e8c79f74f0a49efa2d2a1810ce30a14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 38211 } } peers { permanent_uuid: "c01f58f74b344a5885c8f3e67bb0db51" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43017 } }
I20260809 05:33:27.223093 25606 raft_consensus.cc:374] T 482a0b43301b41948246ee3200cef81e P 0e8c79f74f0a49efa2d2a1810ce30a14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:27.223220 25606 raft_consensus.cc:729] T 482a0b43301b41948246ee3200cef81e P 0e8c79f74f0a49efa2d2a1810ce30a14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e8c79f74f0a49efa2d2a1810ce30a14, State: Initialized, Role: FOLLOWER
I20260809 05:33:27.224138 25606 consensus_queue.cc:260] T 482a0b43301b41948246ee3200cef81e P 0e8c79f74f0a49efa2d2a1810ce30a14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f748e2fa2f9426e83b90480ad6d0d3f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46599 } } peers { permanent_uuid: "0e8c79f74f0a49efa2d2a1810ce30a14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 38211 } } peers { permanent_uuid: "c01f58f74b344a5885c8f3e67bb0db51" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43017 } }
I20260809 05:33:27.225471 25339 heartbeater.cc:503] Master 127.26.185.62:40291 was elected leader, sending a full tablet report...
I20260809 05:33:27.226262 25606 ts_tablet_manager.cc:1428] T 482a0b43301b41948246ee3200cef81e P 0e8c79f74f0a49efa2d2a1810ce30a14: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260809 05:33:27.228120 25607 raft_consensus.cc:348] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f748e2fa2f9426e83b90480ad6d0d3f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46599 } } peers { permanent_uuid: "0e8c79f74f0a49efa2d2a1810ce30a14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 38211 } } peers { permanent_uuid: "c01f58f74b344a5885c8f3e67bb0db51" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43017 } }
I20260809 05:33:27.228598 25607 raft_consensus.cc:374] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:27.228709 25607 raft_consensus.cc:729] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c01f58f74b344a5885c8f3e67bb0db51, State: Initialized, Role: FOLLOWER
I20260809 05:33:27.229396 25607 consensus_queue.cc:260] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f748e2fa2f9426e83b90480ad6d0d3f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46599 } } peers { permanent_uuid: "0e8c79f74f0a49efa2d2a1810ce30a14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 38211 } } peers { permanent_uuid: "c01f58f74b344a5885c8f3e67bb0db51" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43017 } }
I20260809 05:33:27.231444 25607 ts_tablet_manager.cc:1428] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51: Time spent starting tablet: real 0.013s user 0.010s sys 0.005s
I20260809 05:33:27.231150 25608 raft_consensus.cc:348] T 482a0b43301b41948246ee3200cef81e P 9f748e2fa2f9426e83b90480ad6d0d3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f748e2fa2f9426e83b90480ad6d0d3f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46599 } } peers { permanent_uuid: "0e8c79f74f0a49efa2d2a1810ce30a14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 38211 } } peers { permanent_uuid: "c01f58f74b344a5885c8f3e67bb0db51" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43017 } }
I20260809 05:33:27.231614 25608 raft_consensus.cc:374] T 482a0b43301b41948246ee3200cef81e P 9f748e2fa2f9426e83b90480ad6d0d3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:27.231769 25608 raft_consensus.cc:729] T 482a0b43301b41948246ee3200cef81e P 9f748e2fa2f9426e83b90480ad6d0d3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f748e2fa2f9426e83b90480ad6d0d3f, State: Initialized, Role: FOLLOWER
I20260809 05:33:27.232546 25608 consensus_queue.cc:260] T 482a0b43301b41948246ee3200cef81e P 9f748e2fa2f9426e83b90480ad6d0d3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f748e2fa2f9426e83b90480ad6d0d3f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46599 } } peers { permanent_uuid: "0e8c79f74f0a49efa2d2a1810ce30a14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 38211 } } peers { permanent_uuid: "c01f58f74b344a5885c8f3e67bb0db51" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43017 } }
I20260809 05:33:27.234658 25573 heartbeater.cc:503] Master 127.26.185.62:40291 was elected leader, sending a full tablet report...
I20260809 05:33:27.235327 25608 ts_tablet_manager.cc:1428] T 482a0b43301b41948246ee3200cef81e P 9f748e2fa2f9426e83b90480ad6d0d3f: Time spent starting tablet: real 0.016s user 0.016s sys 0.000s
W20260809 05:33:27.317682 25575 tablet.cc:2369] T 482a0b43301b41948246ee3200cef81e P 9f748e2fa2f9426e83b90480ad6d0d3f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:33:27.342237 25613 raft_consensus.cc:482] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:33:27.342631 25613 raft_consensus.cc:504] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f748e2fa2f9426e83b90480ad6d0d3f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46599 } } peers { permanent_uuid: "0e8c79f74f0a49efa2d2a1810ce30a14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 38211 } } peers { permanent_uuid: "c01f58f74b344a5885c8f3e67bb0db51" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43017 } }
I20260809 05:33:27.344930 25613 leader_election.cc:288] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f748e2fa2f9426e83b90480ad6d0d3f (127.26.185.3:46599), 0e8c79f74f0a49efa2d2a1810ce30a14 (127.26.185.2:38211)
I20260809 05:33:27.352633 25593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:27.345557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:49223 (local address 127.26.185.3:46599)
0809 05:33:27.345939 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:27.345947 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:27.346257 (+ 310us) server_negotiation.cc:407] Connection header received
0809 05:33:27.346584 (+ 327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:27.346596 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:27.346724 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:27.346860 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:27.347848 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.348662 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.350651 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.351546 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.351751 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:27.351852 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:27.352158 (+ 306us) server_negotiation.cc:299] Negotiation successful
0809 05:33:27.352297 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260809 05:33:27.352802 25616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:27.345395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:46599 (local address 127.26.185.1:49223)
0809 05:33:27.346109 (+ 714us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:27.346133 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:27.346355 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:27.346989 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:27.346993 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:27.347054 (+ 61us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:27.347662 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:27.347675 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.348814 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.348820 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:27.350473 (+ 1653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:27.350491 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.351778 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.351784 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:27.351970 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:27.352002 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 05:33:27.352125 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 05:33:27.352277 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"mutex_wait_us":26,"spinlock_wait_cycles":32512,"thread_start_us":381,"threads_started":1}
I20260809 05:33:27.352867 25605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:27.346596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:59223 (local address 127.26.185.2:38211)
0809 05:33:27.346887 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:27.346893 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:27.347281 (+ 388us) server_negotiation.cc:407] Connection header received
0809 05:33:27.347531 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:27.347536 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:27.347608 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:27.347711 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:27.348300 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.349062 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.350911 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.351805 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.351989 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:27.352080 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:27.352408 (+ 328us) server_negotiation.cc:299] Negotiation successful
0809 05:33:27.352563 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260809 05:33:27.352985 25618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:27.346356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:38211 (local address 127.26.185.1:59223)
0809 05:33:27.347163 (+ 807us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:27.347181 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:27.347353 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:27.347733 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:27.347737 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:27.347760 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:27.348140 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:27.348150 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.349209 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.349214 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:27.350739 (+ 1525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:27.350761 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.352056 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.352062 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:27.352232 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:27.352256 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 05:33:27.352365 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 05:33:27.352501 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":671,"mutex_wait_us":22,"thread_start_us":364,"threads_started":1}
I20260809 05:33:27.354382 25253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "482a0b43301b41948246ee3200cef81e" candidate_uuid: "c01f58f74b344a5885c8f3e67bb0db51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e8c79f74f0a49efa2d2a1810ce30a14" is_pre_election: true
I20260809 05:33:27.354413 25494 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "482a0b43301b41948246ee3200cef81e" candidate_uuid: "c01f58f74b344a5885c8f3e67bb0db51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f748e2fa2f9426e83b90480ad6d0d3f" is_pre_election: true
I20260809 05:33:27.355224 25253 raft_consensus.cc:2454] T 482a0b43301b41948246ee3200cef81e P 0e8c79f74f0a49efa2d2a1810ce30a14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c01f58f74b344a5885c8f3e67bb0db51 in term 0.
I20260809 05:33:27.355224 25494 raft_consensus.cc:2454] T 482a0b43301b41948246ee3200cef81e P 9f748e2fa2f9426e83b90480ad6d0d3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c01f58f74b344a5885c8f3e67bb0db51 in term 0.
I20260809 05:33:27.356159 24926 leader_election.cc:302] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f748e2fa2f9426e83b90480ad6d0d3f, c01f58f74b344a5885c8f3e67bb0db51; no voters:
I20260809 05:33:27.356659 25613 raft_consensus.cc:2781] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:33:27.356848 25613 raft_consensus.cc:482] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:33:27.356976 25613 raft_consensus.cc:3037] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:27.359814 25613 raft_consensus.cc:504] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f748e2fa2f9426e83b90480ad6d0d3f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46599 } } peers { permanent_uuid: "0e8c79f74f0a49efa2d2a1810ce30a14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 38211 } } peers { permanent_uuid: "c01f58f74b344a5885c8f3e67bb0db51" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43017 } }
I20260809 05:33:27.360584 25613 leader_election.cc:288] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51 [CANDIDATE]: Term 1 election: Requested vote from peers 9f748e2fa2f9426e83b90480ad6d0d3f (127.26.185.3:46599), 0e8c79f74f0a49efa2d2a1810ce30a14 (127.26.185.2:38211)
I20260809 05:33:27.361280 25253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "482a0b43301b41948246ee3200cef81e" candidate_uuid: "c01f58f74b344a5885c8f3e67bb0db51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e8c79f74f0a49efa2d2a1810ce30a14"
I20260809 05:33:27.361255 25494 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "482a0b43301b41948246ee3200cef81e" candidate_uuid: "c01f58f74b344a5885c8f3e67bb0db51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f748e2fa2f9426e83b90480ad6d0d3f"
I20260809 05:33:27.361554 25253 raft_consensus.cc:3037] T 482a0b43301b41948246ee3200cef81e P 0e8c79f74f0a49efa2d2a1810ce30a14 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:27.361549 25494 raft_consensus.cc:3037] T 482a0b43301b41948246ee3200cef81e P 9f748e2fa2f9426e83b90480ad6d0d3f [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:27.365499 25494 raft_consensus.cc:2454] T 482a0b43301b41948246ee3200cef81e P 9f748e2fa2f9426e83b90480ad6d0d3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c01f58f74b344a5885c8f3e67bb0db51 in term 1.
I20260809 05:33:27.366180 24926 leader_election.cc:302] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f748e2fa2f9426e83b90480ad6d0d3f, c01f58f74b344a5885c8f3e67bb0db51; no voters:
I20260809 05:33:27.366309 25253 raft_consensus.cc:2454] T 482a0b43301b41948246ee3200cef81e P 0e8c79f74f0a49efa2d2a1810ce30a14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c01f58f74b344a5885c8f3e67bb0db51 in term 1.
I20260809 05:33:27.366667 25613 raft_consensus.cc:2781] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51 [term 1 FOLLOWER]: Leader election won for term 1
W20260809 05:33:27.366945 25340 tablet.cc:2369] T 482a0b43301b41948246ee3200cef81e P 0e8c79f74f0a49efa2d2a1810ce30a14: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:33:27.367578 25613 raft_consensus.cc:686] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51 [term 1 LEADER]: Becoming Leader. State: Replica: c01f58f74b344a5885c8f3e67bb0db51, State: Running, Role: LEADER
I20260809 05:33:27.368310 25613 consensus_queue.cc:237] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f748e2fa2f9426e83b90480ad6d0d3f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46599 } } peers { permanent_uuid: "0e8c79f74f0a49efa2d2a1810ce30a14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 38211 } } peers { permanent_uuid: "c01f58f74b344a5885c8f3e67bb0db51" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43017 } }
I20260809 05:33:27.374260 24799 catalog_manager.cc:5495] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51 reported cstate change: term changed from 0 to 1, leader changed from <none> to c01f58f74b344a5885c8f3e67bb0db51 (127.26.185.1). New cstate: current_term: 1 leader_uuid: "c01f58f74b344a5885c8f3e67bb0db51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f748e2fa2f9426e83b90480ad6d0d3f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e8c79f74f0a49efa2d2a1810ce30a14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 38211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c01f58f74b344a5885c8f3e67bb0db51" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 43017 } health_report { overall_health: HEALTHY } } }
I20260809 05:33:27.426426 25600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:27.419186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59482 (local address 127.26.185.1:43017)
0809 05:33:27.419425 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:27.419430 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:27.419450 (+ 20us) server_negotiation.cc:407] Connection header received
0809 05:33:27.419666 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:27.419670 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:27.419772 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:27.419926 (+ 154us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:33:27.420479 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.421314 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.423482 (+ 2168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.424165 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.424321 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:27.424993 (+ 672us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:33:27.425698 (+ 705us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:33:27.425886 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:27.425988 (+ 102us) server_negotiation.cc:299] Negotiation successful
0809 05:33:27.426087 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260809 05:33:27.428929 25111 tablet.cc:2369] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:33:27.437731 25494 raft_consensus.cc:1261] T 482a0b43301b41948246ee3200cef81e P 9f748e2fa2f9426e83b90480ad6d0d3f [term 1 FOLLOWER]: Refusing update from remote peer c01f58f74b344a5885c8f3e67bb0db51: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:33:27.437731 25253 raft_consensus.cc:1261] T 482a0b43301b41948246ee3200cef81e P 0e8c79f74f0a49efa2d2a1810ce30a14 [term 1 FOLLOWER]: Refusing update from remote peer c01f58f74b344a5885c8f3e67bb0db51: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:33:27.438912 25619 consensus_queue.cc:1035] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e8c79f74f0a49efa2d2a1810ce30a14" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 38211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:33:27.439428 25613 consensus_queue.cc:1035] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f748e2fa2f9426e83b90480ad6d0d3f" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:33:27.458074 25624 mvcc.cc:205] Tried to move back new op lower bound from 7316494776051494912 to 7316494775785648128. Current Snapshot: MvccSnapshot[applied={T|T < 7316494776051494912}]
I20260809 05:33:27.471879 24799 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46770:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:33:27.472247 24799 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46770:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:33:27.476464 24799 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b60866d325504f37981c10c34c471ed9: Sending DeleteTablet for 3 replicas of tablet 482a0b43301b41948246ee3200cef81e
I20260809 05:33:27.478106 25008 tablet_service.cc:1514] Processing DeleteTablet for tablet 482a0b43301b41948246ee3200cef81e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:33:27 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:59472
I20260809 05:33:27.478099 25456 tablet_service.cc:1514] Processing DeleteTablet for tablet 482a0b43301b41948246ee3200cef81e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:33:27 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:38800
I20260809 05:33:27.478201 25221 tablet_service.cc:1514] Processing DeleteTablet for tablet 482a0b43301b41948246ee3200cef81e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:33:27 UTC) from {username='kudu', principal='kudu/127.26.185.62@KRBTEST.COM'} at 127.0.0.1:58628
I20260809 05:33:27.482443 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 24901
I20260809 05:33:27.493194 25645 tablet_replica.cc:330] T 482a0b43301b41948246ee3200cef81e P 0e8c79f74f0a49efa2d2a1810ce30a14: stopping tablet replica
I20260809 05:33:27.494046 25645 raft_consensus.cc:2229] T 482a0b43301b41948246ee3200cef81e P 0e8c79f74f0a49efa2d2a1810ce30a14 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:33:27.494912 25645 raft_consensus.cc:2258] T 482a0b43301b41948246ee3200cef81e P 0e8c79f74f0a49efa2d2a1810ce30a14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:33:27.499697 25643 tablet_replica.cc:330] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51: stopping tablet replica
I20260809 05:33:27.500397 25643 raft_consensus.cc:2229] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51 [term 1 LEADER]: Raft consensus shutting down.
I20260809 05:33:27.501312 25643 raft_consensus.cc:2258] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:33:27.505014 25645 ts_tablet_manager.cc:1905] T 482a0b43301b41948246ee3200cef81e P 0e8c79f74f0a49efa2d2a1810ce30a14: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:33:27.507441 25643 ts_tablet_manager.cc:1905] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 09 05:33:27 dist-test-slave-h3ft krb5kdc[24716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253604, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.1@KRBTEST.COM
I20260809 05:33:27.514452 25645 ts_tablet_manager.cc:1918] T 482a0b43301b41948246ee3200cef81e P 0e8c79f74f0a49efa2d2a1810ce30a14: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:33:27.514847 25645 log.cc:1196] T 482a0b43301b41948246ee3200cef81e P 0e8c79f74f0a49efa2d2a1810ce30a14: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-1/wal/wals/482a0b43301b41948246ee3200cef81e
I20260809 05:33:27.515631 25641 tablet_replica.cc:330] T 482a0b43301b41948246ee3200cef81e P 9f748e2fa2f9426e83b90480ad6d0d3f: stopping tablet replica
I20260809 05:33:27.515661 25645 ts_tablet_manager.cc:1939] T 482a0b43301b41948246ee3200cef81e P 0e8c79f74f0a49efa2d2a1810ce30a14: Deleting consensus metadata
I20260809 05:33:27.516328 25641 raft_consensus.cc:2229] T 482a0b43301b41948246ee3200cef81e P 9f748e2fa2f9426e83b90480ad6d0d3f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:33:27.517095 25641 raft_consensus.cc:2258] T 482a0b43301b41948246ee3200cef81e P 9f748e2fa2f9426e83b90480ad6d0d3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:33:27.518267 24763 catalog_manager.cc:4841] TS 0e8c79f74f0a49efa2d2a1810ce30a14 (127.26.185.2:38211): tablet 482a0b43301b41948246ee3200cef81e (table test-table [id=9f347cb1d7d14515b9b2e772fd28248d]) successfully deleted
I20260809 05:33:27.520195 25641 ts_tablet_manager.cc:1905] T 482a0b43301b41948246ee3200cef81e P 9f748e2fa2f9426e83b90480ad6d0d3f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:33:27.522756 25643 ts_tablet_manager.cc:1918] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:33:27.523527 25643 log.cc:1196] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-0/wal/wals/482a0b43301b41948246ee3200cef81e
I20260809 05:33:27.524258 25643 ts_tablet_manager.cc:1939] T 482a0b43301b41948246ee3200cef81e P c01f58f74b344a5885c8f3e67bb0db51: Deleting consensus metadata
I20260809 05:33:27.526908 24768 catalog_manager.cc:4841] TS c01f58f74b344a5885c8f3e67bb0db51 (127.26.185.1:43017): tablet 482a0b43301b41948246ee3200cef81e (table test-table [id=9f347cb1d7d14515b9b2e772fd28248d]) successfully deleted
I20260809 05:33:27.528385 25641 ts_tablet_manager.cc:1918] T 482a0b43301b41948246ee3200cef81e P 9f748e2fa2f9426e83b90480ad6d0d3f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:33:27.528656 25641 log.cc:1196] T 482a0b43301b41948246ee3200cef81e P 9f748e2fa2f9426e83b90480ad6d0d3f: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786253234117492-27364-0/minicluster-data/ts-2/wal/wals/482a0b43301b41948246ee3200cef81e
I20260809 05:33:27.528908 25600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:27.485377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59486 (local address 127.26.185.1:43017)
0809 05:33:27.485601 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:27.485608 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:27.495873 (+ 10265us) server_negotiation.cc:407] Connection header received
0809 05:33:27.496272 (+ 399us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:27.496280 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:27.496393 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:27.496483 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:27.498700 (+ 2217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.500081 (+ 1381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.502350 (+ 2269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.503168 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.503280 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:27.519173 (+ 15893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:27.519195 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:27.519220 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:27.519286 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:27.524477 (+ 5191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:27.525783 (+ 1306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:27.525795 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:27.525798 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:27.525997 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:27.526579 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:27.526586 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:27.526593 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:27.527180 (+ 587us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:27.527544 (+ 364us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:27.528173 (+ 629us) server_negotiation.cc:299] Negotiation successful
0809 05:33:27.528462 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 05:33:27.529359 25641 ts_tablet_manager.cc:1939] T 482a0b43301b41948246ee3200cef81e P 9f748e2fa2f9426e83b90480ad6d0d3f: Deleting consensus metadata
I20260809 05:33:27.529702 25101 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:33:27.531661 24763 catalog_manager.cc:4841] TS 9f748e2fa2f9426e83b90480ad6d0d3f (127.26.185.3:46599): tablet 482a0b43301b41948246ee3200cef81e (table test-table [id=9f347cb1d7d14515b9b2e772fd28248d]) successfully deleted
I20260809 05:33:27.642349 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 24901
I20260809 05:33:27.676584 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 25119
Aug 09 05:33:27 dist-test-slave-h3ft krb5kdc[24716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253604, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.2@KRBTEST.COM
I20260809 05:33:27.696996 25605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:27.677683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58636 (local address 127.26.185.2:38211)
0809 05:33:27.677891 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:27.677897 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:27.677925 (+ 28us) server_negotiation.cc:407] Connection header received
0809 05:33:27.678133 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:27.678138 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:27.678221 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:27.678326 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:27.680241 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.681112 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.682500 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.682961 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.683162 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:27.688822 (+ 5660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:27.688846 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:27.688873 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:27.688953 (+ 80us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:27.693513 (+ 4560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:27.694491 (+ 978us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:27.694503 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:27.694506 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:27.694702 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:27.695192 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:27.695197 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:27.695199 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:27.695745 (+ 546us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:27.696059 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:27.696337 (+ 278us) server_negotiation.cc:299] Negotiation successful
0809 05:33:27.696563 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 05:33:27.698048 25331 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:33:27.799378 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 25119
I20260809 05:33:27.833676 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 25346
Aug 09 05:33:27 dist-test-slave-h3ft krb5kdc[24716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253604, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.3@KRBTEST.COM
I20260809 05:33:27.855161 25593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:27.834763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38804 (local address 127.26.185.3:46599)
0809 05:33:27.835124 (+ 361us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:27.835130 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:27.835157 (+ 27us) server_negotiation.cc:407] Connection header received
0809 05:33:27.835387 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:27.835393 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:27.835500 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:27.835605 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:27.837254 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.838110 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.840728 (+ 2618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:27.841384 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:27.841550 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:27.847662 (+ 6112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:27.847693 (+ 31us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:27.847725 (+ 32us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:27.847777 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:27.851268 (+ 3491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:27.852301 (+ 1033us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:27.852310 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:27.852313 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:27.852541 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:27.853110 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:27.853115 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:27.853118 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:27.853751 (+ 633us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:27.854068 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:27.854442 (+ 374us) server_negotiation.cc:299] Negotiation successful
0809 05:33:27.854673 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152}
I20260809 05:33:27.856179 25566 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:33:27.957592 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 25346
I20260809 05:33:27.991201 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 24732
I20260809 05:33:27.992594 24849 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:33:28.124876 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 24732
2026-08-09T05:33:28Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (5675 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-09T05:33:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:33:28Z Disabled control of system clock
I20260809 05:33:28.250527 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:42641
--webserver_interface=127.26.185.62
--webserver_port=0
--builtin_ntp_servers=127.26.185.20:43737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:42641
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 05:33:28.715350 25658 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:28.715855 25658 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:28.716071 25658 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:28.724709 25658 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:33:28.724879 25658 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:28.724996 25658 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:28.725102 25658 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:33:28.725175 25658 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:33:28.738129 25658 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:43737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:42641
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:42641
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:28.740139 25658 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:28.742854 25658 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:28.758090 25672 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:28.758181 25678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:28.758213 25673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:28.759363 25658 server_base.cc:1034] running on GCE node
I20260809 05:33:28.760447 25658 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:28.762454 25658 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:28.763733 25658 hybrid_clock.cc:648] HybridClock initialized: now 1786253608763675 us; error 52 us; skew 500 ppm
I20260809 05:33:28.764240 25658 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 05:33:28.767278 25658 webserver.cc:460] Webserver started at http://127.26.185.62:45465/ using document root <none> and password file <none>
I20260809 05:33:28.768224 25658 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:28.768378 25658 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:28.768803 25658 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:28.772640 25658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "b938e30bd4584c1a9b6d5fcf1774013d"
format_stamp: "Formatted at 2026-08-09 05:33:28 on dist-test-slave-h3ft"
server_key: "6a37ba9fd24cf9c5d4854e06d75e1a75"
server_key_iv: "88a3e1e445a931c6116c33d58dd9fd52"
server_key_version: "encryptionkey@0"
I20260809 05:33:28.773789 25658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "b938e30bd4584c1a9b6d5fcf1774013d"
format_stamp: "Formatted at 2026-08-09 05:33:28 on dist-test-slave-h3ft"
server_key: "6a37ba9fd24cf9c5d4854e06d75e1a75"
server_key_iv: "88a3e1e445a931c6116c33d58dd9fd52"
server_key_version: "encryptionkey@0"
I20260809 05:33:28.780645 25658 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260809 05:33:28.786429 25686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:28.788452 25658 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260809 05:33:28.788722 25658 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "b938e30bd4584c1a9b6d5fcf1774013d"
format_stamp: "Formatted at 2026-08-09 05:33:28 on dist-test-slave-h3ft"
server_key: "6a37ba9fd24cf9c5d4854e06d75e1a75"
server_key_iv: "88a3e1e445a931c6116c33d58dd9fd52"
server_key_version: "encryptionkey@0"
I20260809 05:33:28.789029 25658 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:28.808758 25658 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:28.810037 25658 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:28.810461 25658 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:28.834609 25658 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:42641
I20260809 05:33:28.834631 25769 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:42641 every 8 connection(s)
I20260809 05:33:28.836769 25658 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:33:28.842603 25770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:28.847232 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 25658
I20260809 05:33:28.847755 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:33:28.848670 27364 external_mini_cluster.cc:1428] Setting key 401d90b5f866d3effeaf642cfd74305f
I20260809 05:33:28.861449 25770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b938e30bd4584c1a9b6d5fcf1774013d: Bootstrap starting.
I20260809 05:33:28.866843 25770 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b938e30bd4584c1a9b6d5fcf1774013d: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:28.867941 25775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:28.851777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58032 (local address 127.26.185.62:42641)
0809 05:33:28.853420 (+ 1643us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:28.853439 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:28.853527 (+ 88us) server_negotiation.cc:407] Connection header received
0809 05:33:28.855871 (+ 2344us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:28.855907 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:28.856613 (+ 706us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:28.857081 (+ 468us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:28.857940 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:28.859584 (+ 1644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:28.861895 (+ 2311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:28.862766 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:28.862941 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:28.864700 (+ 1759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:28.864711 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:28.864730 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:28.865449 (+ 719us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:28.865597 (+ 148us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:28.865625 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:28.865737 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:28.866019 (+ 282us) server_negotiation.cc:299] Negotiation successful
0809 05:33:28.866499 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":899,"thread_start_us":609,"threads_started":1}
I20260809 05:33:28.868499 25770 log.cc:824] T 00000000000000000000000000000000 P b938e30bd4584c1a9b6d5fcf1774013d: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:28.873116 25770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b938e30bd4584c1a9b6d5fcf1774013d: No bootstrap required, opened a new log
I20260809 05:33:28.882855 25770 raft_consensus.cc:348] T 00000000000000000000000000000000 P b938e30bd4584c1a9b6d5fcf1774013d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b938e30bd4584c1a9b6d5fcf1774013d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42641 } }
I20260809 05:33:28.883569 25770 raft_consensus.cc:374] T 00000000000000000000000000000000 P b938e30bd4584c1a9b6d5fcf1774013d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:28.883702 25770 raft_consensus.cc:729] T 00000000000000000000000000000000 P b938e30bd4584c1a9b6d5fcf1774013d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b938e30bd4584c1a9b6d5fcf1774013d, State: Initialized, Role: FOLLOWER
I20260809 05:33:28.884570 25770 consensus_queue.cc:260] T 00000000000000000000000000000000 P b938e30bd4584c1a9b6d5fcf1774013d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b938e30bd4584c1a9b6d5fcf1774013d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42641 } }
I20260809 05:33:28.884972 25770 raft_consensus.cc:388] T 00000000000000000000000000000000 P b938e30bd4584c1a9b6d5fcf1774013d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:33:28.885262 25770 raft_consensus.cc:482] T 00000000000000000000000000000000 P b938e30bd4584c1a9b6d5fcf1774013d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:33:28.885524 25770 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b938e30bd4584c1a9b6d5fcf1774013d [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:28.888458 25770 raft_consensus.cc:504] T 00000000000000000000000000000000 P b938e30bd4584c1a9b6d5fcf1774013d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b938e30bd4584c1a9b6d5fcf1774013d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42641 } }
I20260809 05:33:28.889134 25770 leader_election.cc:302] T 00000000000000000000000000000000 P b938e30bd4584c1a9b6d5fcf1774013d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b938e30bd4584c1a9b6d5fcf1774013d; no voters:
I20260809 05:33:28.889830 25770 leader_election.cc:288] T 00000000000000000000000000000000 P b938e30bd4584c1a9b6d5fcf1774013d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:33:28.890097 25777 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b938e30bd4584c1a9b6d5fcf1774013d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:33:28.891134 25777 raft_consensus.cc:686] T 00000000000000000000000000000000 P b938e30bd4584c1a9b6d5fcf1774013d [term 1 LEADER]: Becoming Leader. State: Replica: b938e30bd4584c1a9b6d5fcf1774013d, State: Running, Role: LEADER
I20260809 05:33:28.891884 25777 consensus_queue.cc:237] T 00000000000000000000000000000000 P b938e30bd4584c1a9b6d5fcf1774013d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b938e30bd4584c1a9b6d5fcf1774013d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42641 } }
I20260809 05:33:28.892908 25770 sys_catalog.cc:564] T 00000000000000000000000000000000 P b938e30bd4584c1a9b6d5fcf1774013d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:33:28.895645 25780 sys_catalog.cc:455] T 00000000000000000000000000000000 P b938e30bd4584c1a9b6d5fcf1774013d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b938e30bd4584c1a9b6d5fcf1774013d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b938e30bd4584c1a9b6d5fcf1774013d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42641 } } }
I20260809 05:33:28.896090 25780 sys_catalog.cc:458] T 00000000000000000000000000000000 P b938e30bd4584c1a9b6d5fcf1774013d [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:28.897141 25789 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:33:28.896916 25781 sys_catalog.cc:455] T 00000000000000000000000000000000 P b938e30bd4584c1a9b6d5fcf1774013d [sys.catalog]: SysCatalogTable state changed. Reason: New leader b938e30bd4584c1a9b6d5fcf1774013d. Latest consensus state: current_term: 1 leader_uuid: "b938e30bd4584c1a9b6d5fcf1774013d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b938e30bd4584c1a9b6d5fcf1774013d" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42641 } } }
I20260809 05:33:28.898422 25781 sys_catalog.cc:458] T 00000000000000000000000000000000 P b938e30bd4584c1a9b6d5fcf1774013d [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:28.905468 25789 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:33:28.918068 25789 catalog_manager.cc:1347] Generated new cluster ID: e55d57c1bf1e4c679c631c51098b90af
I20260809 05:33:28.918288 25789 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:33:28.946367 25789 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:33:28.948175 25789 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:33:28.957260 25789 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b938e30bd4584c1a9b6d5fcf1774013d: Generated new TSK 0
I20260809 05:33:28.958581 25789 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 05:33:28.964748 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.1:0
--local_ip_for_outbound_sockets=127.26.185.1
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:42641
--builtin_ntp_servers=127.26.185.20:43737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 05:33:29.409515 25807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:29.409942 25807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:29.410102 25807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:29.418704 25807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:29.418875 25807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:29.419113 25807 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.1
I20260809 05:33:29.430080 25807 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:43737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.185.1
--webserver_port=0
--tserver_master_addrs=127.26.185.62:42641
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.1
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:29.432261 25807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:29.434674 25807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:29.451815 25815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:29.451751 25818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:29.451871 25816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:29.452836 25807 server_base.cc:1034] running on GCE node
I20260809 05:33:29.453687 25807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:29.455159 25807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:29.456445 25807 hybrid_clock.cc:648] HybridClock initialized: now 1786253609456386 us; error 59 us; skew 500 ppm
I20260809 05:33:29.456998 25807 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 05:33:29.460206 25807 webserver.cc:460] Webserver started at http://127.26.185.1:42961/ using document root <none> and password file <none>
I20260809 05:33:29.461259 25807 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:29.461428 25807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:29.461867 25807 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:29.465893 25807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-0/data/instance:
uuid: "74549fa5de754393815003f7c8d194dc"
format_stamp: "Formatted at 2026-08-09 05:33:29 on dist-test-slave-h3ft"
server_key: "5d84955f772f420142281d90e625974a"
server_key_iv: "5148daf469ddacf3d66589d86e0fe4ca"
server_key_version: "encryptionkey@0"
I20260809 05:33:29.466943 25807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance:
uuid: "74549fa5de754393815003f7c8d194dc"
format_stamp: "Formatted at 2026-08-09 05:33:29 on dist-test-slave-h3ft"
server_key: "5d84955f772f420142281d90e625974a"
server_key_iv: "5148daf469ddacf3d66589d86e0fe4ca"
server_key_version: "encryptionkey@0"
I20260809 05:33:29.474447 25807 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.003s sys 0.003s
I20260809 05:33:29.479663 25824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:29.481668 25807 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.003s
I20260809 05:33:29.481963 25807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-0/wal
uuid: "74549fa5de754393815003f7c8d194dc"
format_stamp: "Formatted at 2026-08-09 05:33:29 on dist-test-slave-h3ft"
server_key: "5d84955f772f420142281d90e625974a"
server_key_iv: "5148daf469ddacf3d66589d86e0fe4ca"
server_key_version: "encryptionkey@0"
I20260809 05:33:29.482295 25807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:29.504186 25807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:29.505406 25807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:29.505831 25807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:29.507263 25807 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:33:29.509341 25807 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:33:29.509500 25807 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:29.509675 25807 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:33:29.509778 25807 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:29.552217 25807 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.1:44807
I20260809 05:33:29.552276 26006 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.1:44807 every 8 connection(s)
I20260809 05:33:29.554101 25807 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-0/data/info.pb
I20260809 05:33:29.554944 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 25807
I20260809 05:33:29.555218 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-0/wal/instance
I20260809 05:33:29.555984 27364 external_mini_cluster.cc:1428] Setting key 77aebf755d05682b680237bacc0fbd60
I20260809 05:33:29.560335 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.2:0
--local_ip_for_outbound_sockets=127.26.185.2
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:42641
--builtin_ntp_servers=127.26.185.20:43737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 05:33:29.573642 26009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:29.558074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:52965 (local address 127.26.185.62:42641)
0809 05:33:29.558703 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:29.558712 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:29.560685 (+ 1973us) server_negotiation.cc:407] Connection header received
0809 05:33:29.564063 (+ 3378us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:29.564069 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:29.564173 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:29.564279 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:29.566120 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:29.566954 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:29.569843 (+ 2889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:29.570334 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:29.570453 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:29.572679 (+ 2226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:29.572685 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:29.572688 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:29.572716 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:29.572771 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:29.572785 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:29.572860 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:29.573198 (+ 338us) server_negotiation.cc:299] Negotiation successful
0809 05:33:29.573310 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":485,"thread_start_us":327,"threads_started":1}
I20260809 05:33:29.575687 26012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:29.559056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:42641 (local address 127.26.185.1:52965)
0809 05:33:29.560458 (+ 1402us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:29.560524 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:29.563620 (+ 3096us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:29.564644 (+ 1024us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:29.564663 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:29.564826 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:33:29.565883 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:29.565925 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:29.567182 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:29.567189 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:29.569616 (+ 2427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:29.569640 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:29.570639 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:29.570649 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:29.571120 (+ 471us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:29.572155 (+ 1035us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 05:33:29.572161 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:33:29.572243 (+ 82us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 05:33:29.572392 (+ 149us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:33:29.572895 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:33:29.572916 (+ 21us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:33:29.572929 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 05:33:29.573186 (+ 257us) client_negotiation.cc:240] Negotiation successful
0809 05:33:29.573784 (+ 598us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"thread_start_us":376,"threads_started":1}
I20260809 05:33:29.577961 26007 heartbeater.cc:347] Connected to a master server at 127.26.185.62:42641
I20260809 05:33:29.578415 26007 heartbeater.cc:464] Registering TS with master...
I20260809 05:33:29.579787 26007 heartbeater.cc:511] Master 127.26.185.62:42641 requested a full tablet report, sending...
I20260809 05:33:29.583381 25710 ts_manager.cc:194] Registered new tserver with Master: 74549fa5de754393815003f7c8d194dc (127.26.185.1:44807)
I20260809 05:33:29.586043 25710 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.185.1:52965
W20260809 05:33:30.008961 26013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:30.009413 26013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:30.009521 26013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:30.018586 26013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:30.018778 26013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:30.018915 26013 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.2
I20260809 05:33:30.030033 26013 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:43737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.185.2
--webserver_port=0
--tserver_master_addrs=127.26.185.62:42641
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.2
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:30.032124 26013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:30.034638 26013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:30.051931 26026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:30.052038 26024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:30.052472 26019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:30.053392 26013 server_base.cc:1034] running on GCE node
I20260809 05:33:30.054381 26013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:30.055867 26013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:30.057195 26013 hybrid_clock.cc:648] HybridClock initialized: now 1786253610057120 us; error 54 us; skew 500 ppm
I20260809 05:33:30.057688 26013 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 05:33:30.061569 26013 webserver.cc:460] Webserver started at http://127.26.185.2:44539/ using document root <none> and password file <none>
I20260809 05:33:30.062625 26013 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:30.062745 26013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:30.063294 26013 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:30.068153 26013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-1/data/instance:
uuid: "0760695eb8a64a5496b954d00968cb8e"
format_stamp: "Formatted at 2026-08-09 05:33:30 on dist-test-slave-h3ft"
server_key: "d36452cedfe660fbaf14b512a5ac003c"
server_key_iv: "1e9a8952e2148373afd5ae0a4c002a87"
server_key_version: "encryptionkey@0"
I20260809 05:33:30.069262 26013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance:
uuid: "0760695eb8a64a5496b954d00968cb8e"
format_stamp: "Formatted at 2026-08-09 05:33:30 on dist-test-slave-h3ft"
server_key: "d36452cedfe660fbaf14b512a5ac003c"
server_key_iv: "1e9a8952e2148373afd5ae0a4c002a87"
server_key_version: "encryptionkey@0"
I20260809 05:33:30.076642 26013 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260809 05:33:30.081738 26035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:30.083863 26013 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260809 05:33:30.084139 26013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-1/wal
uuid: "0760695eb8a64a5496b954d00968cb8e"
format_stamp: "Formatted at 2026-08-09 05:33:30 on dist-test-slave-h3ft"
server_key: "d36452cedfe660fbaf14b512a5ac003c"
server_key_iv: "1e9a8952e2148373afd5ae0a4c002a87"
server_key_version: "encryptionkey@0"
I20260809 05:33:30.084448 26013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:30.105870 26013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:30.107205 26013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:30.107621 26013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:30.108956 26013 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:33:30.110905 26013 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:33:30.111058 26013 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:30.111223 26013 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:33:30.111310 26013 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:30.151347 26013 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.2:42325
I20260809 05:33:30.151391 26234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.2:42325 every 8 connection(s)
I20260809 05:33:30.153215 26013 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-1/data/info.pb
I20260809 05:33:30.162736 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 26013
I20260809 05:33:30.163091 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-1/wal/instance
I20260809 05:33:30.163679 27364 external_mini_cluster.cc:1428] Setting key f94e78e4f5cc4ad1853e9f388f862a16
I20260809 05:33:30.167680 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.185.3:0
--local_ip_for_outbound_sockets=127.26.185.3
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:42641
--builtin_ntp_servers=127.26.185.20:43737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 05:33:30.169744 26240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:30.156616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.2:33693 (local address 127.26.185.62:42641)
0809 05:33:30.157193 (+ 577us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:30.157199 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:30.158551 (+ 1352us) server_negotiation.cc:407] Connection header received
0809 05:33:30.160817 (+ 2266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:30.160824 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:30.160950 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:30.161121 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:30.162618 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.163659 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.165986 (+ 2327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.166576 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.166726 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:30.168584 (+ 1858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:30.168593 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:30.168601 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:30.168632 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:30.168704 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:30.168723 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:30.168837 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:30.169083 (+ 246us) server_negotiation.cc:299] Negotiation successful
0809 05:33:30.169227 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":299,"threads_started":1}
I20260809 05:33:30.170933 26241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:30.157236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:42641 (local address 127.26.185.2:33693)
0809 05:33:30.158344 (+ 1108us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:30.158389 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:30.160435 (+ 2046us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:30.161408 (+ 973us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:30.161418 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:30.161544 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:33:30.162346 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:30.162369 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.163855 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.163861 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:30.165778 (+ 1917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:30.165797 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.166835 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.166840 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:30.167188 (+ 348us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:30.168156 (+ 968us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 05:33:30.168159 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:33:30.168214 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 05:33:30.168325 (+ 111us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:33:30.168845 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:33:30.168858 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:33:30.168868 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 05:33:30.169054 (+ 186us) client_negotiation.cc:240] Negotiation successful
0809 05:33:30.169469 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":333,"threads_started":1}
I20260809 05:33:30.172856 26237 heartbeater.cc:347] Connected to a master server at 127.26.185.62:42641
I20260809 05:33:30.173266 26237 heartbeater.cc:464] Registering TS with master...
I20260809 05:33:30.174273 26237 heartbeater.cc:511] Master 127.26.185.62:42641 requested a full tablet report, sending...
I20260809 05:33:30.176205 25710 ts_manager.cc:194] Registered new tserver with Master: 0760695eb8a64a5496b954d00968cb8e (127.26.185.2:42325)
I20260809 05:33:30.177206 25710 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.185.2:33693
I20260809 05:33:30.590785 26007 heartbeater.cc:503] Master 127.26.185.62:42641 was elected leader, sending a full tablet report...
W20260809 05:33:30.606071 26244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:30.606508 26244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:30.606698 26244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:30.614923 26244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:30.615134 26244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:30.615337 26244 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.185.3
I20260809 05:33:30.625523 26244 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:43737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.185.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.185.3
--webserver_port=0
--tserver_master_addrs=127.26.185.62:42641
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.185.3
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:30.627481 26244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:30.629884 26244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:30.646282 26255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:30.646391 26250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:30.646183 26249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:30.647094 26244 server_base.cc:1034] running on GCE node
I20260809 05:33:30.648132 26244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:30.649299 26244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:30.650514 26244 hybrid_clock.cc:648] HybridClock initialized: now 1786253610650453 us; error 50 us; skew 500 ppm
I20260809 05:33:30.650918 26244 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 05:33:30.654191 26244 webserver.cc:460] Webserver started at http://127.26.185.3:40695/ using document root <none> and password file <none>
I20260809 05:33:30.655196 26244 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:30.655344 26244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:30.655747 26244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:30.659714 26244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-2/data/instance:
uuid: "aa4d2a590f884f938c7f93d5ccbad9bf"
format_stamp: "Formatted at 2026-08-09 05:33:30 on dist-test-slave-h3ft"
server_key: "fee90fad76c5db0bdac5471189cd0498"
server_key_iv: "9fcc521eda3f346923e52e07f0ebb7a3"
server_key_version: "encryptionkey@0"
I20260809 05:33:30.660722 26244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance:
uuid: "aa4d2a590f884f938c7f93d5ccbad9bf"
format_stamp: "Formatted at 2026-08-09 05:33:30 on dist-test-slave-h3ft"
server_key: "fee90fad76c5db0bdac5471189cd0498"
server_key_iv: "9fcc521eda3f346923e52e07f0ebb7a3"
server_key_version: "encryptionkey@0"
I20260809 05:33:30.667713 26244 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.004s
I20260809 05:33:30.672313 26272 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:30.674256 26244 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 05:33:30.674449 26244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-2/wal
uuid: "aa4d2a590f884f938c7f93d5ccbad9bf"
format_stamp: "Formatted at 2026-08-09 05:33:30 on dist-test-slave-h3ft"
server_key: "fee90fad76c5db0bdac5471189cd0498"
server_key_iv: "9fcc521eda3f346923e52e07f0ebb7a3"
server_key_version: "encryptionkey@0"
I20260809 05:33:30.674686 26244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:30.692034 26244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:30.693171 26244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:30.694012 26244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:30.695545 26244 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 05:33:30.697366 26244 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 05:33:30.697470 26244 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:30.697568 26244 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 05:33:30.697628 26244 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:30.737527 26244 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.3:41711
I20260809 05:33:30.737576 26455 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.3:41711 every 8 connection(s)
I20260809 05:33:30.739437 26244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-2/data/info.pb
I20260809 05:33:30.746016 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 26244
I20260809 05:33:30.746281 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-2/wal/instance
I20260809 05:33:30.747085 27364 external_mini_cluster.cc:1428] Setting key d4c325875ceff121f0ef6d3ba3e72eb2
I20260809 05:33:30.758657 26461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:30.744976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.3:32955 (local address 127.26.185.62:42641)
0809 05:33:30.745611 (+ 635us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:30.745619 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:30.748045 (+ 2426us) server_negotiation.cc:407] Connection header received
0809 05:33:30.750599 (+ 2554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:30.750606 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:30.750706 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:30.750807 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:30.752273 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.753182 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.755084 (+ 1902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.755597 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.755718 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:30.757646 (+ 1928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:30.757652 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:30.757656 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:30.757684 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:30.757738 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:30.757758 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:30.757869 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:30.758148 (+ 279us) server_negotiation.cc:299] Negotiation successful
0809 05:33:30.758280 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":279,"threads_started":1}
I20260809 05:33:30.760022 26462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:30.745826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:42641 (local address 127.26.185.3:32955)
0809 05:33:30.747830 (+ 2004us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:30.747893 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:30.750226 (+ 2333us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:30.751195 (+ 969us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:30.751207 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:30.751329 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:33:30.752091 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:30.752112 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.753341 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.753346 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:30.754835 (+ 1489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:30.754851 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.755860 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.755865 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:30.756158 (+ 293us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:30.757179 (+ 1021us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 05:33:30.757182 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:33:30.757256 (+ 74us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 05:33:30.757401 (+ 145us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:33:30.757870 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:33:30.757879 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:33:30.757885 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 05:33:30.758081 (+ 196us) client_negotiation.cc:240] Negotiation successful
0809 05:33:30.758522 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1095,"thread_start_us":736,"threads_started":1}
I20260809 05:33:30.762073 26456 heartbeater.cc:347] Connected to a master server at 127.26.185.62:42641
I20260809 05:33:30.762519 26456 heartbeater.cc:464] Registering TS with master...
I20260809 05:33:30.763718 26456 heartbeater.cc:511] Master 127.26.185.62:42641 requested a full tablet report, sending...
I20260809 05:33:30.765524 25710 ts_manager.cc:194] Registered new tserver with Master: aa4d2a590f884f938c7f93d5ccbad9bf (127.26.185.3:41711)
I20260809 05:33:30.766513 25710 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.185.3:32955
I20260809 05:33:30.777380 27364 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 05:33:30.790283 26461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:30.782850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58038 (local address 127.26.185.62:42641)
0809 05:33:30.783165 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:30.783170 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:30.783644 (+ 474us) server_negotiation.cc:407] Connection header received
0809 05:33:30.783869 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:30.783915 (+ 46us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:30.784028 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:30.784139 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:30.784732 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.785601 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.787304 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.787759 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.787876 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:30.789317 (+ 1441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:30.789322 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:30.789326 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:30.789350 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:30.789397 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:30.789411 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:30.789550 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:30.789726 (+ 176us) server_negotiation.cc:299] Negotiation successful
0809 05:33:30.789920 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260809 05:33:30.796056 25710 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58038:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 05:33:30.805437 25710 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 05:33:30.838238 26479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:30.822917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.1:44807 (local address 127.0.0.1:49452)
0809 05:33:30.825159 (+ 2242us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:30.825183 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:30.825308 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:30.829207 (+ 3899us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:30.829215 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:30.829254 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:30.829636 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:30.829647 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.831520 (+ 1873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.831526 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:30.834236 (+ 2710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:30.834255 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.836677 (+ 2422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.836684 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:30.836945 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:30.837011 (+ 66us) client_negotiation.cc:769] Sending connection context
0809 05:33:30.837150 (+ 139us) client_negotiation.cc:240] Negotiation successful
0809 05:33:30.837406 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2093,"thread_start_us":515,"threads_started":1}
I20260809 05:33:30.839761 26478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:30.823785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49452 (local address 127.26.185.1:44807)
0809 05:33:30.828321 (+ 4536us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:30.828335 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:30.828378 (+ 43us) server_negotiation.cc:407] Connection header received
0809 05:33:30.828519 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:30.828529 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:30.828900 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:30.829824 (+ 924us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:30.830075 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.831340 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.834560 (+ 3220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.836427 (+ 1867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.838572 (+ 2145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:30.838968 (+ 396us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:30.839101 (+ 133us) server_negotiation.cc:299] Negotiation successful
0809 05:33:30.839344 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4311,"thread_start_us":4114,"threads_started":1}
I20260809 05:33:30.843729 26474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:30.824490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:42325 (local address 127.0.0.1:38762)
0809 05:33:30.827575 (+ 3085us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:30.827597 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:30.827700 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:30.832415 (+ 4715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:30.832424 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:30.832467 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:30.833101 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:30.833121 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.837421 (+ 4300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.837426 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:30.840432 (+ 3006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:30.840451 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.842679 (+ 2228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.842686 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:30.842934 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:30.842988 (+ 54us) client_negotiation.cc:769] Sending connection context
0809 05:33:30.843098 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 05:33:30.843287 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2940,"thread_start_us":892,"threads_started":1}
I20260809 05:33:30.845319 26485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:30.825198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38762 (local address 127.26.185.2:42325)
0809 05:33:30.831609 (+ 6411us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:30.831622 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:30.831666 (+ 44us) server_negotiation.cc:407] Connection header received
0809 05:33:30.831788 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:30.831799 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:30.832120 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:30.832375 (+ 255us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:30.835700 (+ 3325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.837259 (+ 1559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.840736 (+ 3477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.842389 (+ 1653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.844178 (+ 1789us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:30.844535 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:30.844637 (+ 102us) server_negotiation.cc:299] Negotiation successful
0809 05:33:30.844879 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6185,"thread_start_us":6045,"threads_started":1}
I20260809 05:33:30.848444 25907 tablet_service.cc:1467] Processing CreateTablet for tablet 87ec504adc114405bcb45556cf1e6544 (DEFAULT_TABLE table=test-table [id=76f32b74fb4f44449fbbf217cebde228]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:33:30.850448 25907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87ec504adc114405bcb45556cf1e6544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:30.850076 26114 tablet_service.cc:1467] Processing CreateTablet for tablet 87ec504adc114405bcb45556cf1e6544 (DEFAULT_TABLE table=test-table [id=76f32b74fb4f44449fbbf217cebde228]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:33:30.851854 26114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87ec504adc114405bcb45556cf1e6544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:30.858594 26476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:30.822869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:41711 (local address 127.0.0.1:43434)
0809 05:33:30.824114 (+ 1245us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:30.824184 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:30.824411 (+ 227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:30.835058 (+ 10647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:30.835064 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:30.835096 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:30.835568 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:30.835579 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.837693 (+ 2114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.837699 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:30.854289 (+ 16590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:30.854323 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.857541 (+ 3218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.857550 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:30.857778 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:30.857833 (+ 55us) client_negotiation.cc:769] Sending connection context
0809 05:33:30.857965 (+ 132us) client_negotiation.cc:240] Negotiation successful
0809 05:33:30.858162 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":813,"thread_start_us":4403,"threads_started":1}
I20260809 05:33:30.859081 26484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:30.824318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43434 (local address 127.26.185.3:41711)
0809 05:33:30.834136 (+ 9818us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:30.834149 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:30.834197 (+ 48us) server_negotiation.cc:407] Connection header received
0809 05:33:30.834351 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:30.834364 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:30.834752 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:30.835047 (+ 295us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:30.835798 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.837508 (+ 1710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.855390 (+ 17882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.857202 (+ 1812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.857458 (+ 256us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:30.857841 (+ 383us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:30.858131 (+ 290us) server_negotiation.cc:299] Negotiation successful
0809 05:33:30.858367 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9556,"thread_start_us":26710,"threads_started":1}
I20260809 05:33:30.864974 26343 tablet_service.cc:1467] Processing CreateTablet for tablet 87ec504adc114405bcb45556cf1e6544 (DEFAULT_TABLE table=test-table [id=76f32b74fb4f44449fbbf217cebde228]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 05:33:30.867280 26343 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87ec504adc114405bcb45556cf1e6544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:30.870419 26487 tablet_bootstrap.cc:492] T 87ec504adc114405bcb45556cf1e6544 P 0760695eb8a64a5496b954d00968cb8e: Bootstrap starting.
I20260809 05:33:30.872953 26489 tablet_bootstrap.cc:492] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc: Bootstrap starting.
I20260809 05:33:30.876631 26487 tablet_bootstrap.cc:654] T 87ec504adc114405bcb45556cf1e6544 P 0760695eb8a64a5496b954d00968cb8e: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:30.877369 26489 tablet_bootstrap.cc:654] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:30.878432 26487 log.cc:824] T 87ec504adc114405bcb45556cf1e6544 P 0760695eb8a64a5496b954d00968cb8e: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:30.878759 26489 log.cc:824] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:30.882498 26487 tablet_bootstrap.cc:492] T 87ec504adc114405bcb45556cf1e6544 P 0760695eb8a64a5496b954d00968cb8e: No bootstrap required, opened a new log
I20260809 05:33:30.882825 26489 tablet_bootstrap.cc:492] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc: No bootstrap required, opened a new log
I20260809 05:33:30.882872 26487 ts_tablet_manager.cc:1397] T 87ec504adc114405bcb45556cf1e6544 P 0760695eb8a64a5496b954d00968cb8e: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.000s
I20260809 05:33:30.883249 26489 ts_tablet_manager.cc:1397] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc: Time spent bootstrapping tablet: real 0.011s user 0.010s sys 0.000s
I20260809 05:33:30.886219 26492 tablet_bootstrap.cc:492] T 87ec504adc114405bcb45556cf1e6544 P aa4d2a590f884f938c7f93d5ccbad9bf: Bootstrap starting.
I20260809 05:33:30.891750 26492 tablet_bootstrap.cc:654] T 87ec504adc114405bcb45556cf1e6544 P aa4d2a590f884f938c7f93d5ccbad9bf: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:30.893323 26492 log.cc:824] T 87ec504adc114405bcb45556cf1e6544 P aa4d2a590f884f938c7f93d5ccbad9bf: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:30.893436 26489 raft_consensus.cc:348] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74549fa5de754393815003f7c8d194dc" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 44807 } } peers { permanent_uuid: "aa4d2a590f884f938c7f93d5ccbad9bf" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 41711 } } peers { permanent_uuid: "0760695eb8a64a5496b954d00968cb8e" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42325 } }
I20260809 05:33:30.894157 26489 raft_consensus.cc:374] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:30.894275 26489 raft_consensus.cc:729] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74549fa5de754393815003f7c8d194dc, State: Initialized, Role: FOLLOWER
I20260809 05:33:30.893993 26487 raft_consensus.cc:348] T 87ec504adc114405bcb45556cf1e6544 P 0760695eb8a64a5496b954d00968cb8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74549fa5de754393815003f7c8d194dc" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 44807 } } peers { permanent_uuid: "aa4d2a590f884f938c7f93d5ccbad9bf" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 41711 } } peers { permanent_uuid: "0760695eb8a64a5496b954d00968cb8e" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42325 } }
I20260809 05:33:30.894588 26487 raft_consensus.cc:374] T 87ec504adc114405bcb45556cf1e6544 P 0760695eb8a64a5496b954d00968cb8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:30.894707 26487 raft_consensus.cc:729] T 87ec504adc114405bcb45556cf1e6544 P 0760695eb8a64a5496b954d00968cb8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0760695eb8a64a5496b954d00968cb8e, State: Initialized, Role: FOLLOWER
I20260809 05:33:30.895251 26489 consensus_queue.cc:260] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74549fa5de754393815003f7c8d194dc" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 44807 } } peers { permanent_uuid: "aa4d2a590f884f938c7f93d5ccbad9bf" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 41711 } } peers { permanent_uuid: "0760695eb8a64a5496b954d00968cb8e" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42325 } }
I20260809 05:33:30.895373 26487 consensus_queue.cc:260] T 87ec504adc114405bcb45556cf1e6544 P 0760695eb8a64a5496b954d00968cb8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74549fa5de754393815003f7c8d194dc" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 44807 } } peers { permanent_uuid: "aa4d2a590f884f938c7f93d5ccbad9bf" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 41711 } } peers { permanent_uuid: "0760695eb8a64a5496b954d00968cb8e" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42325 } }
I20260809 05:33:30.897393 26489 ts_tablet_manager.cc:1428] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260809 05:33:30.898576 26492 tablet_bootstrap.cc:492] T 87ec504adc114405bcb45556cf1e6544 P aa4d2a590f884f938c7f93d5ccbad9bf: No bootstrap required, opened a new log
I20260809 05:33:30.898995 26492 ts_tablet_manager.cc:1397] T 87ec504adc114405bcb45556cf1e6544 P aa4d2a590f884f938c7f93d5ccbad9bf: Time spent bootstrapping tablet: real 0.013s user 0.010s sys 0.000s
I20260809 05:33:30.907899 26237 heartbeater.cc:503] Master 127.26.185.62:42641 was elected leader, sending a full tablet report...
I20260809 05:33:30.908993 26487 ts_tablet_manager.cc:1428] T 87ec504adc114405bcb45556cf1e6544 P 0760695eb8a64a5496b954d00968cb8e: Time spent starting tablet: real 0.026s user 0.011s sys 0.016s
I20260809 05:33:30.912215 26492 raft_consensus.cc:348] T 87ec504adc114405bcb45556cf1e6544 P aa4d2a590f884f938c7f93d5ccbad9bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74549fa5de754393815003f7c8d194dc" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 44807 } } peers { permanent_uuid: "aa4d2a590f884f938c7f93d5ccbad9bf" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 41711 } } peers { permanent_uuid: "0760695eb8a64a5496b954d00968cb8e" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42325 } }
I20260809 05:33:30.912750 26492 raft_consensus.cc:374] T 87ec504adc114405bcb45556cf1e6544 P aa4d2a590f884f938c7f93d5ccbad9bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:30.912884 26492 raft_consensus.cc:729] T 87ec504adc114405bcb45556cf1e6544 P aa4d2a590f884f938c7f93d5ccbad9bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa4d2a590f884f938c7f93d5ccbad9bf, State: Initialized, Role: FOLLOWER
I20260809 05:33:30.913666 26492 consensus_queue.cc:260] T 87ec504adc114405bcb45556cf1e6544 P aa4d2a590f884f938c7f93d5ccbad9bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74549fa5de754393815003f7c8d194dc" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 44807 } } peers { permanent_uuid: "aa4d2a590f884f938c7f93d5ccbad9bf" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 41711 } } peers { permanent_uuid: "0760695eb8a64a5496b954d00968cb8e" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42325 } }
I20260809 05:33:30.915088 26456 heartbeater.cc:503] Master 127.26.185.62:42641 was elected leader, sending a full tablet report...
I20260809 05:33:30.915613 26492 ts_tablet_manager.cc:1428] T 87ec504adc114405bcb45556cf1e6544 P aa4d2a590f884f938c7f93d5ccbad9bf: Time spent starting tablet: real 0.016s user 0.016s sys 0.000s
I20260809 05:33:30.932511 26495 raft_consensus.cc:482] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 05:33:30.932889 26495 raft_consensus.cc:504] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74549fa5de754393815003f7c8d194dc" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 44807 } } peers { permanent_uuid: "aa4d2a590f884f938c7f93d5ccbad9bf" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 41711 } } peers { permanent_uuid: "0760695eb8a64a5496b954d00968cb8e" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42325 } }
I20260809 05:33:30.935251 26495 leader_election.cc:288] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa4d2a590f884f938c7f93d5ccbad9bf (127.26.185.3:41711), 0760695eb8a64a5496b954d00968cb8e (127.26.185.2:42325)
I20260809 05:33:30.945957 26485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:30.936206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:43571 (local address 127.26.185.2:42325)
0809 05:33:30.936495 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:30.936505 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:30.936890 (+ 385us) server_negotiation.cc:407] Connection header received
0809 05:33:30.937180 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:30.937185 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:30.937302 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:30.937421 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:30.938344 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.939600 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.943256 (+ 3656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.944579 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.944783 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:30.944871 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:30.945469 (+ 598us) server_negotiation.cc:299] Negotiation successful
0809 05:33:30.945631 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260809 05:33:30.946014 26484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:30.935709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.185.1:37783 (local address 127.26.185.3:41711)
0809 05:33:30.936017 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:30.936027 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:30.937097 (+ 1070us) server_negotiation.cc:407] Connection header received
0809 05:33:30.937254 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:30.937259 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:30.937348 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:30.937449 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 05:33:30.938344 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.939600 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.943261 (+ 3661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.944629 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.944799 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:30.944871 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:30.945470 (+ 599us) server_negotiation.cc:299] Negotiation successful
0809 05:33:30.945637 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260809 05:33:30.946211 26500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:30.935572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.2:42325 (local address 127.26.185.1:43571)
0809 05:33:30.936695 (+ 1123us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:30.936724 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:30.936957 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:30.937485 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:30.937491 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:30.937524 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:30.938133 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:30.938160 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.939835 (+ 1675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.939841 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:30.942946 (+ 3105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:30.942970 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.944902 (+ 1932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.944911 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:30.945192 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:30.945295 (+ 103us) client_negotiation.cc:769] Sending connection context
0809 05:33:30.945407 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 05:33:30.945690 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":926,"mutex_wait_us":355,"thread_start_us":699,"threads_started":1}
I20260809 05:33:30.946524 26504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:30.935593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.3:41711 (local address 127.26.185.1:37783)
0809 05:33:30.936959 (+ 1366us) negotiation.cc:107] Waiting for socket to connect
0809 05:33:30.936977 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 05:33:30.937108 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:33:30.937485 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:33:30.937491 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:33:30.937608 (+ 117us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 05:33:30.938178 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:30.938187 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.939836 (+ 1649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.939841 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:30.942946 (+ 3105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:33:30.942968 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.944921 (+ 1953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.944927 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:33:30.945196 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:30.945293 (+ 97us) client_negotiation.cc:769] Sending connection context
0809 05:33:30.945407 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 05:33:30.945690 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1254,"mutex_wait_us":365,"spinlock_wait_cycles":35712,"thread_start_us":1050,"threads_started":1}
I20260809 05:33:30.947628 26160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87ec504adc114405bcb45556cf1e6544" candidate_uuid: "74549fa5de754393815003f7c8d194dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0760695eb8a64a5496b954d00968cb8e" is_pre_election: true
I20260809 05:33:30.947662 26375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87ec504adc114405bcb45556cf1e6544" candidate_uuid: "74549fa5de754393815003f7c8d194dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa4d2a590f884f938c7f93d5ccbad9bf" is_pre_election: true
I20260809 05:33:30.948290 26160 raft_consensus.cc:2454] T 87ec504adc114405bcb45556cf1e6544 P 0760695eb8a64a5496b954d00968cb8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74549fa5de754393815003f7c8d194dc in term 0.
I20260809 05:33:30.948290 26375 raft_consensus.cc:2454] T 87ec504adc114405bcb45556cf1e6544 P aa4d2a590f884f938c7f93d5ccbad9bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74549fa5de754393815003f7c8d194dc in term 0.
I20260809 05:33:30.949146 25829 leader_election.cc:302] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0760695eb8a64a5496b954d00968cb8e, 74549fa5de754393815003f7c8d194dc, aa4d2a590f884f938c7f93d5ccbad9bf; no voters:
I20260809 05:33:30.949743 26495 raft_consensus.cc:2781] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 05:33:30.949919 26495 raft_consensus.cc:482] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 05:33:30.950048 26495 raft_consensus.cc:3037] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:30.953058 26495 raft_consensus.cc:504] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74549fa5de754393815003f7c8d194dc" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 44807 } } peers { permanent_uuid: "aa4d2a590f884f938c7f93d5ccbad9bf" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 41711 } } peers { permanent_uuid: "0760695eb8a64a5496b954d00968cb8e" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42325 } }
I20260809 05:33:30.953966 26495 leader_election.cc:288] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc [CANDIDATE]: Term 1 election: Requested vote from peers aa4d2a590f884f938c7f93d5ccbad9bf (127.26.185.3:41711), 0760695eb8a64a5496b954d00968cb8e (127.26.185.2:42325)
I20260809 05:33:30.954556 26375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87ec504adc114405bcb45556cf1e6544" candidate_uuid: "74549fa5de754393815003f7c8d194dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa4d2a590f884f938c7f93d5ccbad9bf"
I20260809 05:33:30.954654 26160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87ec504adc114405bcb45556cf1e6544" candidate_uuid: "74549fa5de754393815003f7c8d194dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0760695eb8a64a5496b954d00968cb8e"
I20260809 05:33:30.954840 26375 raft_consensus.cc:3037] T 87ec504adc114405bcb45556cf1e6544 P aa4d2a590f884f938c7f93d5ccbad9bf [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:30.954963 26160 raft_consensus.cc:3037] T 87ec504adc114405bcb45556cf1e6544 P 0760695eb8a64a5496b954d00968cb8e [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:30.957753 26375 raft_consensus.cc:2454] T 87ec504adc114405bcb45556cf1e6544 P aa4d2a590f884f938c7f93d5ccbad9bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74549fa5de754393815003f7c8d194dc in term 1.
I20260809 05:33:30.958016 26160 raft_consensus.cc:2454] T 87ec504adc114405bcb45556cf1e6544 P 0760695eb8a64a5496b954d00968cb8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74549fa5de754393815003f7c8d194dc in term 1.
I20260809 05:33:30.958334 25829 leader_election.cc:302] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74549fa5de754393815003f7c8d194dc, aa4d2a590f884f938c7f93d5ccbad9bf; no voters:
I20260809 05:33:30.958701 26495 raft_consensus.cc:2781] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:33:30.959322 26495 raft_consensus.cc:686] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc [term 1 LEADER]: Becoming Leader. State: Replica: 74549fa5de754393815003f7c8d194dc, State: Running, Role: LEADER
I20260809 05:33:30.959944 26495 consensus_queue.cc:237] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74549fa5de754393815003f7c8d194dc" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 44807 } } peers { permanent_uuid: "aa4d2a590f884f938c7f93d5ccbad9bf" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 41711 } } peers { permanent_uuid: "0760695eb8a64a5496b954d00968cb8e" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42325 } }
I20260809 05:33:30.966512 25710 catalog_manager.cc:5495] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 74549fa5de754393815003f7c8d194dc (127.26.185.1). New cstate: current_term: 1 leader_uuid: "74549fa5de754393815003f7c8d194dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74549fa5de754393815003f7c8d194dc" member_type: VOTER last_known_addr { host: "127.26.185.1" port: 44807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa4d2a590f884f938c7f93d5ccbad9bf" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0760695eb8a64a5496b954d00968cb8e" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42325 } health_report { overall_health: UNKNOWN } } }
W20260809 05:33:30.993654 26460 tablet.cc:2369] T 87ec504adc114405bcb45556cf1e6544 P aa4d2a590f884f938c7f93d5ccbad9bf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:33:30.997328 26478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:30.990550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49458 (local address 127.26.185.1:44807)
0809 05:33:30.990777 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:30.990782 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:30.990806 (+ 24us) server_negotiation.cc:407] Connection header received
0809 05:33:30.990929 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:30.990933 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:30.991143 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:30.991292 (+ 149us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:33:30.991727 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.992498 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.994602 (+ 2104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:30.995264 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:30.995377 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:30.995920 (+ 543us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:33:30.996626 (+ 706us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:33:30.996758 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:30.996889 (+ 131us) server_negotiation.cc:299] Negotiation successful
0809 05:33:30.996975 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 05:33:31.009516 26375 raft_consensus.cc:1261] T 87ec504adc114405bcb45556cf1e6544 P aa4d2a590f884f938c7f93d5ccbad9bf [term 1 FOLLOWER]: Refusing update from remote peer 74549fa5de754393815003f7c8d194dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:33:31.009516 26160 raft_consensus.cc:1261] T 87ec504adc114405bcb45556cf1e6544 P 0760695eb8a64a5496b954d00968cb8e [term 1 FOLLOWER]: Refusing update from remote peer 74549fa5de754393815003f7c8d194dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:33:31.010900 26505 consensus_queue.cc:1035] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0760695eb8a64a5496b954d00968cb8e" member_type: VOTER last_known_addr { host: "127.26.185.2" port: 42325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:33:31.011417 26495 consensus_queue.cc:1035] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa4d2a590f884f938c7f93d5ccbad9bf" member_type: VOTER last_known_addr { host: "127.26.185.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:33:31.025589 26516 mvcc.cc:205] Tried to move back new op lower bound from 7316494790679228416 to 7316494790496595968. Current Snapshot: MvccSnapshot[applied={T|T < 7316494790679228416}]
I20260809 05:33:31.028379 26519 mvcc.cc:205] Tried to move back new op lower bound from 7316494790679228416 to 7316494790496595968. Current Snapshot: MvccSnapshot[applied={T|T < 7316494790679228416}]
I20260809 05:33:31.028606 26517 mvcc.cc:205] Tried to move back new op lower bound from 7316494790679228416 to 7316494790496595968. Current Snapshot: MvccSnapshot[applied={T|T < 7316494790679228416}]
I20260809 05:33:31.046854 25710 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58038:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:33:31.047322 25710 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58038:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 05:33:31.052979 25710 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b938e30bd4584c1a9b6d5fcf1774013d: Sending DeleteTablet for 3 replicas of tablet 87ec504adc114405bcb45556cf1e6544
I20260809 05:33:31.054919 25907 tablet_service.cc:1514] Processing DeleteTablet for tablet 87ec504adc114405bcb45556cf1e6544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:33:31 UTC) from {username='slave'} at 127.0.0.1:49452
I20260809 05:33:31.054917 26343 tablet_service.cc:1514] Processing DeleteTablet for tablet 87ec504adc114405bcb45556cf1e6544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:33:31 UTC) from {username='slave'} at 127.0.0.1:43434
I20260809 05:33:31.054926 26114 tablet_service.cc:1514] Processing DeleteTablet for tablet 87ec504adc114405bcb45556cf1e6544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 05:33:31 UTC) from {username='slave'} at 127.0.0.1:38762
I20260809 05:33:31.058228 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 25807
I20260809 05:33:31.067312 26533 tablet_replica.cc:330] T 87ec504adc114405bcb45556cf1e6544 P 0760695eb8a64a5496b954d00968cb8e: stopping tablet replica
I20260809 05:33:31.068082 26533 raft_consensus.cc:2229] T 87ec504adc114405bcb45556cf1e6544 P 0760695eb8a64a5496b954d00968cb8e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:33:31.069482 26533 raft_consensus.cc:2258] T 87ec504adc114405bcb45556cf1e6544 P 0760695eb8a64a5496b954d00968cb8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:33:31.071759 26536 tablet_replica.cc:330] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc: stopping tablet replica
I20260809 05:33:31.072458 26536 raft_consensus.cc:2229] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc [term 1 LEADER]: Raft consensus shutting down.
I20260809 05:33:31.073518 26536 raft_consensus.cc:2258] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:33:31.074553 26534 tablet_replica.cc:330] T 87ec504adc114405bcb45556cf1e6544 P aa4d2a590f884f938c7f93d5ccbad9bf: stopping tablet replica
I20260809 05:33:31.075196 26534 raft_consensus.cc:2229] T 87ec504adc114405bcb45556cf1e6544 P aa4d2a590f884f938c7f93d5ccbad9bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 05:33:31.075896 26534 raft_consensus.cc:2258] T 87ec504adc114405bcb45556cf1e6544 P aa4d2a590f884f938c7f93d5ccbad9bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 05:33:31.076146 26533 ts_tablet_manager.cc:1905] T 87ec504adc114405bcb45556cf1e6544 P 0760695eb8a64a5496b954d00968cb8e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:33:31.076229 26536 ts_tablet_manager.cc:1905] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:33:31.082521 26534 ts_tablet_manager.cc:1905] T 87ec504adc114405bcb45556cf1e6544 P aa4d2a590f884f938c7f93d5ccbad9bf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 05:33:31.085866 26536 ts_tablet_manager.cc:1918] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:33:31.086151 26536 log.cc:1196] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-0/wal/wals/87ec504adc114405bcb45556cf1e6544
I20260809 05:33:31.086205 26533 ts_tablet_manager.cc:1918] T 87ec504adc114405bcb45556cf1e6544 P 0760695eb8a64a5496b954d00968cb8e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:33:31.086630 26533 log.cc:1196] T 87ec504adc114405bcb45556cf1e6544 P 0760695eb8a64a5496b954d00968cb8e: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-1/wal/wals/87ec504adc114405bcb45556cf1e6544
I20260809 05:33:31.086894 26536 ts_tablet_manager.cc:1939] T 87ec504adc114405bcb45556cf1e6544 P 74549fa5de754393815003f7c8d194dc: Deleting consensus metadata
I20260809 05:33:31.087601 26533 ts_tablet_manager.cc:1939] T 87ec504adc114405bcb45556cf1e6544 P 0760695eb8a64a5496b954d00968cb8e: Deleting consensus metadata
I20260809 05:33:31.089869 25689 catalog_manager.cc:4841] TS 74549fa5de754393815003f7c8d194dc (127.26.185.1:44807): tablet 87ec504adc114405bcb45556cf1e6544 (table test-table [id=76f32b74fb4f44449fbbf217cebde228]) successfully deleted
I20260809 05:33:31.090400 25689 catalog_manager.cc:4841] TS 0760695eb8a64a5496b954d00968cb8e (127.26.185.2:42325): tablet 87ec504adc114405bcb45556cf1e6544 (table test-table [id=76f32b74fb4f44449fbbf217cebde228]) successfully deleted
I20260809 05:33:31.097016 26478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:31.060950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49462 (local address 127.26.185.1:44807)
0809 05:33:31.061309 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:31.061321 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:31.070693 (+ 9372us) server_negotiation.cc:407] Connection header received
0809 05:33:31.071024 (+ 331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:31.071035 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:31.071234 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:31.071436 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:31.074819 (+ 3383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:31.076285 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:31.079273 (+ 2988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:31.080081 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:31.080222 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:31.093689 (+ 13467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:31.093713 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:31.093768 (+ 55us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:31.095568 (+ 1800us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:31.095670 (+ 102us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:31.095714 (+ 44us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:31.095831 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:31.096251 (+ 420us) server_negotiation.cc:299] Negotiation successful
0809 05:33:31.096497 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140}
I20260809 05:33:31.099136 26002 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:33:31.099305 26534 ts_tablet_manager.cc:1918] T 87ec504adc114405bcb45556cf1e6544 P aa4d2a590f884f938c7f93d5ccbad9bf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 05:33:31.099611 26534 log.cc:1196] T 87ec504adc114405bcb45556cf1e6544 P aa4d2a590f884f938c7f93d5ccbad9bf: Deleting WAL directory at /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786253234117492-27364-0/minicluster-data/ts-2/wal/wals/87ec504adc114405bcb45556cf1e6544
I20260809 05:33:31.100667 26534 ts_tablet_manager.cc:1939] T 87ec504adc114405bcb45556cf1e6544 P aa4d2a590f884f938c7f93d5ccbad9bf: Deleting consensus metadata
I20260809 05:33:31.103758 25690 catalog_manager.cc:4841] TS aa4d2a590f884f938c7f93d5ccbad9bf (127.26.185.3:41711): tablet 87ec504adc114405bcb45556cf1e6544 (table test-table [id=76f32b74fb4f44449fbbf217cebde228]) successfully deleted
I20260809 05:33:31.211773 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 25807
I20260809 05:33:31.247658 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 26013
I20260809 05:33:31.256166 26485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:31.248699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38768 (local address 127.26.185.2:42325)
0809 05:33:31.248906 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:31.248911 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:31.248993 (+ 82us) server_negotiation.cc:407] Connection header received
0809 05:33:31.249195 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:31.249200 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:31.249316 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:31.249414 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:31.249905 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:31.250774 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:31.252369 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:31.252841 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:31.252947 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:31.254257 (+ 1310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:31.254268 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:31.254290 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:31.255192 (+ 902us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:31.255257 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:31.255291 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:31.255391 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:31.255588 (+ 197us) server_negotiation.cc:299] Negotiation successful
0809 05:33:31.255715 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 05:33:31.257097 26229 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:33:31.359228 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 26013
I20260809 05:33:31.392978 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 26244
I20260809 05:33:31.402320 26484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:31.394271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43438 (local address 127.26.185.3:41711)
0809 05:33:31.394545 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:31.394556 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:31.394585 (+ 29us) server_negotiation.cc:407] Connection header received
0809 05:33:31.394761 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:31.394765 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:31.394891 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:31.395077 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:31.395593 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:31.396406 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:31.397969 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:31.398407 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:31.398517 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:31.400408 (+ 1891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:31.400430 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:31.400461 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:31.401348 (+ 887us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:31.401430 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:31.401459 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:31.401609 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:31.401775 (+ 166us) server_negotiation.cc:299] Negotiation successful
0809 05:33:31.401900 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260809 05:33:31.403244 26445 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:33:31.503456 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 26244
I20260809 05:33:31.534076 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 25658
I20260809 05:33:31.535614 25759 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:33:31.667058 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 25658
2026-08-09T05:33:31Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (3548 ms)
[----------] 6 tests from EncryptionPolicyTest (28668 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:33:31 dist-test-slave-h3ft krb5kdc[26554](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:33:31 dist-test-slave-h3ft krb5kdc[26554](info): set up 2 sockets
Aug 09 05:33:31 dist-test-slave-h3ft krb5kdc[26554](info): commencing operation
krb5kdc: starting...
W20260809 05:33:33.105345 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.369s user 0.000s sys 0.066s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:33:33 dist-test-slave-h3ft krb5kdc[26554](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253613, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:33:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:33:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 05:33:33.527768 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40797
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40797
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:33:33.968168 26578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:33.968586 26578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:33.968791 26578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:33.977178 26578 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:33:33.977329 26578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:33.977445 26578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:33.977577 26578 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:33:33.977661 26578 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:33:33.989451 26578 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40797
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40797
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:33.991425 26578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:33.993202 26578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:34.008291 26586 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:34.008476 26588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:34.008309 26584 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:34.009913 26578 server_base.cc:1034] running on GCE node
I20260809 05:33:34.011128 26578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:34.013124 26578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:34.014420 26578 hybrid_clock.cc:648] HybridClock initialized: now 1786253614014356 us; error 86 us; skew 500 ppm
I20260809 05:33:34.014919 26578 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:33:34 dist-test-slave-h3ft krb5kdc[26554](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253614, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:33:34.025295 26578 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 05:33:34.027666 26578 webserver.cc:460] Webserver started at http://127.0.0.1:43443/ using document root <none> and password file <none>
I20260809 05:33:34.028650 26578 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:34.028828 26578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:34.029242 26578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:34.033213 26578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "3879b95076aa462a88dfb9020eb5453a"
format_stamp: "Formatted at 2026-08-09 05:33:34 on dist-test-slave-h3ft"
server_key: "803a5efaf9a39c76de2de37790752690"
server_key_iv: "8a3d8ac21b2cf34ed38639a06aee3857"
server_key_version: "encryptionkey@0"
I20260809 05:33:34.034245 26578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "3879b95076aa462a88dfb9020eb5453a"
format_stamp: "Formatted at 2026-08-09 05:33:34 on dist-test-slave-h3ft"
server_key: "803a5efaf9a39c76de2de37790752690"
server_key_iv: "8a3d8ac21b2cf34ed38639a06aee3857"
server_key_version: "encryptionkey@0"
I20260809 05:33:34.041087 26578 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260809 05:33:34.045521 26604 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:34.047247 26578 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:33:34.047482 26578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "3879b95076aa462a88dfb9020eb5453a"
format_stamp: "Formatted at 2026-08-09 05:33:34 on dist-test-slave-h3ft"
server_key: "803a5efaf9a39c76de2de37790752690"
server_key_iv: "8a3d8ac21b2cf34ed38639a06aee3857"
server_key_version: "encryptionkey@0"
I20260809 05:33:34.047737 26578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:34.076848 26578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:34.082667 26578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:34.083173 26578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:34.106299 26578 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40797
I20260809 05:33:34.106359 26690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40797 every 8 connection(s)
I20260809 05:33:34.108250 26578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:33:34.110472 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 26578
I20260809 05:33:34.110765 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:33:34.111795 27364 external_mini_cluster.cc:1428] Setting key aa1074d0d389b65cf407c95dba5f0cba
I20260809 05:33:34.114409 26692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 05:33:34 dist-test-slave-h3ft krb5kdc[26554](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253613, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 05:33:34.130637 26692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3879b95076aa462a88dfb9020eb5453a: Bootstrap starting.
I20260809 05:33:34.135139 26692 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3879b95076aa462a88dfb9020eb5453a: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:34.136456 26692 log.cc:824] T 00000000000000000000000000000000 P 3879b95076aa462a88dfb9020eb5453a: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:34.140180 26692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3879b95076aa462a88dfb9020eb5453a: No bootstrap required, opened a new log
I20260809 05:33:34.140342 26695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:34.114343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60939 (local address 127.0.0.1:40797)
0809 05:33:34.115382 (+ 1039us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:34.115395 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:34.115448 (+ 53us) server_negotiation.cc:407] Connection header received
0809 05:33:34.117301 (+ 1853us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:34.117329 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:34.117849 (+ 520us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:34.118300 (+ 451us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:34.120537 (+ 2237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:34.122252 (+ 1715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:34.124327 (+ 2075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:34.125136 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:34.125308 (+ 172us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:34.131400 (+ 6092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:34.131411 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:34.131432 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:34.131487 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:34.135374 (+ 3887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:34.136316 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:34.136324 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:34.136333 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:34.136548 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:34.137138 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:34.137152 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:34.137155 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:34.137781 (+ 626us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:34.138208 (+ 427us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:34.138703 (+ 495us) server_negotiation.cc:299] Negotiation successful
0809 05:33:34.139145 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":769,"thread_start_us":422,"threads_started":1}
I20260809 05:33:34.145536 27364 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 05:33:34.150063 26692 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3879b95076aa462a88dfb9020eb5453a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3879b95076aa462a88dfb9020eb5453a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40797 } }
I20260809 05:33:34.150591 26692 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3879b95076aa462a88dfb9020eb5453a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:34.150713 26692 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3879b95076aa462a88dfb9020eb5453a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3879b95076aa462a88dfb9020eb5453a, State: Initialized, Role: FOLLOWER
I20260809 05:33:34.151662 26692 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3879b95076aa462a88dfb9020eb5453a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3879b95076aa462a88dfb9020eb5453a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40797 } }
I20260809 05:33:34.151952 26692 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3879b95076aa462a88dfb9020eb5453a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:33:34.152112 26692 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3879b95076aa462a88dfb9020eb5453a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:33:34.152343 26692 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3879b95076aa462a88dfb9020eb5453a [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:34.155959 26692 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3879b95076aa462a88dfb9020eb5453a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3879b95076aa462a88dfb9020eb5453a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40797 } }
I20260809 05:33:34.156759 26692 leader_election.cc:302] T 00000000000000000000000000000000 P 3879b95076aa462a88dfb9020eb5453a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3879b95076aa462a88dfb9020eb5453a; no voters:
I20260809 05:33:34.157577 26692 leader_election.cc:288] T 00000000000000000000000000000000 P 3879b95076aa462a88dfb9020eb5453a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:33:34.157740 26712 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3879b95076aa462a88dfb9020eb5453a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:33:34.159291 26712 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3879b95076aa462a88dfb9020eb5453a [term 1 LEADER]: Becoming Leader. State: Replica: 3879b95076aa462a88dfb9020eb5453a, State: Running, Role: LEADER
I20260809 05:33:34.160126 26712 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3879b95076aa462a88dfb9020eb5453a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3879b95076aa462a88dfb9020eb5453a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40797 } }
I20260809 05:33:34.160458 26692 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3879b95076aa462a88dfb9020eb5453a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:33:34.164667 26716 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3879b95076aa462a88dfb9020eb5453a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3879b95076aa462a88dfb9020eb5453a. Latest consensus state: current_term: 1 leader_uuid: "3879b95076aa462a88dfb9020eb5453a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3879b95076aa462a88dfb9020eb5453a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40797 } } }
I20260809 05:33:34.165272 26716 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3879b95076aa462a88dfb9020eb5453a [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:34.165967 26713 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3879b95076aa462a88dfb9020eb5453a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3879b95076aa462a88dfb9020eb5453a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3879b95076aa462a88dfb9020eb5453a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40797 } } }
I20260809 05:33:34.166411 26713 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3879b95076aa462a88dfb9020eb5453a [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:34.172098 26724 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:33:34.174993 26695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:34.151240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47887 (local address 127.0.0.1:40797)
0809 05:33:34.151476 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:34.151483 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:34.152373 (+ 890us) server_negotiation.cc:407] Connection header received
0809 05:33:34.152480 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:34.152486 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:34.152599 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:34.152700 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:34.154927 (+ 2227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:34.155937 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:34.157920 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:34.159206 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:34.159418 (+ 212us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:34.164107 (+ 4689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:34.164121 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:34.164131 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:34.164197 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:34.169876 (+ 5679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:34.171268 (+ 1392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:34.171274 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:34.171278 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:34.171521 (+ 243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:34.172301 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:34.172310 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:34.172318 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:34.172965 (+ 647us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:34.173451 (+ 486us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:34.173989 (+ 538us) server_negotiation.cc:299] Negotiation successful
0809 05:33:34.174310 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 05:33:34.183686 26724 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:33:34.196278 26724 catalog_manager.cc:1347] Generated new cluster ID: 6df8d2c352524d45b0c1130a256a6ae2
I20260809 05:33:34.196440 26724 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:33:34.219784 26724 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:33:34.221954 26724 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:33:34.238535 26724 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3879b95076aa462a88dfb9020eb5453a: Generated new TSK 0
I20260809 05:33:34.239817 26724 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 05:33:34.252331 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 26578
I20260809 05:33:34.254160 26682 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:33:34.361467 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 26578
W20260809 05:33:34.394291 26546 connection.cc:535] client connection to 127.0.0.1:40797 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40797): Connection reset by peer (error 104)
2026-08-09T05:33:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2681 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:33:34 dist-test-slave-h3ft krb5kdc[26747](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:33:34 dist-test-slave-h3ft krb5kdc[26747](info): set up 2 sockets
Aug 09 05:33:34 dist-test-slave-h3ft krb5kdc[26747](info): commencing operation
krb5kdc: starting...
W20260809 05:33:35.806150 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.390s user 0.009s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:33:36 dist-test-slave-h3ft krb5kdc[26747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253616, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:33:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:33:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 05:33:36.235021 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46245
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46245
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:33:36.661435 26769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:36.661855 26769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:36.661963 26769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:36.669972 26769 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:33:36.670140 26769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:36.670202 26769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:36.670274 26769 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:33:36.670321 26769 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:33:36.682294 26769 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46245
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46245
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:36.684216 26769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:36.685920 26769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:36.700847 26782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:36.700776 26778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:36.700891 26779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:36.702039 26769 server_base.cc:1034] running on GCE node
I20260809 05:33:36.703253 26769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:36.705170 26769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:36.706435 26769 hybrid_clock.cc:648] HybridClock initialized: now 1786253616706385 us; error 51 us; skew 500 ppm
I20260809 05:33:36.706897 26769 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:33:36 dist-test-slave-h3ft krb5kdc[26747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253616, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:33:36.710947 26769 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 05:33:36.712924 26769 webserver.cc:460] Webserver started at http://127.0.0.1:36049/ using document root <none> and password file <none>
I20260809 05:33:36.713831 26769 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:36.713989 26769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:36.714392 26769 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:36.718405 26769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "fc5614ab9d5b4bff9f6541a7e8d42d58"
format_stamp: "Formatted at 2026-08-09 05:33:36 on dist-test-slave-h3ft"
server_key: "14901791970cc6b1744a9772e889f5de"
server_key_iv: "d8b2e48a24c609c2038f5c9427f42cae"
server_key_version: "encryptionkey@0"
I20260809 05:33:36.719460 26769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "fc5614ab9d5b4bff9f6541a7e8d42d58"
format_stamp: "Formatted at 2026-08-09 05:33:36 on dist-test-slave-h3ft"
server_key: "14901791970cc6b1744a9772e889f5de"
server_key_iv: "d8b2e48a24c609c2038f5c9427f42cae"
server_key_version: "encryptionkey@0"
I20260809 05:33:36.726161 26769 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260809 05:33:36.730950 26792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:36.733032 26769 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260809 05:33:36.733309 26769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "fc5614ab9d5b4bff9f6541a7e8d42d58"
format_stamp: "Formatted at 2026-08-09 05:33:36 on dist-test-slave-h3ft"
server_key: "14901791970cc6b1744a9772e889f5de"
server_key_iv: "d8b2e48a24c609c2038f5c9427f42cae"
server_key_version: "encryptionkey@0"
I20260809 05:33:36.733623 26769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:36.764703 26769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:36.770538 26769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:36.770934 26769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:36.794665 26769 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46245
I20260809 05:33:36.794705 26871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46245 every 8 connection(s)
I20260809 05:33:36.796540 26769 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:33:36.800436 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 26769
I20260809 05:33:36.800720 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:33:36.801331 27364 external_mini_cluster.cc:1428] Setting key 3eba3dbbbd26ec9b5e60bd58c2a3dff4
I20260809 05:33:36.801841 26872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:36.819680 26872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc5614ab9d5b4bff9f6541a7e8d42d58: Bootstrap starting.
I20260809 05:33:36.819943 26884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:36.803765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40345 (local address 127.0.0.1:46245)
0809 05:33:36.804785 (+ 1020us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:36.804804 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:36.804868 (+ 64us) server_negotiation.cc:407] Connection header received
0809 05:33:36.807867 (+ 2999us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:36.807907 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:36.808631 (+ 724us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:36.809225 (+ 594us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:36.809887 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:36.812103 (+ 2216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:36.813690 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:36.814862 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:36.815111 (+ 249us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:36.816615 (+ 1504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:36.816626 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:36.816649 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:36.817550 (+ 901us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:36.817657 (+ 107us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:36.817691 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:36.817871 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:36.818158 (+ 287us) server_negotiation.cc:299] Negotiation successful
0809 05:33:36.818372 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":723,"thread_start_us":416,"threads_started":1}
I20260809 05:33:36.824267 26872 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc5614ab9d5b4bff9f6541a7e8d42d58: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:36.824661 27364 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 05:33:36.825906 26872 log.cc:824] T 00000000000000000000000000000000 P fc5614ab9d5b4bff9f6541a7e8d42d58: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:36.830677 26872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc5614ab9d5b4bff9f6541a7e8d42d58: No bootstrap required, opened a new log
I20260809 05:33:36.840353 26884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:36.831345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53953 (local address 127.0.0.1:46245)
0809 05:33:36.831621 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:36.831631 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:36.832262 (+ 631us) server_negotiation.cc:407] Connection header received
0809 05:33:36.832536 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:36.832540 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:36.832631 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:36.832729 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:36.833523 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:36.834434 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:36.836686 (+ 2252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:36.837198 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:36.837313 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:36.839285 (+ 1972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:36.839294 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:36.839300 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:36.839332 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:36.839393 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:36.839412 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:36.839561 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:36.839841 (+ 280us) server_negotiation.cc:299] Negotiation successful
0809 05:33:36.839923 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260809 05:33:36.843629 26872 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc5614ab9d5b4bff9f6541a7e8d42d58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc5614ab9d5b4bff9f6541a7e8d42d58" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46245 } }
I20260809 05:33:36.844149 26872 raft_consensus.cc:374] T 00000000000000000000000000000000 P fc5614ab9d5b4bff9f6541a7e8d42d58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:36.844301 26872 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc5614ab9d5b4bff9f6541a7e8d42d58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc5614ab9d5b4bff9f6541a7e8d42d58, State: Initialized, Role: FOLLOWER
I20260809 05:33:36.845219 26872 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc5614ab9d5b4bff9f6541a7e8d42d58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc5614ab9d5b4bff9f6541a7e8d42d58" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46245 } }
I20260809 05:33:36.845614 26872 raft_consensus.cc:388] T 00000000000000000000000000000000 P fc5614ab9d5b4bff9f6541a7e8d42d58 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:33:36.845798 26872 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc5614ab9d5b4bff9f6541a7e8d42d58 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:33:36.846002 26872 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc5614ab9d5b4bff9f6541a7e8d42d58 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:36.849874 26872 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc5614ab9d5b4bff9f6541a7e8d42d58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc5614ab9d5b4bff9f6541a7e8d42d58" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46245 } }
I20260809 05:33:36.850700 26872 leader_election.cc:302] T 00000000000000000000000000000000 P fc5614ab9d5b4bff9f6541a7e8d42d58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc5614ab9d5b4bff9f6541a7e8d42d58; no voters:
I20260809 05:33:36.851507 26872 leader_election.cc:288] T 00000000000000000000000000000000 P fc5614ab9d5b4bff9f6541a7e8d42d58 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:33:36.851655 26894 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc5614ab9d5b4bff9f6541a7e8d42d58 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:33:36.852571 26894 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc5614ab9d5b4bff9f6541a7e8d42d58 [term 1 LEADER]: Becoming Leader. State: Replica: fc5614ab9d5b4bff9f6541a7e8d42d58, State: Running, Role: LEADER
I20260809 05:33:36.853677 26894 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc5614ab9d5b4bff9f6541a7e8d42d58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc5614ab9d5b4bff9f6541a7e8d42d58" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46245 } }
I20260809 05:33:36.854610 26872 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc5614ab9d5b4bff9f6541a7e8d42d58 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:33:36.857648 26896 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc5614ab9d5b4bff9f6541a7e8d42d58 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc5614ab9d5b4bff9f6541a7e8d42d58. Latest consensus state: current_term: 1 leader_uuid: "fc5614ab9d5b4bff9f6541a7e8d42d58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc5614ab9d5b4bff9f6541a7e8d42d58" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46245 } } }
I20260809 05:33:36.858196 26896 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc5614ab9d5b4bff9f6541a7e8d42d58 [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:36.859340 26895 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc5614ab9d5b4bff9f6541a7e8d42d58 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc5614ab9d5b4bff9f6541a7e8d42d58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc5614ab9d5b4bff9f6541a7e8d42d58" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46245 } } }
I20260809 05:33:36.859748 26895 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc5614ab9d5b4bff9f6541a7e8d42d58 [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:36.861462 26906 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:33:36.869122 26906 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:33:36.882815 26906 catalog_manager.cc:1347] Generated new cluster ID: e5b4d15aa14643e0b52f7c70f5de2d6a
I20260809 05:33:36.883042 26906 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:33:36.911106 26906 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:33:36.912842 26906 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:33:36.924922 26906 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fc5614ab9d5b4bff9f6541a7e8d42d58: Generated new TSK 0
I20260809 05:33:36.926234 26906 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 05:33:36.933924 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 26769
W20260809 05:33:36.935518 26867 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:40345
W20260809 05:33:36.936551 27364 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 26769: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 05:33:36.936807 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 26769
W20260809 05:33:36.974354 26745 connection.cc:535] client connection to 127.0.0.1:46245 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46245): Connection reset by peer (error 104)
2026-08-09T05:33:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2579 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:33:37 dist-test-slave-h3ft krb5kdc[26927](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:33:37 dist-test-slave-h3ft krb5kdc[26927](info): set up 2 sockets
Aug 09 05:33:37 dist-test-slave-h3ft krb5kdc[26927](info): commencing operation
krb5kdc: starting...
W20260809 05:33:38.372072 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.376s user 0.001s sys 0.062s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:33:38 dist-test-slave-h3ft krb5kdc[26927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253618, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:33:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:33:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 05:33:38.824589 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44917
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44917
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:33:39.276717 26951 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:39.277268 26951 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:39.277454 26951 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:39.285501 26951 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:33:39.285698 26951 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:39.285827 26951 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:39.285946 26951 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:33:39.286038 26951 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:33:39.297483 26951 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44917
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:39.299332 26951 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:39.301054 26951 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:39.315452 26960 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:39.315486 26964 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:39.315492 26961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:39.316563 26951 server_base.cc:1034] running on GCE node
I20260809 05:33:39.317589 26951 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:39.319423 26951 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:39.320688 26951 hybrid_clock.cc:648] HybridClock initialized: now 1786253619320622 us; error 63 us; skew 500 ppm
I20260809 05:33:39.321228 26951 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:33:39 dist-test-slave-h3ft krb5kdc[26927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253619, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:33:39.331341 26951 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 05:33:39.333454 26951 webserver.cc:460] Webserver started at http://127.0.0.1:42711/ using document root <none> and password file <none>
I20260809 05:33:39.334482 26951 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:39.334738 26951 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:39.335253 26951 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:39.339164 26951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "00ed3465468b4472890ccd1623588ce2"
format_stamp: "Formatted at 2026-08-09 05:33:39 on dist-test-slave-h3ft"
server_key: "94c5d99f4064c680ed2ec884175d6908"
server_key_iv: "208a0828931268fdf4b81f5b4dbcd856"
server_key_version: "encryptionkey@0"
I20260809 05:33:39.340117 26951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "00ed3465468b4472890ccd1623588ce2"
format_stamp: "Formatted at 2026-08-09 05:33:39 on dist-test-slave-h3ft"
server_key: "94c5d99f4064c680ed2ec884175d6908"
server_key_iv: "208a0828931268fdf4b81f5b4dbcd856"
server_key_version: "encryptionkey@0"
I20260809 05:33:39.346565 26951 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260809 05:33:39.350907 26972 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:39.352703 26951 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260809 05:33:39.353019 26951 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "00ed3465468b4472890ccd1623588ce2"
format_stamp: "Formatted at 2026-08-09 05:33:39 on dist-test-slave-h3ft"
server_key: "94c5d99f4064c680ed2ec884175d6908"
server_key_iv: "208a0828931268fdf4b81f5b4dbcd856"
server_key_version: "encryptionkey@0"
I20260809 05:33:39.353255 26951 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:39.360165 26951 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:39.365510 26951 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:39.365872 26951 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:39.388949 26951 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44917
I20260809 05:33:39.388974 27042 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44917 every 8 connection(s)
I20260809 05:33:39.390779 26951 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:33:39.395112 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 26951
I20260809 05:33:39.395332 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:33:39.395889 27364 external_mini_cluster.cc:1428] Setting key beeff3b56a4eecaac704e2ae3d774322
I20260809 05:33:39.396131 27043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:39.406982 27049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:39.398243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35379 (local address 127.0.0.1:44917)
0809 05:33:39.399262 (+ 1019us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:39.399280 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:39.399347 (+ 67us) server_negotiation.cc:407] Connection header received
0809 05:33:39.402095 (+ 2748us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:39.402136 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:39.402741 (+ 605us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:39.403374 (+ 633us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:39.404598 (+ 1224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:39.404608 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:39.404628 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:39.404646 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:39.404740 (+ 94us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:39.404772 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:39.405049 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:39.405218 (+ 169us) server_negotiation.cc:299] Negotiation successful
0809 05:33:39.405467 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":684,"thread_start_us":411,"threads_started":1}
I20260809 05:33:39.411576 27364 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 05:33:39.413664 27043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00ed3465468b4472890ccd1623588ce2: Bootstrap starting.
I20260809 05:33:39.418109 27043 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 00ed3465468b4472890ccd1623588ce2: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:39.419793 27043 log.cc:824] T 00000000000000000000000000000000 P 00ed3465468b4472890ccd1623588ce2: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:39.419844 27049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:39.416767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47603 (local address 127.0.0.1:44917)
0809 05:33:39.417031 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:39.417042 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:39.417557 (+ 515us) server_negotiation.cc:407] Connection header received
0809 05:33:39.417777 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:39.417781 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:39.417838 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:39.417927 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:39.419108 (+ 1181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:39.419113 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:39.419116 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:39.419131 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:39.419172 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:39.419187 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:39.419280 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:39.419451 (+ 171us) server_negotiation.cc:299] Negotiation successful
0809 05:33:39.419507 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 05:33:39.423411 27043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00ed3465468b4472890ccd1623588ce2: No bootstrap required, opened a new log
I20260809 05:33:39.431501 27043 raft_consensus.cc:348] T 00000000000000000000000000000000 P 00ed3465468b4472890ccd1623588ce2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00ed3465468b4472890ccd1623588ce2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44917 } }
I20260809 05:33:39.431989 27043 raft_consensus.cc:374] T 00000000000000000000000000000000 P 00ed3465468b4472890ccd1623588ce2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:39.432119 27043 raft_consensus.cc:729] T 00000000000000000000000000000000 P 00ed3465468b4472890ccd1623588ce2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00ed3465468b4472890ccd1623588ce2, State: Initialized, Role: FOLLOWER
I20260809 05:33:39.432827 27043 consensus_queue.cc:260] T 00000000000000000000000000000000 P 00ed3465468b4472890ccd1623588ce2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00ed3465468b4472890ccd1623588ce2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44917 } }
I20260809 05:33:39.433120 27043 raft_consensus.cc:388] T 00000000000000000000000000000000 P 00ed3465468b4472890ccd1623588ce2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:33:39.433298 27043 raft_consensus.cc:482] T 00000000000000000000000000000000 P 00ed3465468b4472890ccd1623588ce2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:33:39.433532 27043 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 00ed3465468b4472890ccd1623588ce2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:39.436187 27043 raft_consensus.cc:504] T 00000000000000000000000000000000 P 00ed3465468b4472890ccd1623588ce2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00ed3465468b4472890ccd1623588ce2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44917 } }
I20260809 05:33:39.436846 27043 leader_election.cc:302] T 00000000000000000000000000000000 P 00ed3465468b4472890ccd1623588ce2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 00ed3465468b4472890ccd1623588ce2; no voters:
I20260809 05:33:39.437608 27043 leader_election.cc:288] T 00000000000000000000000000000000 P 00ed3465468b4472890ccd1623588ce2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:33:39.437772 27057 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 00ed3465468b4472890ccd1623588ce2 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:33:39.439311 27057 raft_consensus.cc:686] T 00000000000000000000000000000000 P 00ed3465468b4472890ccd1623588ce2 [term 1 LEADER]: Becoming Leader. State: Replica: 00ed3465468b4472890ccd1623588ce2, State: Running, Role: LEADER
I20260809 05:33:39.440117 27057 consensus_queue.cc:237] T 00000000000000000000000000000000 P 00ed3465468b4472890ccd1623588ce2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00ed3465468b4472890ccd1623588ce2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44917 } }
I20260809 05:33:39.440625 27043 sys_catalog.cc:564] T 00000000000000000000000000000000 P 00ed3465468b4472890ccd1623588ce2 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:33:39.443871 27060 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00ed3465468b4472890ccd1623588ce2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 00ed3465468b4472890ccd1623588ce2. Latest consensus state: current_term: 1 leader_uuid: "00ed3465468b4472890ccd1623588ce2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00ed3465468b4472890ccd1623588ce2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44917 } } }
I20260809 05:33:39.443882 27058 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00ed3465468b4472890ccd1623588ce2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "00ed3465468b4472890ccd1623588ce2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00ed3465468b4472890ccd1623588ce2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44917 } } }
I20260809 05:33:39.444561 27060 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00ed3465468b4472890ccd1623588ce2 [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:39.444561 27058 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00ed3465468b4472890ccd1623588ce2 [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:39.450006 27071 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:33:39.455598 27071 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:33:39.466499 27071 catalog_manager.cc:1347] Generated new cluster ID: eab4c799bb934a14bf1ca776fa49b16e
I20260809 05:33:39.466686 27071 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:33:39.488308 27071 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:33:39.488910 27071 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:33:39.504400 27071 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 00ed3465468b4472890ccd1623588ce2: Generated new TSK 0
I20260809 05:33:39.505618 27071 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 05:33:39.513918 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 26951
W20260809 05:33:39.515367 27038 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:35379
W20260809 05:33:39.516567 27364 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 26951: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 05:33:39.516893 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 26951
2026-08-09T05:33:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2578 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:33:39 dist-test-slave-h3ft krb5kdc[27094](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:33:39 dist-test-slave-h3ft krb5kdc[27094](info): set up 2 sockets
Aug 09 05:33:39 dist-test-slave-h3ft krb5kdc[27094](info): commencing operation
krb5kdc: starting...
W20260809 05:33:41.020660 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.446s user 0.000s sys 0.065s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:33:41 dist-test-slave-h3ft krb5kdc[27094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253621, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:33:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:33:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 05:33:41.455724 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35977
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35977
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:33:41.905344 27115 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:41.905732 27115 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:41.905848 27115 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:41.914788 27115 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:33:41.914986 27115 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:41.915097 27115 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:41.915195 27115 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:33:41.915266 27115 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:33:41.926577 27115 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35977
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35977
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:41.928416 27115 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:41.930302 27115 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:41.945240 27125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:41.945300 27126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:41.945178 27131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:41.946555 27115 server_base.cc:1034] running on GCE node
I20260809 05:33:41.947783 27115 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:41.949715 27115 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:41.951084 27115 hybrid_clock.cc:648] HybridClock initialized: now 1786253621950952 us; error 85 us; skew 500 ppm
I20260809 05:33:41.951586 27115 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:33:41 dist-test-slave-h3ft krb5kdc[27094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253621, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:33:41.956194 27115 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 05:33:41.958518 27115 webserver.cc:460] Webserver started at http://127.0.0.1:45685/ using document root <none> and password file <none>
I20260809 05:33:41.959610 27115 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:41.959821 27115 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:41.960268 27115 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:41.964493 27115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "5b1f8a59b96a46a2a214f37a46730045"
format_stamp: "Formatted at 2026-08-09 05:33:41 on dist-test-slave-h3ft"
server_key: "0436b70c7aa994c531eda502b192e08a"
server_key_iv: "57b67e94c478cf52f4100789a4ba1e69"
server_key_version: "encryptionkey@0"
I20260809 05:33:41.965552 27115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "5b1f8a59b96a46a2a214f37a46730045"
format_stamp: "Formatted at 2026-08-09 05:33:41 on dist-test-slave-h3ft"
server_key: "0436b70c7aa994c531eda502b192e08a"
server_key_iv: "57b67e94c478cf52f4100789a4ba1e69"
server_key_version: "encryptionkey@0"
I20260809 05:33:41.972862 27115 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.000s sys 0.008s
I20260809 05:33:41.977598 27144 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:41.979513 27115 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260809 05:33:41.979756 27115 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "5b1f8a59b96a46a2a214f37a46730045"
format_stamp: "Formatted at 2026-08-09 05:33:41 on dist-test-slave-h3ft"
server_key: "0436b70c7aa994c531eda502b192e08a"
server_key_iv: "57b67e94c478cf52f4100789a4ba1e69"
server_key_version: "encryptionkey@0"
I20260809 05:33:41.980088 27115 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:41.999653 27115 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:42.005563 27115 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:42.005961 27115 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:42.028815 27115 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35977
I20260809 05:33:42.028841 27222 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35977 every 8 connection(s)
I20260809 05:33:42.030668 27115 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:33:42.034497 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 27115
I20260809 05:33:42.034890 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:33:42.035564 27364 external_mini_cluster.cc:1428] Setting key 2e1c9d265083beef1bc78f289bb8caa0
I20260809 05:33:42.036216 27223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:42.051579 27223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b1f8a59b96a46a2a214f37a46730045: Bootstrap starting.
Aug 09 05:33:42 dist-test-slave-h3ft krb5kdc[27094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253621, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 05:33:42.055836 27223 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5b1f8a59b96a46a2a214f37a46730045: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:42.057241 27223 log.cc:824] T 00000000000000000000000000000000 P 5b1f8a59b96a46a2a214f37a46730045: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:42.060804 27223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b1f8a59b96a46a2a214f37a46730045: No bootstrap required, opened a new log
I20260809 05:33:42.063344 27228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:42.037991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45493 (local address 127.0.0.1:35977)
0809 05:33:42.039120 (+ 1129us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:42.039141 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:42.039213 (+ 72us) server_negotiation.cc:407] Connection header received
0809 05:33:42.042194 (+ 2981us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:42.042224 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:42.042767 (+ 543us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:42.043463 (+ 696us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:42.045372 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:42.046838 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:42.048318 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:42.049162 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:42.049387 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:42.054503 (+ 5116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:42.054512 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:42.054531 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:42.054581 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:42.058481 (+ 3900us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:42.059414 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:42.059422 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:42.059430 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:42.059618 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:42.060077 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:42.060087 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:42.060089 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:42.060674 (+ 585us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:42.061041 (+ 367us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:42.061546 (+ 505us) server_negotiation.cc:299] Negotiation successful
0809 05:33:42.062062 (+ 516us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":717,"thread_start_us":446,"threads_started":1}
I20260809 05:33:42.068024 27364 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 05:33:42.070214 27223 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5b1f8a59b96a46a2a214f37a46730045 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b1f8a59b96a46a2a214f37a46730045" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35977 } }
I20260809 05:33:42.070698 27223 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5b1f8a59b96a46a2a214f37a46730045 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:42.070827 27223 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5b1f8a59b96a46a2a214f37a46730045 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b1f8a59b96a46a2a214f37a46730045, State: Initialized, Role: FOLLOWER
I20260809 05:33:42.071652 27223 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5b1f8a59b96a46a2a214f37a46730045 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b1f8a59b96a46a2a214f37a46730045" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35977 } }
I20260809 05:33:42.072013 27223 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5b1f8a59b96a46a2a214f37a46730045 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:33:42.072199 27223 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5b1f8a59b96a46a2a214f37a46730045 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:33:42.072458 27223 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5b1f8a59b96a46a2a214f37a46730045 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:42.076383 27223 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5b1f8a59b96a46a2a214f37a46730045 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b1f8a59b96a46a2a214f37a46730045" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35977 } }
I20260809 05:33:42.077270 27223 leader_election.cc:302] T 00000000000000000000000000000000 P 5b1f8a59b96a46a2a214f37a46730045 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5b1f8a59b96a46a2a214f37a46730045; no voters:
I20260809 05:33:42.078122 27223 leader_election.cc:288] T 00000000000000000000000000000000 P 5b1f8a59b96a46a2a214f37a46730045 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:33:42.078297 27239 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5b1f8a59b96a46a2a214f37a46730045 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:33:42.079073 27239 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5b1f8a59b96a46a2a214f37a46730045 [term 1 LEADER]: Becoming Leader. State: Replica: 5b1f8a59b96a46a2a214f37a46730045, State: Running, Role: LEADER
I20260809 05:33:42.079960 27239 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5b1f8a59b96a46a2a214f37a46730045 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b1f8a59b96a46a2a214f37a46730045" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35977 } }
I20260809 05:33:42.082866 27239 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b1f8a59b96a46a2a214f37a46730045 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b1f8a59b96a46a2a214f37a46730045. Latest consensus state: current_term: 1 leader_uuid: "5b1f8a59b96a46a2a214f37a46730045" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b1f8a59b96a46a2a214f37a46730045" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35977 } } }
I20260809 05:33:42.083334 27239 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b1f8a59b96a46a2a214f37a46730045 [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:42.087502 27223 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5b1f8a59b96a46a2a214f37a46730045 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:33:42.087222 27242 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b1f8a59b96a46a2a214f37a46730045 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5b1f8a59b96a46a2a214f37a46730045" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b1f8a59b96a46a2a214f37a46730045" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35977 } } }
I20260809 05:33:42.088248 27242 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b1f8a59b96a46a2a214f37a46730045 [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:42.094691 27244 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:33:42.096714 27228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:42.073902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38151 (local address 127.0.0.1:35977)
0809 05:33:42.074196 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:42.074207 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:42.074757 (+ 550us) server_negotiation.cc:407] Connection header received
0809 05:33:42.074987 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:42.074991 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:42.075172 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:42.075271 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:42.077614 (+ 2343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:42.079094 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:42.081133 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:42.081831 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:42.082020 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:42.086487 (+ 4467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:42.086496 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:42.086501 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:42.086553 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:42.091458 (+ 4905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:42.092796 (+ 1338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:42.092806 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:42.092813 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:42.093035 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:42.093650 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:42.093658 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:42.093664 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:42.094247 (+ 583us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:42.095292 (+ 1045us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:42.095639 (+ 347us) server_negotiation.cc:299] Negotiation successful
0809 05:33:42.096018 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 05:33:42.102855 27244 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:33:42.116340 27244 catalog_manager.cc:1347] Generated new cluster ID: 2a18d65cce1941219b83aeccc5b5fbcb
I20260809 05:33:42.116514 27244 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:33:42.133179 27244 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:33:42.134897 27244 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:33:42.142261 27244 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5b1f8a59b96a46a2a214f37a46730045: Generated new TSK 0
I20260809 05:33:42.143680 27244 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 05:33:42.158591 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 27115
I20260809 05:33:42.159972 27216 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:33:42.264815 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 27115
2026-08-09T05:33:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2743 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:33:42 dist-test-slave-h3ft krb5kdc[27280](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:33:42 dist-test-slave-h3ft krb5kdc[27280](info): set up 2 sockets
Aug 09 05:33:42 dist-test-slave-h3ft krb5kdc[27280](info): commencing operation
krb5kdc: starting...
W20260809 05:33:43.724911 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.407s user 0.005s sys 0.059s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:33:43 dist-test-slave-h3ft krb5kdc[27280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253623, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:33:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:33:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 05:33:44.159830 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35715
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35715
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:33:44.591526 27308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:44.591955 27308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:44.592165 27308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:44.600534 27308 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:33:44.600744 27308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:44.600871 27308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:44.600987 27308 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:33:44.601059 27308 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:33:44.613073 27308 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35715
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35715
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:44.614995 27308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:44.616858 27308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:44.631547 27316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:44.631610 27318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:44.631562 27321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:44.632928 27308 server_base.cc:1034] running on GCE node
I20260809 05:33:44.633984 27308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:44.635974 27308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:44.637275 27308 hybrid_clock.cc:648] HybridClock initialized: now 1786253624637223 us; error 48 us; skew 500 ppm
I20260809 05:33:44.637756 27308 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:33:44 dist-test-slave-h3ft krb5kdc[27280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253624, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:33:44.645120 27308 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 05:33:44.647205 27308 webserver.cc:460] Webserver started at http://127.0.0.1:44337/ using document root <none> and password file <none>
I20260809 05:33:44.648077 27308 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:44.648195 27308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:44.648511 27308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:44.652313 27308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "7aac280febd744d6923873e55ba7a2cc"
format_stamp: "Formatted at 2026-08-09 05:33:44 on dist-test-slave-h3ft"
server_key: "036ed1941f4cd02f4c755b2abab32183"
server_key_iv: "00704e6cc4d797cf9fecd5ba4884a870"
server_key_version: "encryptionkey@0"
I20260809 05:33:44.653198 27308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "7aac280febd744d6923873e55ba7a2cc"
format_stamp: "Formatted at 2026-08-09 05:33:44 on dist-test-slave-h3ft"
server_key: "036ed1941f4cd02f4c755b2abab32183"
server_key_iv: "00704e6cc4d797cf9fecd5ba4884a870"
server_key_version: "encryptionkey@0"
I20260809 05:33:44.659533 27308 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260809 05:33:44.663928 27331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:44.665593 27308 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 05:33:44.665822 27308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "7aac280febd744d6923873e55ba7a2cc"
format_stamp: "Formatted at 2026-08-09 05:33:44 on dist-test-slave-h3ft"
server_key: "036ed1941f4cd02f4c755b2abab32183"
server_key_iv: "00704e6cc4d797cf9fecd5ba4884a870"
server_key_version: "encryptionkey@0"
I20260809 05:33:44.666049 27308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:44.693892 27308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:44.699717 27308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:44.700109 27308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:44.723140 27308 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35715
I20260809 05:33:44.723161 27428 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35715 every 8 connection(s)
I20260809 05:33:44.725139 27308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:33:44.725585 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 27308
I20260809 05:33:44.725837 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:33:44.726698 27364 external_mini_cluster.cc:1428] Setting key 2944fbbe3566fa05665f710090990ba9
I20260809 05:33:44.731535 27430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:44.745373 27433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:44.729247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49975 (local address 127.0.0.1:35715)
0809 05:33:44.730215 (+ 968us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:44.730234 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:44.730297 (+ 63us) server_negotiation.cc:407] Connection header received
0809 05:33:44.733000 (+ 2703us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:44.733040 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:44.733701 (+ 661us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:44.734261 (+ 560us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:44.734923 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:44.737256 (+ 2333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:44.738883 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:44.740078 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:44.740266 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:44.741675 (+ 1409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:44.741687 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:44.741710 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:44.742580 (+ 870us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:44.742732 (+ 152us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:44.742778 (+ 46us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:44.742912 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:44.743244 (+ 332us) server_negotiation.cc:299] Negotiation successful
0809 05:33:44.743627 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":687,"thread_start_us":401,"threads_started":1}
I20260809 05:33:44.748114 27430 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7aac280febd744d6923873e55ba7a2cc: Bootstrap starting.
I20260809 05:33:44.750295 27364 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 05:33:44.752451 27430 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7aac280febd744d6923873e55ba7a2cc: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:44.753880 27430 log.cc:824] T 00000000000000000000000000000000 P 7aac280febd744d6923873e55ba7a2cc: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:44.758081 27430 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7aac280febd744d6923873e55ba7a2cc: No bootstrap required, opened a new log
I20260809 05:33:44.763321 27433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:44.756059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40191 (local address 127.0.0.1:35715)
0809 05:33:44.756282 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:44.756291 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:44.756778 (+ 487us) server_negotiation.cc:407] Connection header received
0809 05:33:44.757046 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:44.757050 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:44.757122 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:44.757239 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:44.757867 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:44.758753 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:44.760298 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:44.760831 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:44.761027 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:44.762390 (+ 1363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:44.762395 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:44.762399 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:44.762424 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:44.762475 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:44.762492 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:44.762603 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:44.762773 (+ 170us) server_negotiation.cc:299] Negotiation successful
0809 05:33:44.762887 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 05:33:44.768257 27430 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7aac280febd744d6923873e55ba7a2cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aac280febd744d6923873e55ba7a2cc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35715 } }
I20260809 05:33:44.768951 27430 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7aac280febd744d6923873e55ba7a2cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:44.769068 27430 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7aac280febd744d6923873e55ba7a2cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7aac280febd744d6923873e55ba7a2cc, State: Initialized, Role: FOLLOWER
I20260809 05:33:44.769734 27430 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7aac280febd744d6923873e55ba7a2cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aac280febd744d6923873e55ba7a2cc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35715 } }
I20260809 05:33:44.769969 27430 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7aac280febd744d6923873e55ba7a2cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:33:44.770102 27430 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7aac280febd744d6923873e55ba7a2cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:33:44.770262 27430 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7aac280febd744d6923873e55ba7a2cc [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:44.773022 27430 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7aac280febd744d6923873e55ba7a2cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aac280febd744d6923873e55ba7a2cc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35715 } }
I20260809 05:33:44.773814 27430 leader_election.cc:302] T 00000000000000000000000000000000 P 7aac280febd744d6923873e55ba7a2cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7aac280febd744d6923873e55ba7a2cc; no voters:
I20260809 05:33:44.774644 27430 leader_election.cc:288] T 00000000000000000000000000000000 P 7aac280febd744d6923873e55ba7a2cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:33:44.774940 27443 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7aac280febd744d6923873e55ba7a2cc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:33:44.775900 27443 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7aac280febd744d6923873e55ba7a2cc [term 1 LEADER]: Becoming Leader. State: Replica: 7aac280febd744d6923873e55ba7a2cc, State: Running, Role: LEADER
I20260809 05:33:44.776548 27443 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7aac280febd744d6923873e55ba7a2cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aac280febd744d6923873e55ba7a2cc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35715 } }
I20260809 05:33:44.777401 27430 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7aac280febd744d6923873e55ba7a2cc [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:33:44.782232 27449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7aac280febd744d6923873e55ba7a2cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7aac280febd744d6923873e55ba7a2cc. Latest consensus state: current_term: 1 leader_uuid: "7aac280febd744d6923873e55ba7a2cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aac280febd744d6923873e55ba7a2cc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35715 } } }
I20260809 05:33:44.782755 27449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7aac280febd744d6923873e55ba7a2cc [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:44.784459 27448 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7aac280febd744d6923873e55ba7a2cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7aac280febd744d6923873e55ba7a2cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aac280febd744d6923873e55ba7a2cc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35715 } } }
I20260809 05:33:44.784842 27448 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7aac280febd744d6923873e55ba7a2cc [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:44.786037 27455 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:33:44.794556 27455 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:33:44.805863 27455 catalog_manager.cc:1347] Generated new cluster ID: e88d3fdda11748579997968f320674b5
I20260809 05:33:44.806087 27455 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:33:44.835057 27455 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:33:44.836798 27455 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:33:44.854282 27455 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7aac280febd744d6923873e55ba7a2cc: Generated new TSK 0
I20260809 05:33:44.855858 27455 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 05:33:44.874323 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 27308
W20260809 05:33:44.876570 27422 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:49975
W20260809 05:33:44.877480 27364 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 27308: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 05:33:44.877677 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 27308
2026-08-09T05:33:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2619 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:33:45 dist-test-slave-h3ft krb5kdc[27480](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:33:45 dist-test-slave-h3ft krb5kdc[27480](info): set up 2 sockets
Aug 09 05:33:45 dist-test-slave-h3ft krb5kdc[27480](info): commencing operation
krb5kdc: starting...
W20260809 05:33:46.304462 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.367s user 0.000s sys 0.066s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:33:46 dist-test-slave-h3ft krb5kdc[27480](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253626, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:33:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:33:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 05:33:46.739851 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40135
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40135
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:33:47.180411 27506 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:47.180809 27506 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:47.181006 27506 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:47.189224 27506 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:33:47.189373 27506 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:47.189460 27506 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:47.189570 27506 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:33:47.189697 27506 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:33:47.201349 27506 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40135
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40135
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:47.203327 27506 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:47.205139 27506 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:47.220472 27512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:47.220491 27514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:47.220554 27511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:47.221580 27506 server_base.cc:1034] running on GCE node
I20260809 05:33:47.222679 27506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:47.224664 27506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:47.225953 27506 hybrid_clock.cc:648] HybridClock initialized: now 1786253627225873 us; error 57 us; skew 500 ppm
I20260809 05:33:47.226437 27506 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:33:47 dist-test-slave-h3ft krb5kdc[27480](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253627, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:33:47.230530 27506 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 05:33:47.232692 27506 webserver.cc:460] Webserver started at http://127.0.0.1:42483/ using document root <none> and password file <none>
I20260809 05:33:47.233635 27506 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:47.233812 27506 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:47.234215 27506 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:47.238514 27506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "df725d74756341f6a8b3d02f467d661b"
format_stamp: "Formatted at 2026-08-09 05:33:47 on dist-test-slave-h3ft"
server_key: "82a9caa89b1096c79e9bd05fb324c161"
server_key_iv: "7a5d068b6a337cc984c9d12e43ae5b5d"
server_key_version: "encryptionkey@0"
I20260809 05:33:47.239493 27506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "df725d74756341f6a8b3d02f467d661b"
format_stamp: "Formatted at 2026-08-09 05:33:47 on dist-test-slave-h3ft"
server_key: "82a9caa89b1096c79e9bd05fb324c161"
server_key_iv: "7a5d068b6a337cc984c9d12e43ae5b5d"
server_key_version: "encryptionkey@0"
I20260809 05:33:47.246088 27506 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260809 05:33:47.250982 27525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:47.253160 27506 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:33:47.253473 27506 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "df725d74756341f6a8b3d02f467d661b"
format_stamp: "Formatted at 2026-08-09 05:33:47 on dist-test-slave-h3ft"
server_key: "82a9caa89b1096c79e9bd05fb324c161"
server_key_iv: "7a5d068b6a337cc984c9d12e43ae5b5d"
server_key_version: "encryptionkey@0"
I20260809 05:33:47.253818 27506 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:47.261952 27506 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:47.267858 27506 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:47.268249 27506 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:47.291487 27506 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40135
I20260809 05:33:47.291507 27611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40135 every 8 connection(s)
I20260809 05:33:47.293332 27506 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:33:47.296214 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 27506
I20260809 05:33:47.296432 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:33:47.297032 27364 external_mini_cluster.cc:1428] Setting key a883e082b13abcedb4b1fa75990eeb4b
I20260809 05:33:47.298493 27612 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:47.306202 27617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:47.299321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56903 (local address 127.0.0.1:40135)
0809 05:33:47.300254 (+ 933us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:47.300270 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:47.300321 (+ 51us) server_negotiation.cc:407] Connection header received
0809 05:33:47.302120 (+ 1799us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:47.302146 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:47.302563 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:47.303063 (+ 500us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:47.304316 (+ 1253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:47.304323 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:47.304337 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:47.304354 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:47.304455 (+ 101us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:47.304482 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:47.304759 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:47.304919 (+ 160us) server_negotiation.cc:299] Negotiation successful
0809 05:33:47.305142 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":681,"thread_start_us":410,"threads_started":1}
I20260809 05:33:47.310748 27364 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 05:33:47.313436 27612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df725d74756341f6a8b3d02f467d661b: Bootstrap starting.
I20260809 05:33:47.318388 27612 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P df725d74756341f6a8b3d02f467d661b: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:47.319500 27617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:47.316080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45167 (local address 127.0.0.1:40135)
0809 05:33:47.316356 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:47.316367 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:47.316872 (+ 505us) server_negotiation.cc:407] Connection header received
0809 05:33:47.317090 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:47.317095 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:47.317169 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:47.317265 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:47.318620 (+ 1355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:47.318625 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:47.318628 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:47.318645 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:47.318692 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:47.318708 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:47.318802 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:47.319083 (+ 281us) server_negotiation.cc:299] Negotiation successful
0809 05:33:47.319143 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 05:33:47.320127 27612 log.cc:824] T 00000000000000000000000000000000 P df725d74756341f6a8b3d02f467d661b: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:47.324084 27612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df725d74756341f6a8b3d02f467d661b: No bootstrap required, opened a new log
I20260809 05:33:47.332793 27612 raft_consensus.cc:348] T 00000000000000000000000000000000 P df725d74756341f6a8b3d02f467d661b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df725d74756341f6a8b3d02f467d661b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40135 } }
I20260809 05:33:47.333300 27612 raft_consensus.cc:374] T 00000000000000000000000000000000 P df725d74756341f6a8b3d02f467d661b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:47.333469 27612 raft_consensus.cc:729] T 00000000000000000000000000000000 P df725d74756341f6a8b3d02f467d661b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df725d74756341f6a8b3d02f467d661b, State: Initialized, Role: FOLLOWER
I20260809 05:33:47.334342 27612 consensus_queue.cc:260] T 00000000000000000000000000000000 P df725d74756341f6a8b3d02f467d661b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df725d74756341f6a8b3d02f467d661b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40135 } }
I20260809 05:33:47.334719 27612 raft_consensus.cc:388] T 00000000000000000000000000000000 P df725d74756341f6a8b3d02f467d661b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:33:47.334892 27612 raft_consensus.cc:482] T 00000000000000000000000000000000 P df725d74756341f6a8b3d02f467d661b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:33:47.335124 27612 raft_consensus.cc:3037] T 00000000000000000000000000000000 P df725d74756341f6a8b3d02f467d661b [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:47.337776 27612 raft_consensus.cc:504] T 00000000000000000000000000000000 P df725d74756341f6a8b3d02f467d661b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df725d74756341f6a8b3d02f467d661b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40135 } }
I20260809 05:33:47.338389 27612 leader_election.cc:302] T 00000000000000000000000000000000 P df725d74756341f6a8b3d02f467d661b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: df725d74756341f6a8b3d02f467d661b; no voters:
I20260809 05:33:47.339200 27612 leader_election.cc:288] T 00000000000000000000000000000000 P df725d74756341f6a8b3d02f467d661b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:33:47.339355 27627 raft_consensus.cc:2781] T 00000000000000000000000000000000 P df725d74756341f6a8b3d02f467d661b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:33:47.340205 27627 raft_consensus.cc:686] T 00000000000000000000000000000000 P df725d74756341f6a8b3d02f467d661b [term 1 LEADER]: Becoming Leader. State: Replica: df725d74756341f6a8b3d02f467d661b, State: Running, Role: LEADER
I20260809 05:33:47.340926 27627 consensus_queue.cc:237] T 00000000000000000000000000000000 P df725d74756341f6a8b3d02f467d661b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df725d74756341f6a8b3d02f467d661b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40135 } }
I20260809 05:33:47.342021 27612 sys_catalog.cc:564] T 00000000000000000000000000000000 P df725d74756341f6a8b3d02f467d661b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:33:47.344415 27628 sys_catalog.cc:455] T 00000000000000000000000000000000 P df725d74756341f6a8b3d02f467d661b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "df725d74756341f6a8b3d02f467d661b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df725d74756341f6a8b3d02f467d661b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40135 } } }
I20260809 05:33:47.344888 27628 sys_catalog.cc:458] T 00000000000000000000000000000000 P df725d74756341f6a8b3d02f467d661b [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:47.345227 27629 sys_catalog.cc:455] T 00000000000000000000000000000000 P df725d74756341f6a8b3d02f467d661b [sys.catalog]: SysCatalogTable state changed. Reason: New leader df725d74756341f6a8b3d02f467d661b. Latest consensus state: current_term: 1 leader_uuid: "df725d74756341f6a8b3d02f467d661b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df725d74756341f6a8b3d02f467d661b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40135 } } }
I20260809 05:33:47.347048 27629 sys_catalog.cc:458] T 00000000000000000000000000000000 P df725d74756341f6a8b3d02f467d661b [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:47.348026 27635 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:33:47.354986 27635 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:33:47.366235 27635 catalog_manager.cc:1347] Generated new cluster ID: 91b5cc52fc1a402ebccc1ffc237aa672
I20260809 05:33:47.366421 27635 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:33:47.380316 27635 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:33:47.380934 27635 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:33:47.389876 27635 catalog_manager.cc:5868] T 00000000000000000000000000000000 P df725d74756341f6a8b3d02f467d661b: Generated new TSK 0
I20260809 05:33:47.391147 27635 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 05:33:47.409263 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 27506
W20260809 05:33:47.410805 27602 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:56903
W20260809 05:33:47.411896 27364 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 27506: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 05:33:47.412098 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 27506
2026-08-09T05:33:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2528 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:33:47 dist-test-slave-h3ft krb5kdc[27659](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:33:47 dist-test-slave-h3ft krb5kdc[27659](info): set up 2 sockets
Aug 09 05:33:47 dist-test-slave-h3ft krb5kdc[27659](info): commencing operation
krb5kdc: starting...
W20260809 05:33:48.886988 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.419s user 0.010s sys 0.059s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:33:49 dist-test-slave-h3ft krb5kdc[27659](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253629, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:33:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:33:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 05:33:49.327490 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41917
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41917
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:33:49.753613 27677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:49.754050 27677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:49.754244 27677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:49.762526 27677 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:33:49.762699 27677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:49.762790 27677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:49.762904 27677 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:33:49.762992 27677 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:33:49.774449 27677 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41917
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:49.776338 27677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:49.778136 27677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:49.792909 27683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:49.793155 27687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:49.793175 27685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:49.797035 27677 server_base.cc:1034] running on GCE node
I20260809 05:33:49.798197 27677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:49.800274 27677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:49.801544 27677 hybrid_clock.cc:648] HybridClock initialized: now 1786253629801460 us; error 89 us; skew 500 ppm
I20260809 05:33:49.801993 27677 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:33:49 dist-test-slave-h3ft krb5kdc[27659](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253629, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:33:49.811126 27677 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 05:33:49.813323 27677 webserver.cc:460] Webserver started at http://127.0.0.1:35245/ using document root <none> and password file <none>
I20260809 05:33:49.814311 27677 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:49.814493 27677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:49.814895 27677 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:49.818807 27677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "8233f963645949c89be54aec0378faca"
format_stamp: "Formatted at 2026-08-09 05:33:49 on dist-test-slave-h3ft"
server_key: "1a7d540bff9dc098d3f4f627a536b4b9"
server_key_iv: "f2811cba2f98f44fec387e26e9801c86"
server_key_version: "encryptionkey@0"
I20260809 05:33:49.819881 27677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "8233f963645949c89be54aec0378faca"
format_stamp: "Formatted at 2026-08-09 05:33:49 on dist-test-slave-h3ft"
server_key: "1a7d540bff9dc098d3f4f627a536b4b9"
server_key_iv: "f2811cba2f98f44fec387e26e9801c86"
server_key_version: "encryptionkey@0"
I20260809 05:33:49.826527 27677 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260809 05:33:49.831562 27699 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:49.833379 27677 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 05:33:49.833612 27677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "8233f963645949c89be54aec0378faca"
format_stamp: "Formatted at 2026-08-09 05:33:49 on dist-test-slave-h3ft"
server_key: "1a7d540bff9dc098d3f4f627a536b4b9"
server_key_iv: "f2811cba2f98f44fec387e26e9801c86"
server_key_version: "encryptionkey@0"
I20260809 05:33:49.833923 27677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:49.862166 27677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:49.867937 27677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:49.868323 27677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:49.890808 27677 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41917
I20260809 05:33:49.890872 27784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41917 every 8 connection(s)
I20260809 05:33:49.892623 27677 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:33:49.897835 27787 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:49.903259 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 27677
I20260809 05:33:49.903534 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:33:49.904256 27364 external_mini_cluster.cc:1428] Setting key 30577e21d5b7eab2f9dedc0d8f1c9e93
I20260809 05:33:49.915835 27787 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8233f963645949c89be54aec0378faca: Bootstrap starting.
I20260809 05:33:49.921160 27787 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8233f963645949c89be54aec0378faca: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:49.923106 27787 log.cc:824] T 00000000000000000000000000000000 P 8233f963645949c89be54aec0378faca: Log is configured to *not* fsync() on all Append() calls
Aug 09 05:33:49 dist-test-slave-h3ft krb5kdc[27659](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253629, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 05:33:49.927441 27787 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8233f963645949c89be54aec0378faca: No bootstrap required, opened a new log
I20260809 05:33:49.934300 27792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:49.907162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:50493 (local address 127.0.0.1:41917)
0809 05:33:49.908163 (+ 1001us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:49.908178 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:49.908234 (+ 56us) server_negotiation.cc:407] Connection header received
0809 05:33:49.910229 (+ 1995us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:49.910260 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:49.910849 (+ 589us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:49.911376 (+ 527us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:49.913673 (+ 2297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:49.915450 (+ 1777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:49.917561 (+ 2111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:49.918450 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:49.918619 (+ 169us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:49.925173 (+ 6554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:49.925184 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:49.925205 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:49.925256 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:49.928969 (+ 3713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:49.930026 (+ 1057us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:49.930034 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:49.930043 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:49.930240 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:49.930809 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:49.930813 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:49.930815 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:49.931550 (+ 735us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:49.931970 (+ 420us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:49.932491 (+ 521us) server_negotiation.cc:299] Negotiation successful
0809 05:33:49.932951 (+ 460us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":740,"thread_start_us":461,"threads_started":1}
I20260809 05:33:49.937889 27787 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8233f963645949c89be54aec0378faca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8233f963645949c89be54aec0378faca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41917 } }
I20260809 05:33:49.938521 27787 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8233f963645949c89be54aec0378faca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:49.938685 27787 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8233f963645949c89be54aec0378faca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8233f963645949c89be54aec0378faca, State: Initialized, Role: FOLLOWER
I20260809 05:33:49.939586 27364 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 05:33:49.939690 27787 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8233f963645949c89be54aec0378faca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8233f963645949c89be54aec0378faca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41917 } }
I20260809 05:33:49.940052 27787 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8233f963645949c89be54aec0378faca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:33:49.940236 27787 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8233f963645949c89be54aec0378faca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:33:49.940456 27787 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8233f963645949c89be54aec0378faca [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:49.943419 27787 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8233f963645949c89be54aec0378faca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8233f963645949c89be54aec0378faca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41917 } }
I20260809 05:33:49.944108 27787 leader_election.cc:302] T 00000000000000000000000000000000 P 8233f963645949c89be54aec0378faca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8233f963645949c89be54aec0378faca; no voters:
I20260809 05:33:49.944972 27787 leader_election.cc:288] T 00000000000000000000000000000000 P 8233f963645949c89be54aec0378faca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:33:49.945130 27800 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8233f963645949c89be54aec0378faca [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:33:49.949193 27787 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8233f963645949c89be54aec0378faca [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:33:49.953135 27800 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8233f963645949c89be54aec0378faca [term 1 LEADER]: Becoming Leader. State: Replica: 8233f963645949c89be54aec0378faca, State: Running, Role: LEADER
I20260809 05:33:49.954833 27800 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8233f963645949c89be54aec0378faca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8233f963645949c89be54aec0378faca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41917 } }
I20260809 05:33:49.959959 27802 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8233f963645949c89be54aec0378faca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8233f963645949c89be54aec0378faca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8233f963645949c89be54aec0378faca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41917 } } }
I20260809 05:33:49.960538 27802 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8233f963645949c89be54aec0378faca [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:49.963385 27804 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8233f963645949c89be54aec0378faca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8233f963645949c89be54aec0378faca. Latest consensus state: current_term: 1 leader_uuid: "8233f963645949c89be54aec0378faca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8233f963645949c89be54aec0378faca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41917 } } }
I20260809 05:33:49.963740 27804 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8233f963645949c89be54aec0378faca [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:49.965250 27816 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:33:49.966702 27792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:49.945313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:47559 (local address 127.0.0.1:41917)
0809 05:33:49.945650 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:49.945657 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:49.945960 (+ 303us) server_negotiation.cc:407] Connection header received
0809 05:33:49.946319 (+ 359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:49.946328 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:49.946447 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:49.946531 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:49.948630 (+ 2099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:49.949589 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:49.951685 (+ 2096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:49.952346 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:49.952481 (+ 135us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:49.956502 (+ 4021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:49.956508 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:49.956511 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:49.956550 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:49.961250 (+ 4700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:49.962657 (+ 1407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:49.962669 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:49.962676 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:49.962980 (+ 304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:49.963698 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:49.963702 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:49.963707 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:49.964265 (+ 558us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:49.965864 (+ 1599us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:49.966060 (+ 196us) server_negotiation.cc:299] Negotiation successful
0809 05:33:49.966272 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147}
I20260809 05:33:49.972419 27816 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:33:49.984611 27816 catalog_manager.cc:1347] Generated new cluster ID: e4a433e5a52145c28b66f637aff65d64
I20260809 05:33:49.984820 27816 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:33:50.003511 27816 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:33:50.006279 27816 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:33:50.018613 27816 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8233f963645949c89be54aec0378faca: Generated new TSK 0
I20260809 05:33:50.019994 27816 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 05:33:50.037530 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 27677
I20260809 05:33:50.039714 27780 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:33:50.154258 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 27677
W20260809 05:33:50.188995 27655 connection.cc:535] client connection to 127.0.0.1:41917 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41917): Connection reset by peer (error 104)
2026-08-09T05:33:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2743 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:33:50 dist-test-slave-h3ft krb5kdc[27834](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:33:50 dist-test-slave-h3ft krb5kdc[27834](info): set up 2 sockets
Aug 09 05:33:50 dist-test-slave-h3ft krb5kdc[27834](info): commencing operation
krb5kdc: starting...
W20260809 05:33:51.590718 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.380s user 0.003s sys 0.063s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:33:51 dist-test-slave-h3ft krb5kdc[27834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253631, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:33:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:33:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 05:33:52.054793 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39743
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39743
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:33:52.495762 27860 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:52.496272 27860 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:52.496441 27860 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:52.504886 27860 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:33:52.505088 27860 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:52.505218 27860 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:52.505330 27860 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:33:52.505412 27860 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:33:52.517192 27860 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39743
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39743
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:52.519078 27860 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:52.521186 27860 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:52.536016 27869 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:52.535889 27870 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:52.535933 27873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:52.536988 27860 server_base.cc:1034] running on GCE node
I20260809 05:33:52.538152 27860 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:52.540110 27860 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:52.541416 27860 hybrid_clock.cc:648] HybridClock initialized: now 1786253632541347 us; error 55 us; skew 500 ppm
I20260809 05:33:52.541816 27860 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:33:52 dist-test-slave-h3ft krb5kdc[27834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253632, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:33:52.545617 27860 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 05:33:52.547552 27860 webserver.cc:460] Webserver started at http://127.0.0.1:46729/ using document root <none> and password file <none>
I20260809 05:33:52.548425 27860 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:52.548547 27860 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:52.548856 27860 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:52.552740 27860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "11fa8f39ab984c8b85dd23be64c6da98"
format_stamp: "Formatted at 2026-08-09 05:33:52 on dist-test-slave-h3ft"
server_key: "172cc56bc41cdce120b33033335905c1"
server_key_iv: "fbcf29d160fcfd159efe642a688fb0b0"
server_key_version: "encryptionkey@0"
I20260809 05:33:52.553686 27860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "11fa8f39ab984c8b85dd23be64c6da98"
format_stamp: "Formatted at 2026-08-09 05:33:52 on dist-test-slave-h3ft"
server_key: "172cc56bc41cdce120b33033335905c1"
server_key_iv: "fbcf29d160fcfd159efe642a688fb0b0"
server_key_version: "encryptionkey@0"
I20260809 05:33:52.560310 27860 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260809 05:33:52.564823 27884 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:52.566606 27860 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260809 05:33:52.566798 27860 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "11fa8f39ab984c8b85dd23be64c6da98"
format_stamp: "Formatted at 2026-08-09 05:33:52 on dist-test-slave-h3ft"
server_key: "172cc56bc41cdce120b33033335905c1"
server_key_iv: "fbcf29d160fcfd159efe642a688fb0b0"
server_key_version: "encryptionkey@0"
I20260809 05:33:52.567087 27860 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:52.609460 27860 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:52.615422 27860 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:52.615748 27860 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:52.638813 27860 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39743
I20260809 05:33:52.638854 27964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39743 every 8 connection(s)
I20260809 05:33:52.640623 27860 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:33:52.644161 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 27860
I20260809 05:33:52.644428 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:33:52.645149 27364 external_mini_cluster.cc:1428] Setting key 3d06ef41ee36f6cb0a991a1919732feb
I20260809 05:33:52.646212 27966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:52.661741 27970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:52.647573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:36969 (local address 127.0.0.1:39743)
0809 05:33:52.648547 (+ 974us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:52.648562 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:52.648615 (+ 53us) server_negotiation.cc:407] Connection header received
0809 05:33:52.650430 (+ 1815us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:52.650462 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:52.651063 (+ 601us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:52.651540 (+ 477us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:52.652261 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:52.653871 (+ 1610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:52.656040 (+ 2169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:52.656812 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:52.656989 (+ 177us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:52.658604 (+ 1615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:52.658612 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:52.658640 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:52.659394 (+ 754us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:52.659511 (+ 117us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:52.659542 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:52.659690 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:52.660157 (+ 467us) server_negotiation.cc:299] Negotiation successful
0809 05:33:52.660423 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":732,"thread_start_us":458,"threads_started":1}
I20260809 05:33:52.663317 27966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11fa8f39ab984c8b85dd23be64c6da98: Bootstrap starting.
I20260809 05:33:52.666682 27364 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 05:33:52.667897 27966 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11fa8f39ab984c8b85dd23be64c6da98: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:52.669394 27966 log.cc:824] T 00000000000000000000000000000000 P 11fa8f39ab984c8b85dd23be64c6da98: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:52.673764 27966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11fa8f39ab984c8b85dd23be64c6da98: No bootstrap required, opened a new log
I20260809 05:33:52.681316 27970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:52.673473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:42017 (local address 127.0.0.1:39743)
0809 05:33:52.673697 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:52.673705 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:52.674209 (+ 504us) server_negotiation.cc:407] Connection header received
0809 05:33:52.674408 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:52.674419 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:52.674513 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:52.674672 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:52.675396 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:52.676684 (+ 1288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:52.678153 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:52.678887 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:52.679054 (+ 167us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:52.680379 (+ 1325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:52.680385 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:52.680391 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:52.680416 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:52.680491 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:52.680513 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:52.680663 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:52.680867 (+ 204us) server_negotiation.cc:299] Negotiation successful
0809 05:33:52.680931 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 05:33:52.684551 27966 raft_consensus.cc:348] T 00000000000000000000000000000000 P 11fa8f39ab984c8b85dd23be64c6da98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11fa8f39ab984c8b85dd23be64c6da98" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39743 } }
I20260809 05:33:52.685055 27966 raft_consensus.cc:374] T 00000000000000000000000000000000 P 11fa8f39ab984c8b85dd23be64c6da98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:52.685202 27966 raft_consensus.cc:729] T 00000000000000000000000000000000 P 11fa8f39ab984c8b85dd23be64c6da98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11fa8f39ab984c8b85dd23be64c6da98, State: Initialized, Role: FOLLOWER
I20260809 05:33:52.686043 27966 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11fa8f39ab984c8b85dd23be64c6da98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11fa8f39ab984c8b85dd23be64c6da98" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39743 } }
I20260809 05:33:52.686309 27966 raft_consensus.cc:388] T 00000000000000000000000000000000 P 11fa8f39ab984c8b85dd23be64c6da98 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:33:52.686425 27966 raft_consensus.cc:482] T 00000000000000000000000000000000 P 11fa8f39ab984c8b85dd23be64c6da98 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:33:52.686573 27966 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 11fa8f39ab984c8b85dd23be64c6da98 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:52.689119 27966 raft_consensus.cc:504] T 00000000000000000000000000000000 P 11fa8f39ab984c8b85dd23be64c6da98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11fa8f39ab984c8b85dd23be64c6da98" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39743 } }
I20260809 05:33:52.689702 27966 leader_election.cc:302] T 00000000000000000000000000000000 P 11fa8f39ab984c8b85dd23be64c6da98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 11fa8f39ab984c8b85dd23be64c6da98; no voters:
I20260809 05:33:52.690395 27966 leader_election.cc:288] T 00000000000000000000000000000000 P 11fa8f39ab984c8b85dd23be64c6da98 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:33:52.690580 27977 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 11fa8f39ab984c8b85dd23be64c6da98 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:33:52.691395 27977 raft_consensus.cc:686] T 00000000000000000000000000000000 P 11fa8f39ab984c8b85dd23be64c6da98 [term 1 LEADER]: Becoming Leader. State: Replica: 11fa8f39ab984c8b85dd23be64c6da98, State: Running, Role: LEADER
I20260809 05:33:52.692037 27977 consensus_queue.cc:237] T 00000000000000000000000000000000 P 11fa8f39ab984c8b85dd23be64c6da98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11fa8f39ab984c8b85dd23be64c6da98" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39743 } }
I20260809 05:33:52.693220 27966 sys_catalog.cc:564] T 00000000000000000000000000000000 P 11fa8f39ab984c8b85dd23be64c6da98 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:33:52.696219 27981 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11fa8f39ab984c8b85dd23be64c6da98 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11fa8f39ab984c8b85dd23be64c6da98. Latest consensus state: current_term: 1 leader_uuid: "11fa8f39ab984c8b85dd23be64c6da98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11fa8f39ab984c8b85dd23be64c6da98" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39743 } } }
I20260809 05:33:52.696712 27981 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11fa8f39ab984c8b85dd23be64c6da98 [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:52.697257 27979 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11fa8f39ab984c8b85dd23be64c6da98 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "11fa8f39ab984c8b85dd23be64c6da98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11fa8f39ab984c8b85dd23be64c6da98" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39743 } } }
I20260809 05:33:52.697595 27979 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11fa8f39ab984c8b85dd23be64c6da98 [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:52.708400 27991 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:33:52.714149 27991 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:33:52.725508 27991 catalog_manager.cc:1347] Generated new cluster ID: a4cee62ed3234c62ae77e237e5242f3c
I20260809 05:33:52.725670 27991 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:33:52.763764 27991 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:33:52.765473 27991 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:33:52.776166 27991 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 11fa8f39ab984c8b85dd23be64c6da98: Generated new TSK 0
I20260809 05:33:52.777598 27991 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 05:33:52.786793 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 27860
W20260809 05:33:52.788254 27960 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.166:36969
W20260809 05:33:52.789247 27364 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 27860: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 05:33:52.789424 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 27860
W20260809 05:33:52.821507 27832 connection.cc:535] client connection to 127.0.0.1:39743 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39743): Connection reset by peer (error 104)
2026-08-09T05:33:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2632 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:33:52 dist-test-slave-h3ft krb5kdc[28012](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:33:52 dist-test-slave-h3ft krb5kdc[28012](info): set up 2 sockets
Aug 09 05:33:52 dist-test-slave-h3ft krb5kdc[28012](info): commencing operation
krb5kdc: starting...
W20260809 05:33:54.218015 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.375s user 0.000s sys 0.065s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:33:54 dist-test-slave-h3ft krb5kdc[28012](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253634, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:33:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:33:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 05:33:54.652763 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34817
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34817
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:33:55.104826 28032 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:55.105314 28032 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:55.105528 28032 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:55.113914 28032 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:33:55.114094 28032 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:55.114185 28032 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:55.114305 28032 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:33:55.114362 28032 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:33:55.126011 28032 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34817
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34817
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:55.128068 28032 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:55.130061 28032 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:55.146716 28040 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:55.146585 28041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:55.146701 28044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:55.148118 28032 server_base.cc:1034] running on GCE node
I20260809 05:33:55.149255 28032 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:55.151290 28032 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:55.152536 28032 hybrid_clock.cc:648] HybridClock initialized: now 1786253635152483 us; error 44 us; skew 500 ppm
I20260809 05:33:55.152972 28032 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:33:55 dist-test-slave-h3ft krb5kdc[28012](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253635, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:33:55.160604 28032 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 05:33:55.162532 28032 webserver.cc:460] Webserver started at http://127.0.0.1:35445/ using document root <none> and password file <none>
I20260809 05:33:55.163523 28032 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:55.163645 28032 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:55.163975 28032 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:55.168007 28032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "9588df326dd0433eb856988eed7760fb"
format_stamp: "Formatted at 2026-08-09 05:33:55 on dist-test-slave-h3ft"
server_key: "da29be3c034bf5c320f5959d3c4264c3"
server_key_iv: "682aad7f2699fdac34b0d535234548c7"
server_key_version: "encryptionkey@0"
I20260809 05:33:55.168905 28032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "9588df326dd0433eb856988eed7760fb"
format_stamp: "Formatted at 2026-08-09 05:33:55 on dist-test-slave-h3ft"
server_key: "da29be3c034bf5c320f5959d3c4264c3"
server_key_iv: "682aad7f2699fdac34b0d535234548c7"
server_key_version: "encryptionkey@0"
I20260809 05:33:55.175316 28032 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260809 05:33:55.179509 28055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:55.181275 28032 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260809 05:33:55.181454 28032 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "9588df326dd0433eb856988eed7760fb"
format_stamp: "Formatted at 2026-08-09 05:33:55 on dist-test-slave-h3ft"
server_key: "da29be3c034bf5c320f5959d3c4264c3"
server_key_iv: "682aad7f2699fdac34b0d535234548c7"
server_key_version: "encryptionkey@0"
I20260809 05:33:55.181660 28032 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:55.188674 28032 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:55.193781 28032 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:55.194104 28032 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:55.217088 28032 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34817
I20260809 05:33:55.217114 28141 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34817 every 8 connection(s)
I20260809 05:33:55.218967 28032 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:33:55.224094 28142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:55.229051 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 28032
I20260809 05:33:55.229295 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:33:55.229954 27364 external_mini_cluster.cc:1428] Setting key f00394162961dfe90adfbfb716684ee9
I20260809 05:33:55.239914 28148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:55.232462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:55225 (local address 127.0.0.1:34817)
0809 05:33:55.233487 (+ 1025us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:55.233502 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:55.233558 (+ 56us) server_negotiation.cc:407] Connection header received
0809 05:33:55.235557 (+ 1999us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:55.235590 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:55.236074 (+ 484us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:55.236548 (+ 474us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:55.237935 (+ 1387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:55.237943 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:55.237958 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:55.237974 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:55.238047 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:55.238071 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:55.238277 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:55.238388 (+ 111us) server_negotiation.cc:299] Negotiation successful
0809 05:33:55.238650 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":760,"thread_start_us":484,"threads_started":1}
I20260809 05:33:55.240343 28142 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9588df326dd0433eb856988eed7760fb: Bootstrap starting.
I20260809 05:33:55.244359 28142 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9588df326dd0433eb856988eed7760fb: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:55.244441 27364 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 05:33:55.245745 28142 log.cc:824] T 00000000000000000000000000000000 P 9588df326dd0433eb856988eed7760fb: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:55.249930 28142 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9588df326dd0433eb856988eed7760fb: No bootstrap required, opened a new log
I20260809 05:33:55.253083 28148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:55.249933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:49063 (local address 127.0.0.1:34817)
0809 05:33:55.250136 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:55.250144 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:55.250645 (+ 501us) server_negotiation.cc:407] Connection header received
0809 05:33:55.250890 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:55.250894 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:55.250962 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:55.251130 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:55.252269 (+ 1139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:55.252275 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:55.252280 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:33:55.252307 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:55.252360 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:33:55.252377 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:55.252533 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:55.252665 (+ 132us) server_negotiation.cc:299] Negotiation successful
0809 05:33:55.252758 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 05:33:55.259598 28142 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9588df326dd0433eb856988eed7760fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9588df326dd0433eb856988eed7760fb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34817 } }
I20260809 05:33:55.260164 28142 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9588df326dd0433eb856988eed7760fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:55.260290 28142 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9588df326dd0433eb856988eed7760fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9588df326dd0433eb856988eed7760fb, State: Initialized, Role: FOLLOWER
I20260809 05:33:55.261019 28142 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9588df326dd0433eb856988eed7760fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9588df326dd0433eb856988eed7760fb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34817 } }
I20260809 05:33:55.261282 28142 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9588df326dd0433eb856988eed7760fb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:33:55.261463 28142 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9588df326dd0433eb856988eed7760fb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:33:55.261646 28142 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9588df326dd0433eb856988eed7760fb [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:55.264362 28142 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9588df326dd0433eb856988eed7760fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9588df326dd0433eb856988eed7760fb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34817 } }
I20260809 05:33:55.265025 28142 leader_election.cc:302] T 00000000000000000000000000000000 P 9588df326dd0433eb856988eed7760fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9588df326dd0433eb856988eed7760fb; no voters:
I20260809 05:33:55.265858 28142 leader_election.cc:288] T 00000000000000000000000000000000 P 9588df326dd0433eb856988eed7760fb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:33:55.266023 28157 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9588df326dd0433eb856988eed7760fb [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:33:55.266916 28157 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9588df326dd0433eb856988eed7760fb [term 1 LEADER]: Becoming Leader. State: Replica: 9588df326dd0433eb856988eed7760fb, State: Running, Role: LEADER
I20260809 05:33:55.267805 28157 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9588df326dd0433eb856988eed7760fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9588df326dd0433eb856988eed7760fb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34817 } }
I20260809 05:33:55.268668 28142 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9588df326dd0433eb856988eed7760fb [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:33:55.271430 28158 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9588df326dd0433eb856988eed7760fb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9588df326dd0433eb856988eed7760fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9588df326dd0433eb856988eed7760fb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34817 } } }
I20260809 05:33:55.271963 28158 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9588df326dd0433eb856988eed7760fb [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:55.271422 28159 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9588df326dd0433eb856988eed7760fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9588df326dd0433eb856988eed7760fb. Latest consensus state: current_term: 1 leader_uuid: "9588df326dd0433eb856988eed7760fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9588df326dd0433eb856988eed7760fb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34817 } } }
I20260809 05:33:55.272179 28159 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9588df326dd0433eb856988eed7760fb [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:55.276369 28165 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:33:55.283671 28165 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:33:55.294584 28165 catalog_manager.cc:1347] Generated new cluster ID: 8efebb6ab5a645548229372643362527
I20260809 05:33:55.294727 28165 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:33:55.333536 28165 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:33:55.334215 28165 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:33:55.345254 28165 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9588df326dd0433eb856988eed7760fb: Generated new TSK 0
I20260809 05:33:55.346494 28165 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 05:33:55.351601 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 28032
W20260809 05:33:55.353119 28133 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.166:55225
W20260809 05:33:55.353979 27364 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 28032: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 05:33:55.354159 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 28032
2026-08-09T05:33:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2568 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:33:55 dist-test-slave-h3ft krb5kdc[28190](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:33:55 dist-test-slave-h3ft krb5kdc[28190](info): set up 2 sockets
Aug 09 05:33:55 dist-test-slave-h3ft krb5kdc[28190](info): commencing operation
krb5kdc: starting...
W20260809 05:33:56.794732 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.383s user 0.008s sys 0.059s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:33:57 dist-test-slave-h3ft krb5kdc[28190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253637, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:33:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:33:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 05:33:57.235857 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41061
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41061
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:33:57.674373 28212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:33:57.675098 28212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:33:57.675311 28212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:33:57.683787 28212 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:33:57.683990 28212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:33:57.684104 28212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:33:57.684218 28212 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:33:57.684305 28212 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:33:57.696307 28212 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41061
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41061
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:33:57.698285 28212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:33:57.700173 28212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:33:57.716235 28223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:57.716295 28226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:33:57.716331 28224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:33:57.717558 28212 server_base.cc:1034] running on GCE node
I20260809 05:33:57.718664 28212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:33:57.720781 28212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:33:57.722070 28212 hybrid_clock.cc:648] HybridClock initialized: now 1786253637722011 us; error 49 us; skew 500 ppm
I20260809 05:33:57.722505 28212 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:33:57 dist-test-slave-h3ft krb5kdc[28190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253637, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:33:57.726744 28212 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 05:33:57.728890 28212 webserver.cc:460] Webserver started at http://127.0.0.1:45539/ using document root <none> and password file <none>
I20260809 05:33:57.729849 28212 fs_manager.cc:359] Metadata directory not provided
I20260809 05:33:57.730018 28212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:33:57.730436 28212 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:33:57.734753 28212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "17df1633dd6744e19b3b58d8c637d332"
format_stamp: "Formatted at 2026-08-09 05:33:57 on dist-test-slave-h3ft"
server_key: "a1c543b44f8cd5af9da06e74f6468071"
server_key_iv: "6612424e7f503eeb45d46fb10c0a5653"
server_key_version: "encryptionkey@0"
I20260809 05:33:57.735984 28212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "17df1633dd6744e19b3b58d8c637d332"
format_stamp: "Formatted at 2026-08-09 05:33:57 on dist-test-slave-h3ft"
server_key: "a1c543b44f8cd5af9da06e74f6468071"
server_key_iv: "6612424e7f503eeb45d46fb10c0a5653"
server_key_version: "encryptionkey@0"
I20260809 05:33:57.743777 28212 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260809 05:33:57.748791 28239 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:33:57.750774 28212 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260809 05:33:57.751118 28212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "17df1633dd6744e19b3b58d8c637d332"
format_stamp: "Formatted at 2026-08-09 05:33:57 on dist-test-slave-h3ft"
server_key: "a1c543b44f8cd5af9da06e74f6468071"
server_key_iv: "6612424e7f503eeb45d46fb10c0a5653"
server_key_version: "encryptionkey@0"
I20260809 05:33:57.751389 28212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:33:57.776248 28212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:33:57.781870 28212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:33:57.782258 28212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:33:57.804821 28212 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41061
I20260809 05:33:57.804847 28321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41061 every 8 connection(s)
I20260809 05:33:57.806677 28212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:33:57.811929 28322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:33:57.813614 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 28212
I20260809 05:33:57.813849 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:33:57.814379 27364 external_mini_cluster.cc:1428] Setting key 8bef699e65a6ff85b78a445edc6caa5b
I20260809 05:33:57.828758 28322 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17df1633dd6744e19b3b58d8c637d332: Bootstrap starting.
Aug 09 05:33:57 dist-test-slave-h3ft krb5kdc[28190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253637, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 05:33:57.834553 28322 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 17df1633dd6744e19b3b58d8c637d332: Neither blocks nor log segments found. Creating new log.
I20260809 05:33:57.836210 28322 log.cc:824] T 00000000000000000000000000000000 P 17df1633dd6744e19b3b58d8c637d332: Log is configured to *not* fsync() on all Append() calls
I20260809 05:33:57.840396 28322 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17df1633dd6744e19b3b58d8c637d332: No bootstrap required, opened a new log
I20260809 05:33:57.845078 28325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:57.816805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:42095 (local address 127.0.0.1:41061)
0809 05:33:57.817825 (+ 1020us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:57.817844 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:57.817906 (+ 62us) server_negotiation.cc:407] Connection header received
0809 05:33:57.819880 (+ 1974us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:57.819917 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:57.820478 (+ 561us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:57.820909 (+ 431us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:57.823253 (+ 2344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:57.824774 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:57.826857 (+ 2083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:57.827737 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:57.827891 (+ 154us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:57.834658 (+ 6767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:57.834671 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:57.834694 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:57.834791 (+ 97us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:57.839133 (+ 4342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:57.840310 (+ 1177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:57.840319 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:57.840328 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:57.840624 (+ 296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:57.841233 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:57.841239 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:57.841248 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:57.842015 (+ 767us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:57.842475 (+ 460us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:57.843186 (+ 711us) server_negotiation.cc:299] Negotiation successful
0809 05:33:57.843643 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":753,"thread_start_us":478,"threads_started":1}
I20260809 05:33:57.850405 27364 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 05:33:57.851563 28322 raft_consensus.cc:348] T 00000000000000000000000000000000 P 17df1633dd6744e19b3b58d8c637d332 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17df1633dd6744e19b3b58d8c637d332" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41061 } }
I20260809 05:33:57.852062 28322 raft_consensus.cc:374] T 00000000000000000000000000000000 P 17df1633dd6744e19b3b58d8c637d332 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:33:57.852196 28322 raft_consensus.cc:729] T 00000000000000000000000000000000 P 17df1633dd6744e19b3b58d8c637d332 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17df1633dd6744e19b3b58d8c637d332, State: Initialized, Role: FOLLOWER
I20260809 05:33:57.852998 28322 consensus_queue.cc:260] T 00000000000000000000000000000000 P 17df1633dd6744e19b3b58d8c637d332 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17df1633dd6744e19b3b58d8c637d332" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41061 } }
I20260809 05:33:57.853317 28322 raft_consensus.cc:388] T 00000000000000000000000000000000 P 17df1633dd6744e19b3b58d8c637d332 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:33:57.853498 28322 raft_consensus.cc:482] T 00000000000000000000000000000000 P 17df1633dd6744e19b3b58d8c637d332 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:33:57.853722 28322 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 17df1633dd6744e19b3b58d8c637d332 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:33:57.857957 28322 raft_consensus.cc:504] T 00000000000000000000000000000000 P 17df1633dd6744e19b3b58d8c637d332 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17df1633dd6744e19b3b58d8c637d332" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41061 } }
I20260809 05:33:57.858651 28322 leader_election.cc:302] T 00000000000000000000000000000000 P 17df1633dd6744e19b3b58d8c637d332 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 17df1633dd6744e19b3b58d8c637d332; no voters:
I20260809 05:33:57.859563 28322 leader_election.cc:288] T 00000000000000000000000000000000 P 17df1633dd6744e19b3b58d8c637d332 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:33:57.859684 28336 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 17df1633dd6744e19b3b58d8c637d332 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:33:57.863412 28322 sys_catalog.cc:564] T 00000000000000000000000000000000 P 17df1633dd6744e19b3b58d8c637d332 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:33:57.867179 28336 raft_consensus.cc:686] T 00000000000000000000000000000000 P 17df1633dd6744e19b3b58d8c637d332 [term 1 LEADER]: Becoming Leader. State: Replica: 17df1633dd6744e19b3b58d8c637d332, State: Running, Role: LEADER
I20260809 05:33:57.867995 28336 consensus_queue.cc:237] T 00000000000000000000000000000000 P 17df1633dd6744e19b3b58d8c637d332 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17df1633dd6744e19b3b58d8c637d332" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41061 } }
I20260809 05:33:57.876585 28337 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17df1633dd6744e19b3b58d8c637d332 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "17df1633dd6744e19b3b58d8c637d332" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17df1633dd6744e19b3b58d8c637d332" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41061 } } }
I20260809 05:33:57.877264 28337 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17df1633dd6744e19b3b58d8c637d332 [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:57.878120 28344 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17df1633dd6744e19b3b58d8c637d332 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 17df1633dd6744e19b3b58d8c637d332. Latest consensus state: current_term: 1 leader_uuid: "17df1633dd6744e19b3b58d8c637d332" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17df1633dd6744e19b3b58d8c637d332" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41061 } } }
I20260809 05:33:57.878484 28357 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:33:57.878664 28344 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17df1633dd6744e19b3b58d8c637d332 [sys.catalog]: This master's current role is: LEADER
I20260809 05:33:57.880429 28325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:33:57.856473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:35243 (local address 127.0.0.1:41061)
0809 05:33:57.856671 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 05:33:57.856690 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 05:33:57.857353 (+ 663us) server_negotiation.cc:407] Connection header received
0809 05:33:57.857620 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:33:57.857627 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:33:57.857715 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:33:57.857832 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:33:57.859924 (+ 2092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:57.861474 (+ 1550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:57.863118 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:33:57.863746 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:33:57.863905 (+ 159us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:33:57.867547 (+ 3642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:33:57.867559 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:33:57.867568 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:33:57.867637 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:33:57.873918 (+ 6281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:57.875933 (+ 2015us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:57.875943 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:57.875950 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:57.876186 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:33:57.877031 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:33:57.877043 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:33:57.877048 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:33:57.877747 (+ 699us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:33:57.879464 (+ 1717us) server_negotiation.cc:1035] Waiting for connection context
0809 05:33:57.879726 (+ 262us) server_negotiation.cc:299] Negotiation successful
0809 05:33:57.879980 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 05:33:57.891642 28357 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:33:57.905054 28357 catalog_manager.cc:1347] Generated new cluster ID: 9c35fcc3ed474f40bcb33e6436e7ef85
I20260809 05:33:57.905220 28357 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:33:57.937978 28357 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:33:57.939989 28357 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:33:57.958655 28357 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 17df1633dd6744e19b3b58d8c637d332: Generated new TSK 0
I20260809 05:33:57.960376 28357 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 05:33:57.971954 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 28212
I20260809 05:33:57.973706 28313 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:33:58.084398 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 28212
W20260809 05:33:58.122308 28188 connection.cc:535] client connection to 127.0.0.1:41061 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41061): Connection reset by peer (error 104)
2026-08-09T05:33:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2732 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:33:58 dist-test-slave-h3ft krb5kdc[28375](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:33:58 dist-test-slave-h3ft krb5kdc[28375](info): set up 2 sockets
Aug 09 05:33:58 dist-test-slave-h3ft krb5kdc[28375](info): commencing operation
krb5kdc: starting...
W20260809 05:33:59.546499 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.403s user 0.003s sys 0.066s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:33:59 dist-test-slave-h3ft krb5kdc[28375](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253639, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:33:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:33:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 05:33:59.984930 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44727
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44727
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:34:00.438092 28400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:34:00.438580 28400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:34:00.438768 28400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:34:00.446842 28400 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:34:00.447165 28400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:34:00.447302 28400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:34:00.447430 28400 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:34:00.447527 28400 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:34:00.458757 28400 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44727
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44727
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:34:00.460635 28400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:34:00.462338 28400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:34:00.476629 28414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:34:00.476747 28409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:34:00.477298 28412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:34:00.478117 28400 server_base.cc:1034] running on GCE node
I20260809 05:34:00.479195 28400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:34:00.481092 28400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:34:00.482342 28400 hybrid_clock.cc:648] HybridClock initialized: now 1786253640482274 us; error 61 us; skew 500 ppm
I20260809 05:34:00.482753 28400 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:34:00 dist-test-slave-h3ft krb5kdc[28375](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253640, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:34:00.493549 28400 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 05:34:00.495813 28400 webserver.cc:460] Webserver started at http://127.0.0.1:42435/ using document root <none> and password file <none>
I20260809 05:34:00.496796 28400 fs_manager.cc:359] Metadata directory not provided
I20260809 05:34:00.496975 28400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:34:00.497377 28400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:34:00.501525 28400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "117a1452ce03438fadb194ae43173364"
format_stamp: "Formatted at 2026-08-09 05:34:00 on dist-test-slave-h3ft"
server_key: "98d82e01bb6e6e97aed078339fa81930"
server_key_iv: "81245d81263f400128838f31ff9c92ea"
server_key_version: "encryptionkey@0"
I20260809 05:34:00.502571 28400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "117a1452ce03438fadb194ae43173364"
format_stamp: "Formatted at 2026-08-09 05:34:00 on dist-test-slave-h3ft"
server_key: "98d82e01bb6e6e97aed078339fa81930"
server_key_iv: "81245d81263f400128838f31ff9c92ea"
server_key_version: "encryptionkey@0"
I20260809 05:34:00.511523 28400 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.006s sys 0.001s
I20260809 05:34:00.520195 28433 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:34:00.522421 28400 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.003s sys 0.000s
I20260809 05:34:00.522729 28400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "117a1452ce03438fadb194ae43173364"
format_stamp: "Formatted at 2026-08-09 05:34:00 on dist-test-slave-h3ft"
server_key: "98d82e01bb6e6e97aed078339fa81930"
server_key_iv: "81245d81263f400128838f31ff9c92ea"
server_key_version: "encryptionkey@0"
I20260809 05:34:00.523059 28400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:34:00.540416 28400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:34:00.546365 28400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:34:00.546770 28400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:34:00.569454 28400 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44727
I20260809 05:34:00.569478 28511 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44727 every 8 connection(s)
I20260809 05:34:00.571401 28400 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:34:00.574962 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 28400
I20260809 05:34:00.575268 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:34:00.575802 27364 external_mini_cluster.cc:1428] Setting key b2f2042b914444bd84fa5219b582331a
I20260809 05:34:00.576830 28512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:34:00.593605 28518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:00.578092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:48475 (local address 127.0.0.1:44727)
0809 05:34:00.579066 (+ 974us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:00.579084 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:00.579149 (+ 65us) server_negotiation.cc:407] Connection header received
0809 05:34:00.581326 (+ 2177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:00.581362 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:00.582106 (+ 744us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:00.582678 (+ 572us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:00.583362 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:00.585609 (+ 2247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:00.587158 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:00.588321 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:00.588517 (+ 196us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:00.589948 (+ 1431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:00.589960 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:00.589991 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:34:00.590969 (+ 978us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:00.591117 (+ 148us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:34:00.591165 (+ 48us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:00.591359 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:00.591663 (+ 304us) server_negotiation.cc:299] Negotiation successful
0809 05:34:00.591931 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":652,"thread_start_us":375,"threads_started":1}
I20260809 05:34:00.594976 28512 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 117a1452ce03438fadb194ae43173364: Bootstrap starting.
I20260809 05:34:00.598544 27364 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 05:34:00.599228 28512 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 117a1452ce03438fadb194ae43173364: Neither blocks nor log segments found. Creating new log.
I20260809 05:34:00.600764 28512 log.cc:824] T 00000000000000000000000000000000 P 117a1452ce03438fadb194ae43173364: Log is configured to *not* fsync() on all Append() calls
I20260809 05:34:00.605060 28512 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 117a1452ce03438fadb194ae43173364: No bootstrap required, opened a new log
I20260809 05:34:00.612049 28518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:00.604921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:52643 (local address 127.0.0.1:44727)
0809 05:34:00.605132 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:00.605140 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:00.605621 (+ 481us) server_negotiation.cc:407] Connection header received
0809 05:34:00.605878 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:00.605882 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:00.605970 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:00.606087 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:00.606677 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:00.607603 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:00.609096 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:00.609614 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:00.609751 (+ 137us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:00.611191 (+ 1440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:00.611196 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:00.611200 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:34:00.611223 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:00.611274 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:34:00.611294 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:00.611438 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:00.611644 (+ 206us) server_negotiation.cc:299] Negotiation successful
0809 05:34:00.611712 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 05:34:00.615447 28512 raft_consensus.cc:348] T 00000000000000000000000000000000 P 117a1452ce03438fadb194ae43173364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "117a1452ce03438fadb194ae43173364" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44727 } }
I20260809 05:34:00.616041 28512 raft_consensus.cc:374] T 00000000000000000000000000000000 P 117a1452ce03438fadb194ae43173364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:34:00.616178 28512 raft_consensus.cc:729] T 00000000000000000000000000000000 P 117a1452ce03438fadb194ae43173364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 117a1452ce03438fadb194ae43173364, State: Initialized, Role: FOLLOWER
I20260809 05:34:00.617034 28512 consensus_queue.cc:260] T 00000000000000000000000000000000 P 117a1452ce03438fadb194ae43173364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "117a1452ce03438fadb194ae43173364" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44727 } }
I20260809 05:34:00.617390 28512 raft_consensus.cc:388] T 00000000000000000000000000000000 P 117a1452ce03438fadb194ae43173364 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:34:00.617591 28512 raft_consensus.cc:482] T 00000000000000000000000000000000 P 117a1452ce03438fadb194ae43173364 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:34:00.617841 28512 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 117a1452ce03438fadb194ae43173364 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:34:00.620782 28512 raft_consensus.cc:504] T 00000000000000000000000000000000 P 117a1452ce03438fadb194ae43173364 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "117a1452ce03438fadb194ae43173364" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44727 } }
I20260809 05:34:00.621513 28512 leader_election.cc:302] T 00000000000000000000000000000000 P 117a1452ce03438fadb194ae43173364 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 117a1452ce03438fadb194ae43173364; no voters:
I20260809 05:34:00.622479 28512 leader_election.cc:288] T 00000000000000000000000000000000 P 117a1452ce03438fadb194ae43173364 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:34:00.622593 28529 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 117a1452ce03438fadb194ae43173364 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:34:00.623589 28529 raft_consensus.cc:686] T 00000000000000000000000000000000 P 117a1452ce03438fadb194ae43173364 [term 1 LEADER]: Becoming Leader. State: Replica: 117a1452ce03438fadb194ae43173364, State: Running, Role: LEADER
I20260809 05:34:00.624326 28529 consensus_queue.cc:237] T 00000000000000000000000000000000 P 117a1452ce03438fadb194ae43173364 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "117a1452ce03438fadb194ae43173364" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44727 } }
I20260809 05:34:00.625384 28512 sys_catalog.cc:564] T 00000000000000000000000000000000 P 117a1452ce03438fadb194ae43173364 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:34:00.628108 28531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 117a1452ce03438fadb194ae43173364 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 117a1452ce03438fadb194ae43173364. Latest consensus state: current_term: 1 leader_uuid: "117a1452ce03438fadb194ae43173364" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "117a1452ce03438fadb194ae43173364" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44727 } } }
I20260809 05:34:00.628160 28530 sys_catalog.cc:455] T 00000000000000000000000000000000 P 117a1452ce03438fadb194ae43173364 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "117a1452ce03438fadb194ae43173364" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "117a1452ce03438fadb194ae43173364" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44727 } } }
I20260809 05:34:00.628551 28531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 117a1452ce03438fadb194ae43173364 [sys.catalog]: This master's current role is: LEADER
I20260809 05:34:00.628679 28530 sys_catalog.cc:458] T 00000000000000000000000000000000 P 117a1452ce03438fadb194ae43173364 [sys.catalog]: This master's current role is: LEADER
I20260809 05:34:00.632139 28536 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:34:00.639480 28536 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:34:00.652107 28536 catalog_manager.cc:1347] Generated new cluster ID: cc43ad2a8ef6458dba109b34949a6236
I20260809 05:34:00.652308 28536 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:34:00.664079 28536 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:34:00.666285 28536 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:34:00.680939 28536 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 117a1452ce03438fadb194ae43173364: Generated new TSK 0
I20260809 05:34:00.682256 28536 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 05:34:00.696329 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 28400
W20260809 05:34:00.697805 28500 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.166:48475
W20260809 05:34:00.698767 27364 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 28400: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 05:34:00.698968 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 28400
W20260809 05:34:00.730774 28373 connection.cc:535] client connection to 127.0.0.1:44727 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44727): Connection reset by peer (error 104)
2026-08-09T05:34:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2608 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:34:00 dist-test-slave-h3ft krb5kdc[28562](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:34:00 dist-test-slave-h3ft krb5kdc[28562](info): set up 2 sockets
Aug 09 05:34:00 dist-test-slave-h3ft krb5kdc[28562](info): commencing operation
krb5kdc: starting...
W20260809 05:34:02.181600 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.429s user 0.004s sys 0.064s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:34:02 dist-test-slave-h3ft krb5kdc[28562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253642, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:34:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:34:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 05:34:02.612124 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44901
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44901
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:34:03.049821 28585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:34:03.050303 28585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:34:03.050491 28585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:34:03.058795 28585 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:34:03.059007 28585 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:34:03.059157 28585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:34:03.059281 28585 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:34:03.059367 28585 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:34:03.070937 28585 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44901
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786253234117492-27364-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44901
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:34:03.072953 28585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:34:03.074759 28585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:34:03.089367 28592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:34:03.089636 28593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:34:03.089612 28596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:34:03.090611 28585 server_base.cc:1034] running on GCE node
I20260809 05:34:03.091846 28585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:34:03.093730 28585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:34:03.095069 28585 hybrid_clock.cc:648] HybridClock initialized: now 1786253643094947 us; error 60 us; skew 500 ppm
I20260809 05:34:03.095498 28585 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:34:03 dist-test-slave-h3ft krb5kdc[28562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253643, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:34:03.099849 28585 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 05:34:03.101922 28585 webserver.cc:460] Webserver started at http://127.0.0.1:38899/ using document root <none> and password file <none>
I20260809 05:34:03.102888 28585 fs_manager.cc:359] Metadata directory not provided
I20260809 05:34:03.103055 28585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:34:03.103487 28585 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:34:03.107688 28585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "8c652020c89c4022878e22a87c04b96b"
format_stamp: "Formatted at 2026-08-09 05:34:03 on dist-test-slave-h3ft"
server_key: "566be97402305c8d8a856bb329af0f41"
server_key_iv: "3f19e51bbd44275b46df0ba8339ef494"
server_key_version: "encryptionkey@0"
I20260809 05:34:03.108695 28585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "8c652020c89c4022878e22a87c04b96b"
format_stamp: "Formatted at 2026-08-09 05:34:03 on dist-test-slave-h3ft"
server_key: "566be97402305c8d8a856bb329af0f41"
server_key_iv: "3f19e51bbd44275b46df0ba8339ef494"
server_key_version: "encryptionkey@0"
I20260809 05:34:03.115996 28585 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260809 05:34:03.121431 28607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:34:03.123497 28585 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260809 05:34:03.123721 28585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "8c652020c89c4022878e22a87c04b96b"
format_stamp: "Formatted at 2026-08-09 05:34:03 on dist-test-slave-h3ft"
server_key: "566be97402305c8d8a856bb329af0f41"
server_key_iv: "3f19e51bbd44275b46df0ba8339ef494"
server_key_version: "encryptionkey@0"
I20260809 05:34:03.124003 28585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:34:03.131351 28585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:34:03.137388 28585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:34:03.137756 28585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:34:03.160907 28585 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44901
I20260809 05:34:03.160969 28690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44901 every 8 connection(s)
I20260809 05:34:03.162750 28585 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:34:03.167639 28691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:34:03.167950 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 28585
I20260809 05:34:03.168174 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:34:03.168741 27364 external_mini_cluster.cc:1428] Setting key 7c41c35e281a76a7a0af41990385256b
I20260809 05:34:03.177798 28695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:03.170940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:46487 (local address 127.0.0.1:44901)
0809 05:34:03.171945 (+ 1005us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:03.171959 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:03.172010 (+ 51us) server_negotiation.cc:407] Connection header received
0809 05:34:03.173658 (+ 1648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:03.173685 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:03.174140 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:03.174664 (+ 524us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:03.175920 (+ 1256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:03.175927 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:03.175945 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:34:03.175967 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:03.176028 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:34:03.176050 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:03.176317 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:03.176486 (+ 169us) server_negotiation.cc:299] Negotiation successful
0809 05:34:03.176707 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":716,"thread_start_us":394,"threads_started":1}
I20260809 05:34:03.182327 27364 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 05:34:03.183831 28691 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c652020c89c4022878e22a87c04b96b: Bootstrap starting.
I20260809 05:34:03.188024 28691 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8c652020c89c4022878e22a87c04b96b: Neither blocks nor log segments found. Creating new log.
I20260809 05:34:03.189489 28691 log.cc:824] T 00000000000000000000000000000000 P 8c652020c89c4022878e22a87c04b96b: Log is configured to *not* fsync() on all Append() calls
I20260809 05:34:03.190868 28695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:03.187755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.166:59937 (local address 127.0.0.1:44901)
0809 05:34:03.187987 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:03.187995 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:03.188348 (+ 353us) server_negotiation.cc:407] Connection header received
0809 05:34:03.188587 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:03.188591 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:03.188647 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:03.188757 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:03.189975 (+ 1218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:03.189981 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:03.189987 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:34:03.190012 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:03.190077 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:34:03.190108 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:03.190282 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:03.190484 (+ 202us) server_negotiation.cc:299] Negotiation successful
0809 05:34:03.190543 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 05:34:03.193575 28691 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c652020c89c4022878e22a87c04b96b: No bootstrap required, opened a new log
I20260809 05:34:03.202580 28691 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8c652020c89c4022878e22a87c04b96b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c652020c89c4022878e22a87c04b96b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44901 } }
I20260809 05:34:03.203184 28691 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8c652020c89c4022878e22a87c04b96b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:34:03.203329 28691 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8c652020c89c4022878e22a87c04b96b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c652020c89c4022878e22a87c04b96b, State: Initialized, Role: FOLLOWER
I20260809 05:34:03.204185 28691 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8c652020c89c4022878e22a87c04b96b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c652020c89c4022878e22a87c04b96b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44901 } }
I20260809 05:34:03.204476 28691 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8c652020c89c4022878e22a87c04b96b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:34:03.204649 28691 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8c652020c89c4022878e22a87c04b96b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:34:03.204864 28691 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8c652020c89c4022878e22a87c04b96b [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:34:03.207688 28691 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8c652020c89c4022878e22a87c04b96b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c652020c89c4022878e22a87c04b96b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44901 } }
I20260809 05:34:03.208352 28691 leader_election.cc:302] T 00000000000000000000000000000000 P 8c652020c89c4022878e22a87c04b96b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8c652020c89c4022878e22a87c04b96b; no voters:
I20260809 05:34:03.209096 28691 leader_election.cc:288] T 00000000000000000000000000000000 P 8c652020c89c4022878e22a87c04b96b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:34:03.209295 28705 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8c652020c89c4022878e22a87c04b96b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:34:03.210191 28705 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8c652020c89c4022878e22a87c04b96b [term 1 LEADER]: Becoming Leader. State: Replica: 8c652020c89c4022878e22a87c04b96b, State: Running, Role: LEADER
I20260809 05:34:03.210803 28705 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8c652020c89c4022878e22a87c04b96b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c652020c89c4022878e22a87c04b96b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44901 } }
I20260809 05:34:03.211896 28691 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8c652020c89c4022878e22a87c04b96b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:34:03.214636 28707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c652020c89c4022878e22a87c04b96b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8c652020c89c4022878e22a87c04b96b. Latest consensus state: current_term: 1 leader_uuid: "8c652020c89c4022878e22a87c04b96b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c652020c89c4022878e22a87c04b96b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44901 } } }
I20260809 05:34:03.214799 28706 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c652020c89c4022878e22a87c04b96b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8c652020c89c4022878e22a87c04b96b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c652020c89c4022878e22a87c04b96b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44901 } } }
I20260809 05:34:03.215526 28707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c652020c89c4022878e22a87c04b96b [sys.catalog]: This master's current role is: LEADER
I20260809 05:34:03.215551 28706 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c652020c89c4022878e22a87c04b96b [sys.catalog]: This master's current role is: LEADER
I20260809 05:34:03.216934 28719 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:34:03.225034 28719 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:34:03.238605 28719 catalog_manager.cc:1347] Generated new cluster ID: b518c988174147ceaa69ec52d6f2dd22
I20260809 05:34:03.238845 28719 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:34:03.275502 28719 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:34:03.276172 28719 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:34:03.289683 28719 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8c652020c89c4022878e22a87c04b96b: Generated new TSK 0
I20260809 05:34:03.291219 28719 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 05:34:03.304330 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 28585
W20260809 05:34:03.305817 28685 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.166:46487
W20260809 05:34:03.306726 27364 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 28585: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 05:34:03.306926 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 28585
2026-08-09T05:34:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2611 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:34:03 dist-test-slave-h3ft krb5kdc[28735](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:34:03 dist-test-slave-h3ft krb5kdc[28735](info): set up 2 sockets
Aug 09 05:34:03 dist-test-slave-h3ft krb5kdc[28735](info): commencing operation
krb5kdc: starting...
W20260809 05:34:04.756433 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.393s user 0.004s sys 0.065s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:34:05 dist-test-slave-h3ft krb5kdc[28735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253645, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:34:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:34:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
I20260809 05:34:05.221019 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:42237
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:35699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:42237
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:34:05.680384 28759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:34:05.680826 28759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:34:05.681028 28759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:34:05.689642 28759 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:34:05.689824 28759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:34:05.689939 28759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:34:05.690043 28759 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:34:05.690129 28759 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:34:05.702486 28759 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:35699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:42237
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:42237
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:34:05.704605 28759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:34:05.706529 28759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:34:05.723402 28766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:34:05.723371 28770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:34:05.723321 28767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:34:05.725001 28759 server_base.cc:1034] running on GCE node
I20260809 05:34:05.726521 28759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:34:05.728971 28759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:34:05.730310 28759 hybrid_clock.cc:648] HybridClock initialized: now 1786253645730241 us; error 109 us; skew 500 ppm
I20260809 05:34:05.730865 28759 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:34:05 dist-test-slave-h3ft krb5kdc[28735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253645, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:34:05.739993 28759 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:34:05.742457 28759 webserver.cc:460] Webserver started at http://127.26.185.62:33183/ using document root <none> and password file <none>
I20260809 05:34:05.743680 28759 fs_manager.cc:359] Metadata directory not provided
I20260809 05:34:05.743835 28759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:34:05.744256 28759 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:34:05.748662 28759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "d94a9f6f8fbe4f8ba3d5a6202c0645c8"
format_stamp: "Formatted at 2026-08-09 05:34:05 on dist-test-slave-h3ft"
server_key: "01660ad156fcdb6f52c4addacabba66d"
server_key_iv: "0aa5371dc284de8531c2b31429d70163"
server_key_version: "encryptionkey@0"
I20260809 05:34:05.749897 28759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "d94a9f6f8fbe4f8ba3d5a6202c0645c8"
format_stamp: "Formatted at 2026-08-09 05:34:05 on dist-test-slave-h3ft"
server_key: "01660ad156fcdb6f52c4addacabba66d"
server_key_iv: "0aa5371dc284de8531c2b31429d70163"
server_key_version: "encryptionkey@0"
I20260809 05:34:05.757994 28759 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260809 05:34:05.763928 28783 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:34:05.766343 28759 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.001s
I20260809 05:34:05.766707 28759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "d94a9f6f8fbe4f8ba3d5a6202c0645c8"
format_stamp: "Formatted at 2026-08-09 05:34:05 on dist-test-slave-h3ft"
server_key: "01660ad156fcdb6f52c4addacabba66d"
server_key_iv: "0aa5371dc284de8531c2b31429d70163"
server_key_version: "encryptionkey@0"
I20260809 05:34:05.767068 28759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:34:05.793605 28759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:34:05.800129 28759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:34:05.800532 28759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:34:05.825798 28759 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:42237
I20260809 05:34:05.825803 28864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:42237 every 8 connection(s)
I20260809 05:34:05.827775 28759 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:34:05.832224 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 28759
I20260809 05:34:05.832480 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:34:05.833087 27364 external_mini_cluster.cc:1428] Setting key 2b4c20fb7cd6f14578ee87f0e0918c47
I20260809 05:34:05.833587 28867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 05:34:05 dist-test-slave-h3ft krb5kdc[28735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253645, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:34:05.852905 28867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d94a9f6f8fbe4f8ba3d5a6202c0645c8: Bootstrap starting.
I20260809 05:34:05.859113 28867 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d94a9f6f8fbe4f8ba3d5a6202c0645c8: Neither blocks nor log segments found. Creating new log.
I20260809 05:34:05.860899 28867 log.cc:824] T 00000000000000000000000000000000 P d94a9f6f8fbe4f8ba3d5a6202c0645c8: Log is configured to *not* fsync() on all Append() calls
I20260809 05:34:05.865449 28872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:05.835647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35479 (local address 127.26.185.62:42237)
0809 05:34:05.836715 (+ 1068us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:05.836736 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:05.836805 (+ 69us) server_negotiation.cc:407] Connection header received
0809 05:34:05.838980 (+ 2175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:05.839023 (+ 43us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:05.839824 (+ 801us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:05.840458 (+ 634us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:05.842165 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:05.844851 (+ 2686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:05.846499 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:05.847821 (+ 1322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:05.848067 (+ 246us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:05.853270 (+ 5203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:05.853285 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:05.853315 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:05.853399 (+ 84us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:05.858476 (+ 5077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:05.859845 (+ 1369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:05.859857 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:05.859870 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:05.860143 (+ 273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:05.860793 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:05.860799 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:05.860806 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:05.861843 (+ 1037us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:05.862273 (+ 430us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:05.863058 (+ 785us) server_negotiation.cc:299] Negotiation successful
0809 05:34:05.863564 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":751,"thread_start_us":432,"threads_started":1}
I20260809 05:34:05.865980 28867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d94a9f6f8fbe4f8ba3d5a6202c0645c8: No bootstrap required, opened a new log
I20260809 05:34:05.871388 27364 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 05:34:05.877664 28867 raft_consensus.cc:348] T 00000000000000000000000000000000 P d94a9f6f8fbe4f8ba3d5a6202c0645c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d94a9f6f8fbe4f8ba3d5a6202c0645c8" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42237 } }
I20260809 05:34:05.878463 28867 raft_consensus.cc:374] T 00000000000000000000000000000000 P d94a9f6f8fbe4f8ba3d5a6202c0645c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:34:05.878643 28867 raft_consensus.cc:729] T 00000000000000000000000000000000 P d94a9f6f8fbe4f8ba3d5a6202c0645c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d94a9f6f8fbe4f8ba3d5a6202c0645c8, State: Initialized, Role: FOLLOWER
I20260809 05:34:05.879590 28867 consensus_queue.cc:260] T 00000000000000000000000000000000 P d94a9f6f8fbe4f8ba3d5a6202c0645c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d94a9f6f8fbe4f8ba3d5a6202c0645c8" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42237 } }
I20260809 05:34:05.879912 28867 raft_consensus.cc:388] T 00000000000000000000000000000000 P d94a9f6f8fbe4f8ba3d5a6202c0645c8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:34:05.880110 28867 raft_consensus.cc:482] T 00000000000000000000000000000000 P d94a9f6f8fbe4f8ba3d5a6202c0645c8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:34:05.880343 28867 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d94a9f6f8fbe4f8ba3d5a6202c0645c8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:34:05.883391 28867 raft_consensus.cc:504] T 00000000000000000000000000000000 P d94a9f6f8fbe4f8ba3d5a6202c0645c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d94a9f6f8fbe4f8ba3d5a6202c0645c8" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42237 } }
I20260809 05:34:05.884150 28867 leader_election.cc:302] T 00000000000000000000000000000000 P d94a9f6f8fbe4f8ba3d5a6202c0645c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d94a9f6f8fbe4f8ba3d5a6202c0645c8; no voters:
I20260809 05:34:05.885063 28867 leader_election.cc:288] T 00000000000000000000000000000000 P d94a9f6f8fbe4f8ba3d5a6202c0645c8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:34:05.885208 28882 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d94a9f6f8fbe4f8ba3d5a6202c0645c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:34:05.887373 28882 raft_consensus.cc:686] T 00000000000000000000000000000000 P d94a9f6f8fbe4f8ba3d5a6202c0645c8 [term 1 LEADER]: Becoming Leader. State: Replica: d94a9f6f8fbe4f8ba3d5a6202c0645c8, State: Running, Role: LEADER
I20260809 05:34:05.888298 28882 consensus_queue.cc:237] T 00000000000000000000000000000000 P d94a9f6f8fbe4f8ba3d5a6202c0645c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d94a9f6f8fbe4f8ba3d5a6202c0645c8" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42237 } }
I20260809 05:34:05.888644 28867 sys_catalog.cc:564] T 00000000000000000000000000000000 P d94a9f6f8fbe4f8ba3d5a6202c0645c8 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:34:05.895692 28872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:05.877206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54333 (local address 127.26.185.62:42237)
0809 05:34:05.877438 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:05.877444 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:05.878078 (+ 634us) server_negotiation.cc:407] Connection header received
0809 05:34:05.878265 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:05.878271 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:05.878391 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:05.878540 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:05.880560 (+ 2020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:05.881501 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:05.882900 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:05.883481 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:05.883639 (+ 158us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:05.887437 (+ 3798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:05.887446 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:05.887451 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:05.887503 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:05.891667 (+ 4164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:05.892726 (+ 1059us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:05.892734 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:05.892741 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:05.893026 (+ 285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:05.893753 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:05.893757 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:05.893759 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:05.894277 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:05.894660 (+ 383us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:05.895112 (+ 452us) server_negotiation.cc:299] Negotiation successful
0809 05:34:05.895328 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 05:34:05.900561 28887 sys_catalog.cc:455] T 00000000000000000000000000000000 P d94a9f6f8fbe4f8ba3d5a6202c0645c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d94a9f6f8fbe4f8ba3d5a6202c0645c8. Latest consensus state: current_term: 1 leader_uuid: "d94a9f6f8fbe4f8ba3d5a6202c0645c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d94a9f6f8fbe4f8ba3d5a6202c0645c8" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42237 } } }
I20260809 05:34:05.901116 28887 sys_catalog.cc:458] T 00000000000000000000000000000000 P d94a9f6f8fbe4f8ba3d5a6202c0645c8 [sys.catalog]: This master's current role is: LEADER
I20260809 05:34:05.901861 28885 sys_catalog.cc:455] T 00000000000000000000000000000000 P d94a9f6f8fbe4f8ba3d5a6202c0645c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d94a9f6f8fbe4f8ba3d5a6202c0645c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d94a9f6f8fbe4f8ba3d5a6202c0645c8" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 42237 } } }
I20260809 05:34:05.902266 28885 sys_catalog.cc:458] T 00000000000000000000000000000000 P d94a9f6f8fbe4f8ba3d5a6202c0645c8 [sys.catalog]: This master's current role is: LEADER
I20260809 05:34:05.907105 28898 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:34:05.913041 28898 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:34:05.926595 28898 catalog_manager.cc:1347] Generated new cluster ID: ac5d7270b3764c158d706a5f61217e6d
I20260809 05:34:05.926776 28898 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:34:05.949296 28898 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:34:05.951114 28898 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:34:05.963315 28898 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d94a9f6f8fbe4f8ba3d5a6202c0645c8: Generated new TSK 0
I20260809 05:34:05.964846 28898 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 05:34:05.975283 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 28759
I20260809 05:34:05.977344 28851 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:34:06.086079 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 28759
W20260809 05:34:06.121240 28733 connection.cc:535] client connection to 127.26.185.62:42237 recv error: Network error: failed to read from TLS socket (remote: 127.26.185.62:42237): Connection reset by peer (error 104)
2026-08-09T05:34:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2778 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:34:06 dist-test-slave-h3ft krb5kdc[28914](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:34:06 dist-test-slave-h3ft krb5kdc[28914](info): set up 2 sockets
Aug 09 05:34:06 dist-test-slave-h3ft krb5kdc[28914](info): commencing operation
krb5kdc: starting...
W20260809 05:34:07.554478 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.412s user 0.000s sys 0.072s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:34:07 dist-test-slave-h3ft krb5kdc[28914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253647, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:34:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:34:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
I20260809 05:34:08.000254 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:35689
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:40165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:35689
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:34:08.440549 28933 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:34:08.441035 28933 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:34:08.441157 28933 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:34:08.449302 28933 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:34:08.449460 28933 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:34:08.449534 28933 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:34:08.449632 28933 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:34:08.449681 28933 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:34:08.461154 28933 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:40165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:35689
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:35689
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:34:08.462973 28933 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:34:08.464846 28933 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:34:08.479692 28942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:34:08.479763 28945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:34:08.479665 28943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:34:08.481048 28933 server_base.cc:1034] running on GCE node
I20260809 05:34:08.482259 28933 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:34:08.484203 28933 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:34:08.485466 28933 hybrid_clock.cc:648] HybridClock initialized: now 1786253648485403 us; error 37 us; skew 500 ppm
I20260809 05:34:08.486083 28933 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:34:08 dist-test-slave-h3ft krb5kdc[28914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253648, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:34:08.490415 28933 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:34:08.492341 28933 webserver.cc:460] Webserver started at http://127.26.185.62:33319/ using document root <none> and password file <none>
I20260809 05:34:08.493281 28933 fs_manager.cc:359] Metadata directory not provided
I20260809 05:34:08.493404 28933 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:34:08.493719 28933 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:34:08.497493 28933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "137ced3d0cbb4d1ab096c5ffdc2ab416"
format_stamp: "Formatted at 2026-08-09 05:34:08 on dist-test-slave-h3ft"
server_key: "1e2bc3aeb59c04b307dadc9b96779c10"
server_key_iv: "21b3fad640a82460ad435559f978a002"
server_key_version: "encryptionkey@0"
I20260809 05:34:08.498338 28933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "137ced3d0cbb4d1ab096c5ffdc2ab416"
format_stamp: "Formatted at 2026-08-09 05:34:08 on dist-test-slave-h3ft"
server_key: "1e2bc3aeb59c04b307dadc9b96779c10"
server_key_iv: "21b3fad640a82460ad435559f978a002"
server_key_version: "encryptionkey@0"
I20260809 05:34:08.504942 28933 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.002s
I20260809 05:34:08.509117 28961 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:34:08.510782 28933 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 05:34:08.510993 28933 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "137ced3d0cbb4d1ab096c5ffdc2ab416"
format_stamp: "Formatted at 2026-08-09 05:34:08 on dist-test-slave-h3ft"
server_key: "1e2bc3aeb59c04b307dadc9b96779c10"
server_key_iv: "21b3fad640a82460ad435559f978a002"
server_key_version: "encryptionkey@0"
I20260809 05:34:08.511302 28933 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:34:08.536091 28933 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:34:08.541666 28933 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:34:08.542062 28933 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:34:08.565843 28933 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:35689
I20260809 05:34:08.565878 29043 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:35689 every 8 connection(s)
I20260809 05:34:08.567776 28933 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:34:08.572952 29044 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:34:08.577991 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 28933
I20260809 05:34:08.578236 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:34:08.578811 27364 external_mini_cluster.cc:1428] Setting key 3401e9849fb62e992df0f6b1bc5db63a
I20260809 05:34:08.590433 29044 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 137ced3d0cbb4d1ab096c5ffdc2ab416: Bootstrap starting.
I20260809 05:34:08.595696 29044 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 137ced3d0cbb4d1ab096c5ffdc2ab416: Neither blocks nor log segments found. Creating new log.
I20260809 05:34:08.597194 29048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:08.581435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59503 (local address 127.26.185.62:35689)
0809 05:34:08.582497 (+ 1062us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:08.582520 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:08.582591 (+ 71us) server_negotiation.cc:407] Connection header received
0809 05:34:08.584842 (+ 2251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:08.584891 (+ 49us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:08.585663 (+ 772us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:08.586252 (+ 589us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:08.586943 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:08.589174 (+ 2231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:08.590799 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:08.591985 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:08.592208 (+ 223us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:08.593639 (+ 1431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:08.593655 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:08.593679 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:34:08.594575 (+ 896us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:08.594696 (+ 121us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:34:08.594742 (+ 46us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:08.594910 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:08.595221 (+ 311us) server_negotiation.cc:299] Negotiation successful
0809 05:34:08.595452 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":761,"thread_start_us":452,"threads_started":1}
I20260809 05:34:08.597478 29044 log.cc:824] T 00000000000000000000000000000000 P 137ced3d0cbb4d1ab096c5ffdc2ab416: Log is configured to *not* fsync() on all Append() calls
I20260809 05:34:08.602032 29044 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 137ced3d0cbb4d1ab096c5ffdc2ab416: No bootstrap required, opened a new log
I20260809 05:34:08.603300 27364 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 05:34:08.612928 29044 raft_consensus.cc:348] T 00000000000000000000000000000000 P 137ced3d0cbb4d1ab096c5ffdc2ab416 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "137ced3d0cbb4d1ab096c5ffdc2ab416" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 35689 } }
I20260809 05:34:08.613667 29044 raft_consensus.cc:374] T 00000000000000000000000000000000 P 137ced3d0cbb4d1ab096c5ffdc2ab416 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:34:08.613826 29044 raft_consensus.cc:729] T 00000000000000000000000000000000 P 137ced3d0cbb4d1ab096c5ffdc2ab416 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 137ced3d0cbb4d1ab096c5ffdc2ab416, State: Initialized, Role: FOLLOWER
I20260809 05:34:08.614770 29044 consensus_queue.cc:260] T 00000000000000000000000000000000 P 137ced3d0cbb4d1ab096c5ffdc2ab416 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "137ced3d0cbb4d1ab096c5ffdc2ab416" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 35689 } }
I20260809 05:34:08.615187 29044 raft_consensus.cc:388] T 00000000000000000000000000000000 P 137ced3d0cbb4d1ab096c5ffdc2ab416 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:34:08.615383 29044 raft_consensus.cc:482] T 00000000000000000000000000000000 P 137ced3d0cbb4d1ab096c5ffdc2ab416 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:34:08.615618 29044 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 137ced3d0cbb4d1ab096c5ffdc2ab416 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:34:08.617336 29048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:08.608809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44309 (local address 127.26.185.62:35689)
0809 05:34:08.609116 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:08.609132 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:08.609650 (+ 518us) server_negotiation.cc:407] Connection header received
0809 05:34:08.609898 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:08.609904 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:08.610013 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:08.610116 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:08.610898 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:08.611838 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:08.613898 (+ 2060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:08.614554 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:08.614671 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:08.616303 (+ 1632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:08.616312 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:08.616318 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:34:08.616345 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:08.616454 (+ 109us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:34:08.616483 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:08.616622 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:08.616839 (+ 217us) server_negotiation.cc:299] Negotiation successful
0809 05:34:08.616903 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260809 05:34:08.619407 29044 raft_consensus.cc:504] T 00000000000000000000000000000000 P 137ced3d0cbb4d1ab096c5ffdc2ab416 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "137ced3d0cbb4d1ab096c5ffdc2ab416" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 35689 } }
I20260809 05:34:08.620092 29044 leader_election.cc:302] T 00000000000000000000000000000000 P 137ced3d0cbb4d1ab096c5ffdc2ab416 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 137ced3d0cbb4d1ab096c5ffdc2ab416; no voters:
I20260809 05:34:08.620918 29044 leader_election.cc:288] T 00000000000000000000000000000000 P 137ced3d0cbb4d1ab096c5ffdc2ab416 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:34:08.621062 29066 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 137ced3d0cbb4d1ab096c5ffdc2ab416 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:34:08.622593 29066 raft_consensus.cc:686] T 00000000000000000000000000000000 P 137ced3d0cbb4d1ab096c5ffdc2ab416 [term 1 LEADER]: Becoming Leader. State: Replica: 137ced3d0cbb4d1ab096c5ffdc2ab416, State: Running, Role: LEADER
I20260809 05:34:08.623343 29066 consensus_queue.cc:237] T 00000000000000000000000000000000 P 137ced3d0cbb4d1ab096c5ffdc2ab416 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "137ced3d0cbb4d1ab096c5ffdc2ab416" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 35689 } }
I20260809 05:34:08.624233 29044 sys_catalog.cc:564] T 00000000000000000000000000000000 P 137ced3d0cbb4d1ab096c5ffdc2ab416 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:34:08.627089 29068 sys_catalog.cc:455] T 00000000000000000000000000000000 P 137ced3d0cbb4d1ab096c5ffdc2ab416 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "137ced3d0cbb4d1ab096c5ffdc2ab416" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "137ced3d0cbb4d1ab096c5ffdc2ab416" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 35689 } } }
I20260809 05:34:08.627521 29068 sys_catalog.cc:458] T 00000000000000000000000000000000 P 137ced3d0cbb4d1ab096c5ffdc2ab416 [sys.catalog]: This master's current role is: LEADER
I20260809 05:34:08.631794 29073 sys_catalog.cc:455] T 00000000000000000000000000000000 P 137ced3d0cbb4d1ab096c5ffdc2ab416 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 137ced3d0cbb4d1ab096c5ffdc2ab416. Latest consensus state: current_term: 1 leader_uuid: "137ced3d0cbb4d1ab096c5ffdc2ab416" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "137ced3d0cbb4d1ab096c5ffdc2ab416" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 35689 } } }
I20260809 05:34:08.632339 29073 sys_catalog.cc:458] T 00000000000000000000000000000000 P 137ced3d0cbb4d1ab096c5ffdc2ab416 [sys.catalog]: This master's current role is: LEADER
I20260809 05:34:08.633217 29077 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:34:08.640534 29077 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:34:08.653324 29077 catalog_manager.cc:1347] Generated new cluster ID: 23c9d282a26e4e1d88b28beb061c262d
I20260809 05:34:08.653514 29077 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:34:08.699582 29077 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:34:08.701287 29077 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:34:08.710772 29077 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 137ced3d0cbb4d1ab096c5ffdc2ab416: Generated new TSK 0
I20260809 05:34:08.712121 29077 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 05:34:08.728557 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 28933
W20260809 05:34:08.730374 29039 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:59503
W20260809 05:34:08.731384 27364 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 28933: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 05:34:08.731582 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 28933
W20260809 05:34:08.776752 28912 connection.cc:535] client connection to 127.26.185.62:35689 recv error: Network error: failed to read from TLS socket (remote: 127.26.185.62:35689): Connection reset by peer (error 104)
2026-08-09T05:34:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2658 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:34:08 dist-test-slave-h3ft krb5kdc[29103](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:34:08 dist-test-slave-h3ft krb5kdc[29103](info): set up 2 sockets
Aug 09 05:34:08 dist-test-slave-h3ft krb5kdc[29103](info): commencing operation
krb5kdc: starting...
W20260809 05:34:10.198352 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.396s user 0.006s sys 0.071s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:34:10 dist-test-slave-h3ft krb5kdc[29103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253650, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:34:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:34:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
I20260809 05:34:10.639487 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:34617
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:38197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:34617
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:34:11.094342 29119 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:34:11.094875 29119 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:34:11.095095 29119 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:34:11.103619 29119 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:34:11.103889 29119 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:34:11.104018 29119 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:34:11.104151 29119 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:34:11.104244 29119 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:34:11.116788 29119 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:38197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:34617
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:34617
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:34:11.118804 29119 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:34:11.120669 29119 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:34:11.136667 29133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:34:11.136828 29128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:34:11.136828 29126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:34:11.137887 29119 server_base.cc:1034] running on GCE node
I20260809 05:34:11.139274 29119 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:34:11.141376 29119 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:34:11.142681 29119 hybrid_clock.cc:648] HybridClock initialized: now 1786253651142606 us; error 63 us; skew 500 ppm
I20260809 05:34:11.143252 29119 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:34:11 dist-test-slave-h3ft krb5kdc[29103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253651, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:34:11.152436 29119 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:34:11.154541 29119 webserver.cc:460] Webserver started at http://127.26.185.62:34015/ using document root <none> and password file <none>
I20260809 05:34:11.155604 29119 fs_manager.cc:359] Metadata directory not provided
I20260809 05:34:11.155784 29119 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:34:11.156193 29119 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:34:11.160277 29119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "f4eeab3693df4ab9a90382d757e23511"
format_stamp: "Formatted at 2026-08-09 05:34:11 on dist-test-slave-h3ft"
server_key: "17bc42351101fb21b98bb2cbfc2e9dae"
server_key_iv: "3f480119f6223af13b59680a10fc8466"
server_key_version: "encryptionkey@0"
I20260809 05:34:11.161268 29119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "f4eeab3693df4ab9a90382d757e23511"
format_stamp: "Formatted at 2026-08-09 05:34:11 on dist-test-slave-h3ft"
server_key: "17bc42351101fb21b98bb2cbfc2e9dae"
server_key_iv: "3f480119f6223af13b59680a10fc8466"
server_key_version: "encryptionkey@0"
I20260809 05:34:11.167904 29119 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260809 05:34:11.172371 29143 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:34:11.174228 29119 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.002s
I20260809 05:34:11.174479 29119 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "f4eeab3693df4ab9a90382d757e23511"
format_stamp: "Formatted at 2026-08-09 05:34:11 on dist-test-slave-h3ft"
server_key: "17bc42351101fb21b98bb2cbfc2e9dae"
server_key_iv: "3f480119f6223af13b59680a10fc8466"
server_key_version: "encryptionkey@0"
I20260809 05:34:11.174744 29119 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:34:11.181891 29119 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:34:11.187189 29119 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:34:11.187603 29119 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:34:11.210798 29119 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:34617
I20260809 05:34:11.210868 29227 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:34617 every 8 connection(s)
I20260809 05:34:11.212811 29119 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:34:11.218282 29228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:34:11.218683 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 29119
I20260809 05:34:11.218910 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:34:11.219683 27364 external_mini_cluster.cc:1428] Setting key 3d96681f3b2bd10b93a198e1d604b784
I20260809 05:34:11.230894 29232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:11.222129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44615 (local address 127.26.185.62:34617)
0809 05:34:11.223347 (+ 1218us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:11.223363 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:11.223429 (+ 66us) server_negotiation.cc:407] Connection header received
0809 05:34:11.226207 (+ 2778us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:11.226243 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:11.226769 (+ 526us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:11.227376 (+ 607us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:11.228762 (+ 1386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:11.228771 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:11.228788 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:34:11.228805 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:11.228944 (+ 139us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:34:11.228973 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:11.229206 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:11.229323 (+ 117us) server_negotiation.cc:299] Negotiation successful
0809 05:34:11.229615 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":911,"thread_start_us":560,"threads_started":1}
I20260809 05:34:11.235545 29228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4eeab3693df4ab9a90382d757e23511: Bootstrap starting.
I20260809 05:34:11.236121 27364 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 05:34:11.241109 29228 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f4eeab3693df4ab9a90382d757e23511: Neither blocks nor log segments found. Creating new log.
I20260809 05:34:11.243278 29228 log.cc:824] T 00000000000000000000000000000000 P f4eeab3693df4ab9a90382d757e23511: Log is configured to *not* fsync() on all Append() calls
I20260809 05:34:11.246780 29232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:11.243341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37287 (local address 127.26.185.62:34617)
0809 05:34:11.243605 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:11.243613 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:11.244240 (+ 627us) server_negotiation.cc:407] Connection header received
0809 05:34:11.244515 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:11.244520 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:11.244580 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:11.244721 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:11.246000 (+ 1279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:11.246005 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:11.246009 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:34:11.246028 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:11.246085 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:34:11.246104 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:11.246251 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:11.246377 (+ 126us) server_negotiation.cc:299] Negotiation successful
0809 05:34:11.246460 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260809 05:34:11.247705 29228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4eeab3693df4ab9a90382d757e23511: No bootstrap required, opened a new log
I20260809 05:34:11.257117 29228 raft_consensus.cc:348] T 00000000000000000000000000000000 P f4eeab3693df4ab9a90382d757e23511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4eeab3693df4ab9a90382d757e23511" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 34617 } }
I20260809 05:34:11.257668 29228 raft_consensus.cc:374] T 00000000000000000000000000000000 P f4eeab3693df4ab9a90382d757e23511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:34:11.257795 29228 raft_consensus.cc:729] T 00000000000000000000000000000000 P f4eeab3693df4ab9a90382d757e23511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4eeab3693df4ab9a90382d757e23511, State: Initialized, Role: FOLLOWER
I20260809 05:34:11.258656 29228 consensus_queue.cc:260] T 00000000000000000000000000000000 P f4eeab3693df4ab9a90382d757e23511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4eeab3693df4ab9a90382d757e23511" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 34617 } }
I20260809 05:34:11.259090 29228 raft_consensus.cc:388] T 00000000000000000000000000000000 P f4eeab3693df4ab9a90382d757e23511 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:34:11.259299 29228 raft_consensus.cc:482] T 00000000000000000000000000000000 P f4eeab3693df4ab9a90382d757e23511 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:34:11.259547 29228 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f4eeab3693df4ab9a90382d757e23511 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:34:11.262153 29228 raft_consensus.cc:504] T 00000000000000000000000000000000 P f4eeab3693df4ab9a90382d757e23511 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4eeab3693df4ab9a90382d757e23511" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 34617 } }
I20260809 05:34:11.262780 29228 leader_election.cc:302] T 00000000000000000000000000000000 P f4eeab3693df4ab9a90382d757e23511 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f4eeab3693df4ab9a90382d757e23511; no voters:
I20260809 05:34:11.263579 29228 leader_election.cc:288] T 00000000000000000000000000000000 P f4eeab3693df4ab9a90382d757e23511 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:34:11.263732 29248 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f4eeab3693df4ab9a90382d757e23511 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:34:11.264711 29248 raft_consensus.cc:686] T 00000000000000000000000000000000 P f4eeab3693df4ab9a90382d757e23511 [term 1 LEADER]: Becoming Leader. State: Replica: f4eeab3693df4ab9a90382d757e23511, State: Running, Role: LEADER
I20260809 05:34:11.265455 29248 consensus_queue.cc:237] T 00000000000000000000000000000000 P f4eeab3693df4ab9a90382d757e23511 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4eeab3693df4ab9a90382d757e23511" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 34617 } }
I20260809 05:34:11.266542 29228 sys_catalog.cc:564] T 00000000000000000000000000000000 P f4eeab3693df4ab9a90382d757e23511 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:34:11.269178 29250 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4eeab3693df4ab9a90382d757e23511 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f4eeab3693df4ab9a90382d757e23511" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4eeab3693df4ab9a90382d757e23511" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 34617 } } }
I20260809 05:34:11.269680 29250 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4eeab3693df4ab9a90382d757e23511 [sys.catalog]: This master's current role is: LEADER
I20260809 05:34:11.269140 29251 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4eeab3693df4ab9a90382d757e23511 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f4eeab3693df4ab9a90382d757e23511. Latest consensus state: current_term: 1 leader_uuid: "f4eeab3693df4ab9a90382d757e23511" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4eeab3693df4ab9a90382d757e23511" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 34617 } } }
I20260809 05:34:11.270123 29251 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4eeab3693df4ab9a90382d757e23511 [sys.catalog]: This master's current role is: LEADER
I20260809 05:34:11.270768 29257 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:34:11.280084 29257 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:34:11.291240 29257 catalog_manager.cc:1347] Generated new cluster ID: 0f6626513e5b40b0bab3568a29555775
I20260809 05:34:11.291399 29257 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:34:11.311697 29257 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:34:11.312323 29257 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:34:11.323482 29257 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f4eeab3693df4ab9a90382d757e23511: Generated new TSK 0
I20260809 05:34:11.324718 29257 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 05:34:11.333993 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 29119
W20260809 05:34:11.335574 29219 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:44615
W20260809 05:34:11.336572 27364 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 29119: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 05:34:11.336771 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 29119
2026-08-09T05:34:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2591 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:34:11 dist-test-slave-h3ft krb5kdc[29283](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:34:11 dist-test-slave-h3ft krb5kdc[29283](info): set up 2 sockets
Aug 09 05:34:11 dist-test-slave-h3ft krb5kdc[29283](info): commencing operation
krb5kdc: starting...
W20260809 05:34:12.850772 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.458s user 0.003s sys 0.066s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:34:13 dist-test-slave-h3ft krb5kdc[29283](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253653, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:34:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:34:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
I20260809 05:34:13.299258 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:38417
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:39661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:38417
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:34:13.730754 29307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:34:13.731285 29307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:34:13.731482 29307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:34:13.739805 29307 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:34:13.739967 29307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:34:13.740072 29307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:34:13.740198 29307 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:34:13.740264 29307 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:34:13.751959 29307 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:39661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:38417
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:38417
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:34:13.753908 29307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:34:13.755857 29307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:34:13.771466 29318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:34:13.771552 29323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:34:13.771458 29327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:34:13.772482 29307 server_base.cc:1034] running on GCE node
I20260809 05:34:13.773545 29307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:34:13.775499 29307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:34:13.776726 29307 hybrid_clock.cc:648] HybridClock initialized: now 1786253653776667 us; error 53 us; skew 500 ppm
I20260809 05:34:13.777333 29307 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:34:13 dist-test-slave-h3ft krb5kdc[29283](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253653, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:34:13.781467 29307 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:34:13.783825 29307 webserver.cc:460] Webserver started at http://127.26.185.62:44131/ using document root <none> and password file <none>
I20260809 05:34:13.784804 29307 fs_manager.cc:359] Metadata directory not provided
I20260809 05:34:13.784950 29307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:34:13.785336 29307 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:34:13.789610 29307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "93554cfbdc354f8cb4fd68e942a416fb"
format_stamp: "Formatted at 2026-08-09 05:34:13 on dist-test-slave-h3ft"
server_key: "4c698d3c4db290ac9964da91fa92f49a"
server_key_iv: "60d3b99107a05ba21a616fc99a9ce426"
server_key_version: "encryptionkey@0"
I20260809 05:34:13.790613 29307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "93554cfbdc354f8cb4fd68e942a416fb"
format_stamp: "Formatted at 2026-08-09 05:34:13 on dist-test-slave-h3ft"
server_key: "4c698d3c4db290ac9964da91fa92f49a"
server_key_iv: "60d3b99107a05ba21a616fc99a9ce426"
server_key_version: "encryptionkey@0"
I20260809 05:34:13.798453 29307 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.001s
I20260809 05:34:13.803215 29334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:34:13.805100 29307 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:34:13.805294 29307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "93554cfbdc354f8cb4fd68e942a416fb"
format_stamp: "Formatted at 2026-08-09 05:34:13 on dist-test-slave-h3ft"
server_key: "4c698d3c4db290ac9964da91fa92f49a"
server_key_iv: "60d3b99107a05ba21a616fc99a9ce426"
server_key_version: "encryptionkey@0"
I20260809 05:34:13.805508 29307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:34:13.824851 29307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:34:13.831380 29307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:34:13.831730 29307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:34:13.856560 29307 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:38417
I20260809 05:34:13.856595 29410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:38417 every 8 connection(s)
I20260809 05:34:13.858456 29307 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:34:13.864190 29414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:34:13.866016 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 29307
I20260809 05:34:13.866276 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:34:13.866993 27364 external_mini_cluster.cc:1428] Setting key 6643a7166798ba86b34ef0bbd0b8deb0
I20260809 05:34:13.882558 29414 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93554cfbdc354f8cb4fd68e942a416fb: Bootstrap starting.
Aug 09 05:34:13 dist-test-slave-h3ft krb5kdc[29283](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253653, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:34:13.887914 29414 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 93554cfbdc354f8cb4fd68e942a416fb: Neither blocks nor log segments found. Creating new log.
I20260809 05:34:13.889551 29414 log.cc:824] T 00000000000000000000000000000000 P 93554cfbdc354f8cb4fd68e942a416fb: Log is configured to *not* fsync() on all Append() calls
I20260809 05:34:13.894141 29414 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93554cfbdc354f8cb4fd68e942a416fb: No bootstrap required, opened a new log
I20260809 05:34:13.898061 29419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:13.869793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46527 (local address 127.26.185.62:38417)
0809 05:34:13.870978 (+ 1185us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:13.870995 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:13.871127 (+ 132us) server_negotiation.cc:407] Connection header received
0809 05:34:13.873055 (+ 1928us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:13.873090 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:13.873683 (+ 593us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:13.874129 (+ 446us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:13.876478 (+ 2349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:13.878238 (+ 1760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:13.880472 (+ 2234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:13.881484 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:13.881685 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:13.887871 (+ 6186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:13.887884 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:13.887911 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:13.887965 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:13.892576 (+ 4611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:13.893762 (+ 1186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:13.893771 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:13.893779 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:13.893983 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:13.894525 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:13.894530 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:13.894533 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:13.895266 (+ 733us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:13.895666 (+ 400us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:13.896162 (+ 496us) server_negotiation.cc:299] Negotiation successful
0809 05:34:13.896737 (+ 575us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":885,"thread_start_us":571,"threads_started":1}
I20260809 05:34:13.902794 27364 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 05:34:13.903754 29414 raft_consensus.cc:348] T 00000000000000000000000000000000 P 93554cfbdc354f8cb4fd68e942a416fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93554cfbdc354f8cb4fd68e942a416fb" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 38417 } }
I20260809 05:34:13.904217 29414 raft_consensus.cc:374] T 00000000000000000000000000000000 P 93554cfbdc354f8cb4fd68e942a416fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:34:13.904337 29414 raft_consensus.cc:729] T 00000000000000000000000000000000 P 93554cfbdc354f8cb4fd68e942a416fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93554cfbdc354f8cb4fd68e942a416fb, State: Initialized, Role: FOLLOWER
I20260809 05:34:13.905064 29414 consensus_queue.cc:260] T 00000000000000000000000000000000 P 93554cfbdc354f8cb4fd68e942a416fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93554cfbdc354f8cb4fd68e942a416fb" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 38417 } }
I20260809 05:34:13.905340 29414 raft_consensus.cc:388] T 00000000000000000000000000000000 P 93554cfbdc354f8cb4fd68e942a416fb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:34:13.905498 29414 raft_consensus.cc:482] T 00000000000000000000000000000000 P 93554cfbdc354f8cb4fd68e942a416fb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:34:13.905702 29414 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 93554cfbdc354f8cb4fd68e942a416fb [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:34:13.909246 29414 raft_consensus.cc:504] T 00000000000000000000000000000000 P 93554cfbdc354f8cb4fd68e942a416fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93554cfbdc354f8cb4fd68e942a416fb" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 38417 } }
I20260809 05:34:13.909974 29414 leader_election.cc:302] T 00000000000000000000000000000000 P 93554cfbdc354f8cb4fd68e942a416fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 93554cfbdc354f8cb4fd68e942a416fb; no voters:
I20260809 05:34:13.910729 29414 leader_election.cc:288] T 00000000000000000000000000000000 P 93554cfbdc354f8cb4fd68e942a416fb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:34:13.910848 29429 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 93554cfbdc354f8cb4fd68e942a416fb [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:34:13.912338 29429 raft_consensus.cc:686] T 00000000000000000000000000000000 P 93554cfbdc354f8cb4fd68e942a416fb [term 1 LEADER]: Becoming Leader. State: Replica: 93554cfbdc354f8cb4fd68e942a416fb, State: Running, Role: LEADER
I20260809 05:34:13.913141 29429 consensus_queue.cc:237] T 00000000000000000000000000000000 P 93554cfbdc354f8cb4fd68e942a416fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93554cfbdc354f8cb4fd68e942a416fb" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 38417 } }
I20260809 05:34:13.913887 29414 sys_catalog.cc:564] T 00000000000000000000000000000000 P 93554cfbdc354f8cb4fd68e942a416fb [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:34:13.918767 29431 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93554cfbdc354f8cb4fd68e942a416fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 93554cfbdc354f8cb4fd68e942a416fb. Latest consensus state: current_term: 1 leader_uuid: "93554cfbdc354f8cb4fd68e942a416fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93554cfbdc354f8cb4fd68e942a416fb" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 38417 } } }
I20260809 05:34:13.919418 29431 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93554cfbdc354f8cb4fd68e942a416fb [sys.catalog]: This master's current role is: LEADER
I20260809 05:34:13.918785 29430 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93554cfbdc354f8cb4fd68e942a416fb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "93554cfbdc354f8cb4fd68e942a416fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93554cfbdc354f8cb4fd68e942a416fb" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 38417 } } }
I20260809 05:34:13.920670 29430 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93554cfbdc354f8cb4fd68e942a416fb [sys.catalog]: This master's current role is: LEADER
I20260809 05:34:13.927429 29440 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:34:13.931269 29419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:13.908270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60187 (local address 127.26.185.62:38417)
0809 05:34:13.908550 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:13.908561 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:13.909023 (+ 462us) server_negotiation.cc:407] Connection header received
0809 05:34:13.909276 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:13.909282 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:13.909366 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:13.909502 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:13.912046 (+ 2544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:13.913241 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:13.914842 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:13.916462 (+ 1620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:13.916622 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:13.921155 (+ 4533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:13.921166 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:13.921174 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:13.921238 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:13.926182 (+ 4944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:13.927471 (+ 1289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:13.927477 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:13.927481 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:13.927669 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:13.928279 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:13.928286 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:13.928289 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:13.929042 (+ 753us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:13.929471 (+ 429us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:13.930252 (+ 781us) server_negotiation.cc:299] Negotiation successful
0809 05:34:13.930567 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 05:34:13.935874 29440 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:34:13.948781 29440 catalog_manager.cc:1347] Generated new cluster ID: ad032785427341debb7acc772aa233e8
I20260809 05:34:13.948971 29440 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:34:13.970189 29440 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:34:13.971953 29440 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:34:13.983676 29440 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 93554cfbdc354f8cb4fd68e942a416fb: Generated new TSK 0
I20260809 05:34:13.984834 29440 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 05:34:13.991798 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 29307
I20260809 05:34:13.993633 29403 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:34:14.098749 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 29307
2026-08-09T05:34:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2760 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:34:14 dist-test-slave-h3ft krb5kdc[29467](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:34:14 dist-test-slave-h3ft krb5kdc[29467](info): set up 2 sockets
Aug 09 05:34:14 dist-test-slave-h3ft krb5kdc[29467](info): commencing operation
krb5kdc: starting...
W20260809 05:34:15.535403 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.382s user 0.000s sys 0.071s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:34:15 dist-test-slave-h3ft krb5kdc[29467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253655, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:34:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:34:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
I20260809 05:34:15.995885 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:43083
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:36269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:43083
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:34:16.433013 29488 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:34:16.433422 29488 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:34:16.433606 29488 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:34:16.441538 29488 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:34:16.441679 29488 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:34:16.441771 29488 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:34:16.441884 29488 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:34:16.441977 29488 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:34:16.453095 29488 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:36269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:43083
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:43083
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:34:16.455179 29488 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:34:16.456926 29488 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:34:16.471632 29495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:34:16.471678 29494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:34:16.471593 29497 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:34:16.472801 29488 server_base.cc:1034] running on GCE node
I20260809 05:34:16.473980 29488 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:34:16.475934 29488 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:34:16.477203 29488 hybrid_clock.cc:648] HybridClock initialized: now 1786253656477149 us; error 47 us; skew 500 ppm
I20260809 05:34:16.477651 29488 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:34:16 dist-test-slave-h3ft krb5kdc[29467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253656, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:34:16.485809 29488 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:34:16.487972 29488 webserver.cc:460] Webserver started at http://127.26.185.62:39085/ using document root <none> and password file <none>
I20260809 05:34:16.488924 29488 fs_manager.cc:359] Metadata directory not provided
I20260809 05:34:16.489094 29488 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:34:16.489480 29488 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:34:16.493386 29488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "2efa55b212fd41c1a2731479ae8a34b2"
format_stamp: "Formatted at 2026-08-09 05:34:16 on dist-test-slave-h3ft"
server_key: "b683a00b3cfb0d6eac87dc907b66cbd4"
server_key_iv: "2382a5e7758225cc32a04b746c0d59c5"
server_key_version: "encryptionkey@0"
I20260809 05:34:16.494359 29488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "2efa55b212fd41c1a2731479ae8a34b2"
format_stamp: "Formatted at 2026-08-09 05:34:16 on dist-test-slave-h3ft"
server_key: "b683a00b3cfb0d6eac87dc907b66cbd4"
server_key_iv: "2382a5e7758225cc32a04b746c0d59c5"
server_key_version: "encryptionkey@0"
I20260809 05:34:16.501287 29488 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260809 05:34:16.505786 29509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:34:16.507727 29488 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260809 05:34:16.507988 29488 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "2efa55b212fd41c1a2731479ae8a34b2"
format_stamp: "Formatted at 2026-08-09 05:34:16 on dist-test-slave-h3ft"
server_key: "b683a00b3cfb0d6eac87dc907b66cbd4"
server_key_iv: "2382a5e7758225cc32a04b746c0d59c5"
server_key_version: "encryptionkey@0"
I20260809 05:34:16.508253 29488 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:34:16.529175 29488 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:34:16.534375 29488 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:34:16.534744 29488 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:34:16.558286 29488 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:43083
I20260809 05:34:16.558302 29599 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:43083 every 8 connection(s)
I20260809 05:34:16.560125 29488 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:34:16.562992 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 29488
I20260809 05:34:16.563257 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:34:16.563831 27364 external_mini_cluster.cc:1428] Setting key 9ca98a2116d1274486adf6ba514ce1fe
I20260809 05:34:16.565547 29600 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:34:16.582988 29605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:16.566253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41163 (local address 127.26.185.62:43083)
0809 05:34:16.567249 (+ 996us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:16.567266 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:16.567331 (+ 65us) server_negotiation.cc:407] Connection header received
0809 05:34:16.569770 (+ 2439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:16.569823 (+ 53us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:16.570723 (+ 900us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:16.571412 (+ 689us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:16.572154 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:16.574532 (+ 2378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:16.576294 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:16.577463 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:16.577670 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:16.579219 (+ 1549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:16.579233 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:16.579266 (+ 33us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:34:16.580260 (+ 994us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:16.580392 (+ 132us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:34:16.580428 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:16.580580 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:16.580853 (+ 273us) server_negotiation.cc:299] Negotiation successful
0809 05:34:16.581255 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":693,"thread_start_us":401,"threads_started":1}
I20260809 05:34:16.584209 29600 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2efa55b212fd41c1a2731479ae8a34b2: Bootstrap starting.
I20260809 05:34:16.587920 27364 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 05:34:16.588533 29600 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2efa55b212fd41c1a2731479ae8a34b2: Neither blocks nor log segments found. Creating new log.
I20260809 05:34:16.590252 29600 log.cc:824] T 00000000000000000000000000000000 P 2efa55b212fd41c1a2731479ae8a34b2: Log is configured to *not* fsync() on all Append() calls
I20260809 05:34:16.594039 29600 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2efa55b212fd41c1a2731479ae8a34b2: No bootstrap required, opened a new log
I20260809 05:34:16.602913 29605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:16.594509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35479 (local address 127.26.185.62:43083)
0809 05:34:16.594800 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:16.594811 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:16.595368 (+ 557us) server_negotiation.cc:407] Connection header received
0809 05:34:16.595614 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:16.595619 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:16.595694 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:16.595789 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:16.596662 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:16.597529 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:16.599632 (+ 2103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:16.600215 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:16.600337 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:16.601918 (+ 1581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:16.601924 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:16.601928 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:34:16.601956 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:16.602006 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:34:16.602025 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:16.602123 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:16.602293 (+ 170us) server_negotiation.cc:299] Negotiation successful
0809 05:34:16.602422 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 05:34:16.605746 29600 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2efa55b212fd41c1a2731479ae8a34b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2efa55b212fd41c1a2731479ae8a34b2" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43083 } }
I20260809 05:34:16.606393 29600 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2efa55b212fd41c1a2731479ae8a34b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:34:16.606537 29600 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2efa55b212fd41c1a2731479ae8a34b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2efa55b212fd41c1a2731479ae8a34b2, State: Initialized, Role: FOLLOWER
I20260809 05:34:16.607378 29600 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2efa55b212fd41c1a2731479ae8a34b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2efa55b212fd41c1a2731479ae8a34b2" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43083 } }
I20260809 05:34:16.607684 29600 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2efa55b212fd41c1a2731479ae8a34b2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:34:16.607853 29600 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2efa55b212fd41c1a2731479ae8a34b2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:34:16.608063 29600 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2efa55b212fd41c1a2731479ae8a34b2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:34:16.610868 29600 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2efa55b212fd41c1a2731479ae8a34b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2efa55b212fd41c1a2731479ae8a34b2" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43083 } }
I20260809 05:34:16.611584 29600 leader_election.cc:302] T 00000000000000000000000000000000 P 2efa55b212fd41c1a2731479ae8a34b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2efa55b212fd41c1a2731479ae8a34b2; no voters:
I20260809 05:34:16.612303 29600 leader_election.cc:288] T 00000000000000000000000000000000 P 2efa55b212fd41c1a2731479ae8a34b2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:34:16.612502 29623 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2efa55b212fd41c1a2731479ae8a34b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:34:16.614064 29623 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2efa55b212fd41c1a2731479ae8a34b2 [term 1 LEADER]: Becoming Leader. State: Replica: 2efa55b212fd41c1a2731479ae8a34b2, State: Running, Role: LEADER
I20260809 05:34:16.614907 29623 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2efa55b212fd41c1a2731479ae8a34b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2efa55b212fd41c1a2731479ae8a34b2" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43083 } }
I20260809 05:34:16.615304 29600 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2efa55b212fd41c1a2731479ae8a34b2 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:34:16.618803 29628 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2efa55b212fd41c1a2731479ae8a34b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2efa55b212fd41c1a2731479ae8a34b2. Latest consensus state: current_term: 1 leader_uuid: "2efa55b212fd41c1a2731479ae8a34b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2efa55b212fd41c1a2731479ae8a34b2" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43083 } } }
I20260809 05:34:16.619313 29628 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2efa55b212fd41c1a2731479ae8a34b2 [sys.catalog]: This master's current role is: LEADER
I20260809 05:34:16.619738 29626 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2efa55b212fd41c1a2731479ae8a34b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2efa55b212fd41c1a2731479ae8a34b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2efa55b212fd41c1a2731479ae8a34b2" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43083 } } }
I20260809 05:34:16.620196 29626 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2efa55b212fd41c1a2731479ae8a34b2 [sys.catalog]: This master's current role is: LEADER
I20260809 05:34:16.623085 29639 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:34:16.628481 29639 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:34:16.638852 29639 catalog_manager.cc:1347] Generated new cluster ID: 8bcb7ff8899b4e86816985311eb606a5
I20260809 05:34:16.639050 29639 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:34:16.656572 29639 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:34:16.658445 29639 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:34:16.668488 29639 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2efa55b212fd41c1a2731479ae8a34b2: Generated new TSK 0
I20260809 05:34:16.670022 29639 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 05:34:16.688218 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 29488
W20260809 05:34:16.690332 29591 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:41163
W20260809 05:34:16.691331 27364 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 29488: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 05:34:16.691535 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 29488
2026-08-09T05:34:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2596 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:34:16 dist-test-slave-h3ft krb5kdc[29657](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:34:16 dist-test-slave-h3ft krb5kdc[29657](info): set up 2 sockets
Aug 09 05:34:16 dist-test-slave-h3ft krb5kdc[29657](info): commencing operation
krb5kdc: starting...
W20260809 05:34:18.157227 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.407s user 0.006s sys 0.064s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:34:18 dist-test-slave-h3ft krb5kdc[29657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253658, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:34:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:34:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
I20260809 05:34:18.612187 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:35605
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:41647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:35605
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:34:19.086627 29673 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:34:19.087110 29673 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:34:19.087306 29673 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:34:19.095718 29673 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:34:19.095896 29673 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:34:19.095950 29673 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:34:19.096062 29673 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:34:19.096136 29673 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:34:19.110021 29673 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:41647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:35605
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:35605
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:34:19.112107 29673 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:34:19.113884 29673 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:34:19.128993 29683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:34:19.128916 29681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:34:19.129040 29680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:34:19.130055 29673 server_base.cc:1034] running on GCE node
I20260809 05:34:19.131255 29673 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:34:19.133265 29673 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:34:19.134549 29673 hybrid_clock.cc:648] HybridClock initialized: now 1786253659134494 us; error 47 us; skew 500 ppm
I20260809 05:34:19.135131 29673 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:34:19 dist-test-slave-h3ft krb5kdc[29657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253659, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:34:19.139323 29673 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:34:19.141327 29673 webserver.cc:460] Webserver started at http://127.26.185.62:41515/ using document root <none> and password file <none>
I20260809 05:34:19.142254 29673 fs_manager.cc:359] Metadata directory not provided
I20260809 05:34:19.142424 29673 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:34:19.142812 29673 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:34:19.147054 29673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "ba1ee1916d104effb504563bee76ff04"
format_stamp: "Formatted at 2026-08-09 05:34:19 on dist-test-slave-h3ft"
server_key: "0c4b25dcfc8322f6b4810bc9b02fa4a6"
server_key_iv: "d10d14e7fbe8201d30555319e657486a"
server_key_version: "encryptionkey@0"
I20260809 05:34:19.148150 29673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "ba1ee1916d104effb504563bee76ff04"
format_stamp: "Formatted at 2026-08-09 05:34:19 on dist-test-slave-h3ft"
server_key: "0c4b25dcfc8322f6b4810bc9b02fa4a6"
server_key_iv: "d10d14e7fbe8201d30555319e657486a"
server_key_version: "encryptionkey@0"
I20260809 05:34:19.155874 29673 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260809 05:34:19.160701 29691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:34:19.162683 29673 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260809 05:34:19.162942 29673 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "ba1ee1916d104effb504563bee76ff04"
format_stamp: "Formatted at 2026-08-09 05:34:19 on dist-test-slave-h3ft"
server_key: "0c4b25dcfc8322f6b4810bc9b02fa4a6"
server_key_iv: "d10d14e7fbe8201d30555319e657486a"
server_key_version: "encryptionkey@0"
I20260809 05:34:19.163266 29673 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:34:19.171195 29673 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:34:19.177280 29673 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:34:19.177726 29673 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:34:19.201464 29673 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:35605
I20260809 05:34:19.201486 29774 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:35605 every 8 connection(s)
I20260809 05:34:19.203575 29673 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:34:19.210047 29777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:34:19.213382 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 29673
I20260809 05:34:19.213625 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:34:19.214192 27364 external_mini_cluster.cc:1428] Setting key 26610ff6d6a908dc9eab21e39a058e8c
I20260809 05:34:19.225806 29780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:19.217303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43605 (local address 127.26.185.62:35605)
0809 05:34:19.218600 (+ 1297us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:19.218618 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:19.218680 (+ 62us) server_negotiation.cc:407] Connection header received
0809 05:34:19.220812 (+ 2132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:19.220849 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:19.221393 (+ 544us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:19.221926 (+ 533us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:19.223528 (+ 1602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:19.223537 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:19.223556 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:34:19.223578 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:19.223676 (+ 98us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:34:19.223703 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:19.223949 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:19.224081 (+ 132us) server_negotiation.cc:299] Negotiation successful
0809 05:34:19.224378 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":992,"thread_start_us":661,"threads_started":1}
I20260809 05:34:19.226382 29777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba1ee1916d104effb504563bee76ff04: Bootstrap starting.
I20260809 05:34:19.230818 27364 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 05:34:19.230875 29777 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba1ee1916d104effb504563bee76ff04: Neither blocks nor log segments found. Creating new log.
I20260809 05:34:19.232303 29777 log.cc:824] T 00000000000000000000000000000000 P ba1ee1916d104effb504563bee76ff04: Log is configured to *not* fsync() on all Append() calls
I20260809 05:34:19.236507 29777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba1ee1916d104effb504563bee76ff04: No bootstrap required, opened a new log
I20260809 05:34:19.240264 29780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:19.236933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34873 (local address 127.26.185.62:35605)
0809 05:34:19.237184 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:19.237193 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:19.237679 (+ 486us) server_negotiation.cc:407] Connection header received
0809 05:34:19.237855 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:19.237861 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:19.237936 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:19.238061 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:19.239337 (+ 1276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:19.239346 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:19.239351 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 05:34:19.239375 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:19.239464 (+ 89us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 05:34:19.239490 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:19.239635 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:19.239788 (+ 153us) server_negotiation.cc:299] Negotiation successful
0809 05:34:19.239863 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 05:34:19.247457 29777 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba1ee1916d104effb504563bee76ff04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba1ee1916d104effb504563bee76ff04" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 35605 } }
I20260809 05:34:19.248021 29777 raft_consensus.cc:374] T 00000000000000000000000000000000 P ba1ee1916d104effb504563bee76ff04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 05:34:19.248160 29777 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba1ee1916d104effb504563bee76ff04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba1ee1916d104effb504563bee76ff04, State: Initialized, Role: FOLLOWER
I20260809 05:34:19.249022 29777 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba1ee1916d104effb504563bee76ff04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba1ee1916d104effb504563bee76ff04" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 35605 } }
I20260809 05:34:19.249315 29777 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba1ee1916d104effb504563bee76ff04 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 05:34:19.249512 29777 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba1ee1916d104effb504563bee76ff04 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 05:34:19.249742 29777 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba1ee1916d104effb504563bee76ff04 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:34:19.252810 29777 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba1ee1916d104effb504563bee76ff04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba1ee1916d104effb504563bee76ff04" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 35605 } }
I20260809 05:34:19.253470 29777 leader_election.cc:302] T 00000000000000000000000000000000 P ba1ee1916d104effb504563bee76ff04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba1ee1916d104effb504563bee76ff04; no voters:
I20260809 05:34:19.254180 29777 leader_election.cc:288] T 00000000000000000000000000000000 P ba1ee1916d104effb504563bee76ff04 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 05:34:19.254397 29795 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba1ee1916d104effb504563bee76ff04 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:34:19.255229 29795 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba1ee1916d104effb504563bee76ff04 [term 1 LEADER]: Becoming Leader. State: Replica: ba1ee1916d104effb504563bee76ff04, State: Running, Role: LEADER
I20260809 05:34:19.256076 29795 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba1ee1916d104effb504563bee76ff04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba1ee1916d104effb504563bee76ff04" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 35605 } }
I20260809 05:34:19.256879 29777 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba1ee1916d104effb504563bee76ff04 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:34:19.260233 29800 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba1ee1916d104effb504563bee76ff04 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba1ee1916d104effb504563bee76ff04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba1ee1916d104effb504563bee76ff04" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 35605 } } }
I20260809 05:34:19.260993 29800 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba1ee1916d104effb504563bee76ff04 [sys.catalog]: This master's current role is: LEADER
I20260809 05:34:19.260221 29801 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba1ee1916d104effb504563bee76ff04 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba1ee1916d104effb504563bee76ff04. Latest consensus state: current_term: 1 leader_uuid: "ba1ee1916d104effb504563bee76ff04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba1ee1916d104effb504563bee76ff04" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 35605 } } }
I20260809 05:34:19.262018 29801 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba1ee1916d104effb504563bee76ff04 [sys.catalog]: This master's current role is: LEADER
I20260809 05:34:19.263809 29810 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:34:19.270172 29810 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:34:19.287827 29810 catalog_manager.cc:1347] Generated new cluster ID: 8d3a6e9ff1624e3fb9e1d6334aeac8a5
I20260809 05:34:19.288028 29810 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:34:19.309885 29810 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:34:19.310645 29810 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:34:19.321116 29810 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ba1ee1916d104effb504563bee76ff04: Generated new TSK 0
I20260809 05:34:19.322686 29810 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 05:34:19.330189 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 29673
W20260809 05:34:19.331689 29768 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:43605
W20260809 05:34:19.332628 27364 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 29673: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 05:34:19.332818 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 29673
2026-08-09T05:34:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2639 ms)
[----------] 18 tests from AuthTokenIssuingTest (47655 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:34:19 dist-test-slave-h3ft krb5kdc[29835](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:34:19 dist-test-slave-h3ft krb5kdc[29835](info): set up 2 sockets
Aug 09 05:34:19 dist-test-slave-h3ft krb5kdc[29835](info): commencing operation
krb5kdc: starting...
W20260809 05:34:20.795683 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.404s user 0.000s sys 0.073s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:34:21 dist-test-slave-h3ft krb5kdc[29835](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253661, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:34:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:34:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
I20260809 05:34:21.264698 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:44941
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:33169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:44941,127.26.185.61:46015,127.26.185.60:42261
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:34:21.712992 29855 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 05:34:21.713471 29855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:34:21.713622 29855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:34:21.713776 29855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:34:21.722244 29855 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:34:21.722391 29855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:34:21.722496 29855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:34:21.722584 29855 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:34:21.722692 29855 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:34:21.735229 29855 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:33169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:44941,127.26.185.61:46015,127.26.185.60:42261
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:44941
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:34:21.737188 29855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:34:21.739099 29855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:34:21.755288 29870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:34:21.755370 29865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:34:21.755244 29864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:34:21.761794 29855 server_base.cc:1034] running on GCE node
I20260809 05:34:21.763304 29855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:34:21.765573 29855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:34:21.767055 29855 hybrid_clock.cc:648] HybridClock initialized: now 1786253661766830 us; error 102 us; skew 500 ppm
I20260809 05:34:21.767582 29855 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:34:21 dist-test-slave-h3ft krb5kdc[29835](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253661, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:34:21.776895 29855 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:34:21.779287 29855 webserver.cc:460] Webserver started at http://127.26.185.62:40371/ using document root <none> and password file <none>
I20260809 05:34:21.780414 29855 fs_manager.cc:359] Metadata directory not provided
I20260809 05:34:21.780602 29855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:34:21.781059 29855 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:34:21.785352 29855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "3a87deb5b6304637bb481fa5b2130103"
format_stamp: "Formatted at 2026-08-09 05:34:21 on dist-test-slave-h3ft"
server_key: "61b8214b791fb072c18e19c1107cdd9c"
server_key_iv: "6bcdcaaec27a92dadb9a08baea7e466c"
server_key_version: "encryptionkey@0"
I20260809 05:34:21.786619 29855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "3a87deb5b6304637bb481fa5b2130103"
format_stamp: "Formatted at 2026-08-09 05:34:21 on dist-test-slave-h3ft"
server_key: "61b8214b791fb072c18e19c1107cdd9c"
server_key_iv: "6bcdcaaec27a92dadb9a08baea7e466c"
server_key_version: "encryptionkey@0"
I20260809 05:34:21.794694 29855 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.001s
I20260809 05:34:21.799957 29882 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:34:21.801947 29855 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 05:34:21.802227 29855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "3a87deb5b6304637bb481fa5b2130103"
format_stamp: "Formatted at 2026-08-09 05:34:21 on dist-test-slave-h3ft"
server_key: "61b8214b791fb072c18e19c1107cdd9c"
server_key_iv: "6bcdcaaec27a92dadb9a08baea7e466c"
server_key_version: "encryptionkey@0"
I20260809 05:34:21.802559 29855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:34:21.832078 29855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:34:21.838186 29855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:34:21.838603 29855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:34:21.862537 29855 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:44941
I20260809 05:34:21.862558 29969 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:44941 every 8 connection(s)
I20260809 05:34:21.864532 29855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:34:21.869531 29970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:34:21.875108 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 29855
I20260809 05:34:21.875398 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:34:21.876160 27364 external_mini_cluster.cc:1428] Setting key 4b920b6153359a58eba433eb3a56f7b6
I20260809 05:34:21.878089 29970 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44941 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 05:34:21 dist-test-slave-h3ft krb5kdc[29835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253661, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:34:21.907961 29978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:21.884337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36138 (local address 127.26.185.62:44941)
0809 05:34:21.885211 (+ 874us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:21.885220 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:21.885283 (+ 63us) server_negotiation.cc:407] Connection header received
0809 05:34:21.886627 (+ 1344us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:21.886634 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:21.886902 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:21.887208 (+ 306us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:21.888755 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:21.890151 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:21.892536 (+ 2385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:21.893491 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:21.893713 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:21.898961 (+ 5248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:21.898972 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:21.898990 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:21.899083 (+ 93us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:21.902335 (+ 3252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:21.903438 (+ 1103us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:21.903447 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:21.903449 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:21.903632 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:21.904145 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:21.904149 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:21.904151 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:21.904834 (+ 683us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:21.905058 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:21.905833 (+ 775us) server_negotiation.cc:299] Negotiation successful
0809 05:34:21.906276 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":6,"server-negotiator.queue_time_us":600,"thread_start_us":394,"threads_started":1}
I20260809 05:34:21.908004 29977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:21.882503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44941 (local address 127.0.0.1:36138)
0809 05:34:21.883657 (+ 1154us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:21.883707 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 05:34:21.886161 (+ 2454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:34:21.887218 (+ 1057us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:34:21.887225 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:34:21.888094 (+ 869us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:34:21.888516 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:21.888537 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:21.890343 (+ 1806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:21.890352 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:21.892357 (+ 2005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:21.892380 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:21.893823 (+ 1443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:21.893833 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:21.894105 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:21.895092 (+ 987us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:34:21.895138 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:34:21.898686 (+ 3548us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:34:21.902509 (+ 3823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:21.902526 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:21.902546 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:21.903254 (+ 708us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:21.903760 (+ 506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:21.903767 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:21.903774 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:21.904025 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:21.905013 (+ 988us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:34:21.905026 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:34:21.905345 (+ 319us) client_negotiation.cc:769] Sending connection context
0809 05:34:21.905683 (+ 338us) client_negotiation.cc:240] Negotiation successful
0809 05:34:21.906493 (+ 810us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":825,"mutex_wait_us":153,"thread_start_us":501,"threads_started":1}
I20260809 05:34:21.912433 29970 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.61" port: 46015 } has no permanent_uuid. Determining permanent_uuid...
I20260809 05:34:21.914052 29977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:21.913360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:46015 (local address 127.0.0.1:56274)
0809 05:34:21.913626 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:21.913803 (+ 177us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.61:46015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260809 05:34:21.914461 29886 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.185.61:46015: connect: Connection refused (error 111)
I20260809 05:34:21.916484 29977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:21.915961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:46015 (local address 127.0.0.1:56282)
0809 05:34:21.916170 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:21.916276 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.61:46015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260809 05:34:21.916733 29970 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.61:46015: Network error: Client connection negotiation failed: client connection to 127.26.185.61:46015: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.26.185.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.61@KRBTEST.COM" created.
I20260809 05:34:21.966166 29970 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.61" port: 46015 } attempt: 1
I20260809 05:34:21.967892 29977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:21.967232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:46015 (local address 127.0.0.1:56292)
0809 05:34:21.967512 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:21.967663 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.61:46015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260809 05:34:21.969223 29977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:21.968691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:46015 (local address 127.0.0.1:56308)
0809 05:34:21.968877 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:21.968987 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.61:46015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 05:34:21.969451 29970 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.61:46015: Network error: Client connection negotiation failed: client connection to 127.26.185.61:46015: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.61.keytab.
Entry for principal kudu/127.26.185.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.61.keytab.
I20260809 05:34:21.976145 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.61:46015
--webserver_interface=127.26.185.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.61.keytab
--principal=kudu/127.26.185.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:33169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:44941,127.26.185.61:46015,127.26.185.60:42261
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:34:22.037791 29970 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.61" port: 46015 } attempt: 2
I20260809 05:34:22.039503 29977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:22.038764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:46015 (local address 127.0.0.1:56316)
0809 05:34:22.039093 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:22.039247 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.61:46015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260809 05:34:22.040988 29977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:22.040386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:46015 (local address 127.0.0.1:56320)
0809 05:34:22.040595 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:22.040744 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.61:46015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260809 05:34:22.041225 29970 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.61:46015: Network error: Client connection negotiation failed: client connection to 127.26.185.61:46015: connect: Connection refused (error 111)
I20260809 05:34:22.132557 29970 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.61" port: 46015 } attempt: 3
I20260809 05:34:22.134322 29977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:22.133625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:46015 (local address 127.0.0.1:56332)
0809 05:34:22.133960 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:22.134111 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.61:46015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260809 05:34:22.135728 29977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:22.135253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:46015 (local address 127.0.0.1:56348)
0809 05:34:22.135415 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:22.135515 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.61:46015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 05:34:22.136062 29970 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.61:46015: Network error: Client connection negotiation failed: client connection to 127.26.185.61:46015: connect: Connection refused (error 111)
I20260809 05:34:22.279428 29970 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.61" port: 46015 } attempt: 4
I20260809 05:34:22.281296 29977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:22.280380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:46015 (local address 127.0.0.1:56352)
0809 05:34:22.280895 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:22.281063 (+ 168us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.61:46015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235}
I20260809 05:34:22.282577 29977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:22.282115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:46015 (local address 127.0.0.1:56368)
0809 05:34:22.282273 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:22.282380 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.61:46015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 05:34:22.282855 29970 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.61:46015: Network error: Client connection negotiation failed: client connection to 127.26.185.61:46015: connect: Connection refused (error 111)
W20260809 05:34:22.409655 29985 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 05:34:22.410142 29985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:34:22.410270 29985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:34:22.410423 29985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:34:22.418290 29985 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:34:22.418407 29985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:34:22.418521 29985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:34:22.418627 29985 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:34:22.418725 29985 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:34:22.429847 29985 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:33169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:44941,127.26.185.61:46015,127.26.185.60:42261
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.61.keytab
--principal=kudu/127.26.185.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.61:46015
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.185.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:34:22.431792 29985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:34:22.433573 29985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:34:22.447564 29991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:34:22.447656 29993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:34:22.447606 29995 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:34:22.448959 29985 server_base.cc:1034] running on GCE node
I20260809 05:34:22.450021 29985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:34:22.451902 29985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:34:22.453245 29985 hybrid_clock.cc:648] HybridClock initialized: now 1786253662453155 us; error 54 us; skew 500 ppm
I20260809 05:34:22.453735 29985 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:34:22 dist-test-slave-h3ft krb5kdc[29835](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253662, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:34:22.458154 29985 init.cc:377] Logged in from keytab as kudu/127.26.185.61@KRBTEST.COM (short username kudu)
I20260809 05:34:22.460191 29985 webserver.cc:460] Webserver started at http://127.26.185.61:36011/ using document root <none> and password file <none>
I20260809 05:34:22.461138 29985 fs_manager.cc:359] Metadata directory not provided
I20260809 05:34:22.461287 29985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:34:22.461675 29985 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:34:22.465508 29985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-1/data/instance:
uuid: "9400062d9e654d8bb4f5bf2f71643105"
format_stamp: "Formatted at 2026-08-09 05:34:22 on dist-test-slave-h3ft"
server_key: "f9f1ebb717101e88608c8e135e305d82"
server_key_iv: "e30ecebfa88bf0344fd41d4ec606d8d8"
server_key_version: "encryptionkey@0"
I20260809 05:34:22.466478 29985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-1/wal/instance:
uuid: "9400062d9e654d8bb4f5bf2f71643105"
format_stamp: "Formatted at 2026-08-09 05:34:22 on dist-test-slave-h3ft"
server_key: "f9f1ebb717101e88608c8e135e305d82"
server_key_iv: "e30ecebfa88bf0344fd41d4ec606d8d8"
server_key_version: "encryptionkey@0"
I20260809 05:34:22.472837 29985 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260809 05:34:22.477128 30008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:34:22.478803 29985 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 05:34:22.479067 29985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-1/wal
uuid: "9400062d9e654d8bb4f5bf2f71643105"
format_stamp: "Formatted at 2026-08-09 05:34:22 on dist-test-slave-h3ft"
server_key: "f9f1ebb717101e88608c8e135e305d82"
server_key_iv: "e30ecebfa88bf0344fd41d4ec606d8d8"
server_key_version: "encryptionkey@0"
I20260809 05:34:22.479346 29985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:34:22.496201 29985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:34:22.501259 29985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:34:22.501622 29985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:34:22.523778 29985 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.61:46015
I20260809 05:34:22.523805 30092 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.61:46015 every 8 connection(s)
I20260809 05:34:22.525575 29985 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-1/data/info.pb
I20260809 05:34:22.530241 30093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:34:22.533193 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 29985
I20260809 05:34:22.533432 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-1/wal/instance
I20260809 05:34:22.534061 27364 external_mini_cluster.cc:1428] Setting key d3dbc19d3d3a34a24aa6a439741a77a8
I20260809 05:34:22.541496 30093 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44941 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 05:34:22 dist-test-slave-h3ft krb5kdc[29835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253662, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.61@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:34:22.573299 30095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:22.545992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36146 (local address 127.26.185.62:44941)
0809 05:34:22.551648 (+ 5656us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:22.551656 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:22.552406 (+ 750us) server_negotiation.cc:407] Connection header received
0809 05:34:22.556200 (+ 3794us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:22.556207 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:22.556334 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:22.556486 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:22.558586 (+ 2100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:22.559542 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:22.561324 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:22.561780 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:22.561930 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:22.566196 (+ 4266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:22.566202 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:22.566205 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:22.566251 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:22.569446 (+ 3195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:22.570376 (+ 930us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:22.570384 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:22.570387 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:22.570540 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:22.571055 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:22.571061 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:22.571071 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:22.571399 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:22.571603 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:22.572526 (+ 923us) server_negotiation.cc:299] Negotiation successful
0809 05:34:22.572830 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5446,"thread_start_us":5234,"threads_started":1}
I20260809 05:34:22.574755 30096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:22.546776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44941 (local address 127.0.0.1:36146)
0809 05:34:22.552132 (+ 5356us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:22.552219 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0809 05:34:22.555705 (+ 3486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:34:22.556845 (+ 1140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:34:22.556856 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:34:22.557567 (+ 711us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:34:22.558329 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:22.558350 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:22.559763 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:22.559767 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:22.561160 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:22.561173 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:22.562043 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:22.562051 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:22.562330 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:22.563262 (+ 932us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:34:22.563292 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:34:22.565907 (+ 2615us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:34:22.569635 (+ 3728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:22.569647 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:22.569672 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:22.570235 (+ 563us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:22.570667 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:22.570672 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:22.570676 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:22.570903 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:22.571568 (+ 665us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:34:22.571578 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:34:22.572090 (+ 512us) client_negotiation.cc:769] Sending connection context
0809 05:34:22.572436 (+ 346us) client_negotiation.cc:240] Negotiation successful
0809 05:34:22.573157 (+ 721us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4936,"thread_start_us":4670,"threads_started":1}
I20260809 05:34:22.577386 30093 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.61" port: 46015 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.26.185.60@KRBTEST.COM; defaulting to no policy
I20260809 05:34:22.582140 29970 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.61" port: 46015 } attempt: 5
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.60@KRBTEST.COM" created.
Aug 09 05:34:22 dist-test-slave-h3ft krb5kdc[29835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253662, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.61@KRBTEST.COM for kudu/127.26.185.61@KRBTEST.COM
Aug 09 05:34:22 dist-test-slave-h3ft krb5kdc[29835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253661, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for kudu/127.26.185.61@KRBTEST.COM
I20260809 05:34:22.598966 30096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:22.578455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:46015 (local address 127.0.0.1:56378)
0809 05:34:22.578721 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:22.578745 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 05:34:22.578895 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:34:22.580223 (+ 1328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:34:22.580230 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:34:22.580821 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:34:22.580991 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:22.581000 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:22.583064 (+ 2064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:22.583073 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:22.584740 (+ 1667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:22.584763 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:22.586307 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:22.586313 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:22.586591 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:22.587448 (+ 857us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:34:22.587474 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:34:22.590735 (+ 3261us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:34:22.595265 (+ 4530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:22.595273 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:22.595279 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:22.595887 (+ 608us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:22.596596 (+ 709us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:22.596603 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:22.596609 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:22.596802 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:22.597758 (+ 956us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:34:22.597768 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:34:22.597941 (+ 173us) client_negotiation.cc:769] Sending connection context
0809 05:34:22.598083 (+ 142us) client_negotiation.cc:240] Negotiation successful
0809 05:34:22.598425 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77,"mutex_wait_us":52}
I20260809 05:34:22.600097 30098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:22.578794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56378 (local address 127.26.185.61:46015)
0809 05:34:22.579643 (+ 849us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:22.579650 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:22.579681 (+ 31us) server_negotiation.cc:407] Connection header received
0809 05:34:22.579733 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:22.579740 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:22.579984 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:22.580134 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:22.581211 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:22.582840 (+ 1629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:22.584926 (+ 2086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:22.586125 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:22.586315 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:22.590978 (+ 4663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:22.591033 (+ 55us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:22.591062 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:22.591112 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:22.595113 (+ 4001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:22.596304 (+ 1191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:22.596317 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:22.596323 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:22.596476 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:22.596910 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:22.596916 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:22.596922 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:22.597488 (+ 566us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:22.597709 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:22.599457 (+ 1748us) server_negotiation.cc:299] Negotiation successful
0809 05:34:22.599772 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":32,"server-negotiator.queue_time_us":665,"thread_start_us":486,"threads_started":1}
I20260809 05:34:22.602803 29977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:22.582904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:46015 (local address 127.0.0.1:56384)
0809 05:34:22.583305 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:22.583334 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 05:34:22.583490 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:34:22.584699 (+ 1209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:34:22.584707 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:34:22.585311 (+ 604us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:34:22.585534 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:22.585545 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:22.587143 (+ 1598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:22.587148 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:22.588686 (+ 1538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:22.588707 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:22.589888 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:22.589897 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:22.590187 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:22.591041 (+ 854us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:34:22.591076 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:34:22.594480 (+ 3404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:34:22.599455 (+ 4975us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:22.599464 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:22.599470 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:22.600108 (+ 638us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:22.600645 (+ 537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:22.600651 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:22.600654 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:22.600842 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:22.601576 (+ 734us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:34:22.601582 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:34:22.601794 (+ 212us) client_negotiation.cc:769] Sending connection context
0809 05:34:22.602022 (+ 228us) client_negotiation.cc:240] Negotiation successful
0809 05:34:22.602407 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227}
I20260809 05:34:22.602975 30099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:22.582925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56384 (local address 127.26.185.61:46015)
0809 05:34:22.584350 (+ 1425us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:22.584356 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:22.584387 (+ 31us) server_negotiation.cc:407] Connection header received
0809 05:34:22.584437 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:22.584444 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:22.584515 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:22.584646 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:22.585718 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:22.586934 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:22.588890 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:22.589683 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:22.594694 (+ 5011us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:22.595042 (+ 348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:22.595052 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:22.595060 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:22.595103 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:22.599262 (+ 4159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:22.600287 (+ 1025us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:22.600294 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:22.600300 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:22.600486 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:22.600980 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:22.600987 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:22.600992 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:22.601424 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:22.601609 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:22.602139 (+ 530us) server_negotiation.cc:299] Negotiation successful
0809 05:34:22.602421 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":1264,"thread_start_us":1094,"threads_started":1}
I20260809 05:34:22.604036 30093 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 } has no permanent_uuid. Determining permanent_uuid...
I20260809 05:34:22.604773 29970 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 } has no permanent_uuid. Determining permanent_uuid...
I20260809 05:34:22.605535 30096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:22.604899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42261 (local address 127.0.0.1:33940)
0809 05:34:22.605123 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:22.605251 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260809 05:34:22.605877 30014 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42261: connect: Connection refused (error 111)
I20260809 05:34:22.607143 29977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:22.605549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42261 (local address 127.0.0.1:33948)
0809 05:34:22.606467 (+ 918us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:22.606553 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":803}
I20260809 05:34:22.607810 30096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:22.607350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42261 (local address 127.0.0.1:33964)
0809 05:34:22.607529 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:22.607653 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 05:34:22.608124 30093 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.60:42261: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42261: connect: Connection refused (error 111)
I20260809 05:34:22.608665 29977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:22.607916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42261 (local address 127.0.0.1:33966)
0809 05:34:22.608408 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:22.608507 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400}
W20260809 05:34:22.608901 29970 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.60:42261: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42261: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.60.keytab.
Entry for principal kudu/127.26.185.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.60.keytab.
I20260809 05:34:22.635258 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.60:42261
--webserver_interface=127.26.185.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.60.keytab
--principal=kudu/127.26.185.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:33169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:44941,127.26.185.61:46015,127.26.185.60:42261
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:34:22.657538 30093 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 } attempt: 1
I20260809 05:34:22.659405 30096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:22.658571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42261 (local address 127.0.0.1:33970)
0809 05:34:22.658908 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:22.659095 (+ 187us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260809 05:34:22.660125 29970 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 } attempt: 1
I20260809 05:34:22.661160 30096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:22.660539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42261 (local address 127.0.0.1:33984)
0809 05:34:22.660792 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:22.660932 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260809 05:34:22.661470 29977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:22.660900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42261 (local address 127.0.0.1:33986)
0809 05:34:22.661114 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:22.661209 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260809 05:34:22.661546 30093 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.60:42261: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42261: connect: Connection refused (error 111)
I20260809 05:34:22.662878 29977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:22.662450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42261 (local address 127.0.0.1:33998)
0809 05:34:22.662643 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:22.662736 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
W20260809 05:34:22.663159 29970 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.60:42261: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42261: connect: Connection refused (error 111)
I20260809 05:34:22.729880 30093 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 } attempt: 2
I20260809 05:34:22.731413 29970 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 } attempt: 2
I20260809 05:34:22.731632 30096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:22.730896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42261 (local address 127.0.0.1:34008)
0809 05:34:22.731213 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:22.731358 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
I20260809 05:34:22.732903 29977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:22.732230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42261 (local address 127.0.0.1:34012)
0809 05:34:22.732475 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:22.732653 (+ 178us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260809 05:34:22.732913 30096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:22.732463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42261 (local address 127.0.0.1:34018)
0809 05:34:22.732655 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:22.732748 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260809 05:34:22.733234 30093 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.60:42261: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42261: connect: Connection refused (error 111)
I20260809 05:34:22.734033 29977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:22.733649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42261 (local address 127.0.0.1:34026)
0809 05:34:22.733841 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:22.733914 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260809 05:34:22.734278 29970 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.60:42261: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42261: connect: Connection refused (error 111)
I20260809 05:34:22.824556 30093 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 } attempt: 3
I20260809 05:34:22.826205 30096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:22.825577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42261 (local address 127.0.0.1:34042)
0809 05:34:22.825841 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:22.825983 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260809 05:34:22.827584 30096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:22.827064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42261 (local address 127.0.0.1:34044)
0809 05:34:22.827342 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:22.827429 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145}
W20260809 05:34:22.827806 30093 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.60:42261: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42261: connect: Connection refused (error 111)
I20260809 05:34:22.840549 29970 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 } attempt: 3
I20260809 05:34:22.841984 29977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:22.841400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42261 (local address 127.0.0.1:34048)
0809 05:34:22.841657 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:22.841776 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260809 05:34:22.843505 29977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:22.842960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42261 (local address 127.0.0.1:34058)
0809 05:34:22.843285 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:22.843382 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151}
W20260809 05:34:22.843822 29970 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.60:42261: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42261: connect: Connection refused (error 111)
I20260809 05:34:22.971098 30093 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 } attempt: 4
I20260809 05:34:22.972853 30096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:22.972047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42261 (local address 127.0.0.1:34072)
0809 05:34:22.972391 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:22.972555 (+ 164us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260809 05:34:22.974092 30096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:22.973673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42261 (local address 127.0.0.1:34084)
0809 05:34:22.973840 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:22.973925 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260809 05:34:22.974432 30093 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.60:42261: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42261: connect: Connection refused (error 111)
I20260809 05:34:23.021121 29970 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 } attempt: 4
I20260809 05:34:23.022698 29977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:23.022095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42261 (local address 127.0.0.1:34094)
0809 05:34:23.022347 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:23.022468 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260809 05:34:23.023967 29977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:23.023566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42261 (local address 127.0.0.1:34104)
0809 05:34:23.023740 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:23.023830 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260809 05:34:23.024283 29970 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.60:42261: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42261: connect: Connection refused (error 111)
W20260809 05:34:23.084626 30104 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 05:34:23.085227 30104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:34:23.085366 30104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:34:23.085530 30104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:34:23.093899 30104 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:34:23.094010 30104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:34:23.094131 30104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:34:23.094228 30104 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:34:23.094352 30104 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:34:23.105993 30104 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:33169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:44941,127.26.185.61:46015,127.26.185.60:42261
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.60.keytab
--principal=kudu/127.26.185.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.60:42261
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.185.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:34:23.108047 30104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:34:23.109833 30104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:34:23.125406 30112 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:34:23.125499 30111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:34:23.125429 30114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:34:23.126647 30104 server_base.cc:1034] running on GCE node
I20260809 05:34:23.127712 30104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:34:23.129539 30104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:34:23.130806 30104 hybrid_clock.cc:648] HybridClock initialized: now 1786253663130727 us; error 47 us; skew 500 ppm
I20260809 05:34:23.131273 30104 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:34:23 dist-test-slave-h3ft krb5kdc[29835](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253663, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:34:23.135344 30104 init.cc:377] Logged in from keytab as kudu/127.26.185.60@KRBTEST.COM (short username kudu)
I20260809 05:34:23.137375 30104 webserver.cc:460] Webserver started at http://127.26.185.60:41255/ using document root <none> and password file <none>
I20260809 05:34:23.138314 30104 fs_manager.cc:359] Metadata directory not provided
I20260809 05:34:23.138418 30104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:34:23.138839 30104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:34:23.142730 30104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-2/data/instance:
uuid: "14b7e6ba199c4cf5b10a3073abb52ad7"
format_stamp: "Formatted at 2026-08-09 05:34:23 on dist-test-slave-h3ft"
server_key: "9b83bfbfb9b3d2ba1da6a22ba702d434"
server_key_iv: "4b324e8aad134c490b240eea5e9380b5"
server_key_version: "encryptionkey@0"
I20260809 05:34:23.143780 30104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-2/wal/instance:
uuid: "14b7e6ba199c4cf5b10a3073abb52ad7"
format_stamp: "Formatted at 2026-08-09 05:34:23 on dist-test-slave-h3ft"
server_key: "9b83bfbfb9b3d2ba1da6a22ba702d434"
server_key_iv: "4b324e8aad134c490b240eea5e9380b5"
server_key_version: "encryptionkey@0"
I20260809 05:34:23.150069 30104 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260809 05:34:23.154415 30123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:34:23.156191 30104 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 05:34:23.156405 30104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-2/wal
uuid: "14b7e6ba199c4cf5b10a3073abb52ad7"
format_stamp: "Formatted at 2026-08-09 05:34:23 on dist-test-slave-h3ft"
server_key: "9b83bfbfb9b3d2ba1da6a22ba702d434"
server_key_iv: "4b324e8aad134c490b240eea5e9380b5"
server_key_version: "encryptionkey@0"
I20260809 05:34:23.156694 30104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:34:23.184445 30104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:34:23.189604 30104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:34:23.189965 30104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:34:23.212285 30104 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.60:42261
I20260809 05:34:23.212312 30207 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.60:42261 every 8 connection(s)
I20260809 05:34:23.214058 30104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-2/data/info.pb
I20260809 05:34:23.215561 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 30104
I20260809 05:34:23.215806 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786253234117492-27364-0/minicluster-data/master-2/wal/instance
I20260809 05:34:23.216464 27364 external_mini_cluster.cc:1428] Setting key b1a995959399f890378c88018d28fe1e
I20260809 05:34:23.220077 30208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:34:23.230237 30208 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44941 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 05:34:23 dist-test-slave-h3ft krb5kdc[29835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253661, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.60@KRBTEST.COM
Aug 09 05:34:23 dist-test-slave-h3ft krb5kdc[29835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253663, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.60@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:34:23.245934 30213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:23.218972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34118 (local address 127.26.185.60:42261)
0809 05:34:23.220049 (+ 1077us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:23.220067 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:23.220124 (+ 57us) server_negotiation.cc:407] Connection header received
0809 05:34:23.222041 (+ 1917us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:23.222069 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:23.222567 (+ 498us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:23.222979 (+ 412us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:23.225244 (+ 2265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.226753 (+ 1509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.228792 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.229588 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.229743 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:23.236008 (+ 6265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:23.236019 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:23.236035 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:23.236080 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:23.240424 (+ 4344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:23.241372 (+ 948us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:23.241378 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:23.241387 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:23.241576 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:23.242073 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:23.242078 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:23.242081 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:23.243033 (+ 952us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:23.243413 (+ 380us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:23.243868 (+ 455us) server_negotiation.cc:299] Negotiation successful
0809 05:34:23.244464 (+ 596us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":733,"thread_start_us":450,"threads_started":1}
I20260809 05:34:23.253232 30214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:23.234298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36150 (local address 127.26.185.62:44941)
0809 05:34:23.235083 (+ 785us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:23.235093 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:23.235618 (+ 525us) server_negotiation.cc:407] Connection header received
0809 05:34:23.235923 (+ 305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:23.235930 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:23.236031 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:23.236134 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:23.237973 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.238934 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.241058 (+ 2124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.241657 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.241818 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:23.245857 (+ 4039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:23.245863 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:23.245867 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:23.245911 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:23.249630 (+ 3719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:23.250667 (+ 1037us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:23.250674 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:23.250678 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:23.250844 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:23.251372 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:23.251377 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:23.251380 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:23.251772 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:23.251908 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:23.252591 (+ 683us) server_negotiation.cc:299] Negotiation successful
0809 05:34:23.252794 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":364,"threads_started":1}
I20260809 05:34:23.253271 30215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:23.234354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:44941 (local address 127.0.0.1:36150)
0809 05:34:23.235454 (+ 1100us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:23.235496 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 05:34:23.235736 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:34:23.236225 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:34:23.236234 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:34:23.237308 (+ 1074us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:34:23.237779 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:23.237798 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.239151 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.239158 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:23.240877 (+ 1719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:23.240888 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.241854 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.241859 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:23.242059 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:23.242774 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:34:23.242797 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:34:23.245621 (+ 2824us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:34:23.249848 (+ 4227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:23.249861 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:23.249869 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:23.250545 (+ 676us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:23.250977 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:23.250984 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:23.250988 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:23.251200 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:23.251929 (+ 729us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:34:23.251941 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:34:23.252193 (+ 252us) client_negotiation.cc:769] Sending connection context
0809 05:34:23.252443 (+ 250us) client_negotiation.cc:240] Negotiation successful
0809 05:34:23.252866 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":843,"thread_start_us":674,"threads_started":1}
I20260809 05:34:23.255204 30208 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.61" port: 46015 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 05:34:23 dist-test-slave-h3ft krb5kdc[29835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253661, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
Aug 09 05:34:23 dist-test-slave-h3ft krb5kdc[29835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253663, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.60@KRBTEST.COM for kudu/127.26.185.61@KRBTEST.COM
I20260809 05:34:23.269984 30216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:23.250216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36154 (local address 127.26.185.62:44941)
0809 05:34:23.250968 (+ 752us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:23.250973 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:23.250994 (+ 21us) server_negotiation.cc:407] Connection header received
0809 05:34:23.251098 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:23.251105 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:23.251173 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:23.251270 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:23.253092 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.254423 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.255928 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.256681 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.256840 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:23.263442 (+ 6602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:23.263449 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:23.263453 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:23.263495 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:23.266648 (+ 3153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:23.267509 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:23.267516 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:23.267522 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:23.267686 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:23.268129 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:23.268133 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:23.268135 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:23.268466 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:23.268806 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:23.269123 (+ 317us) server_negotiation.cc:299] Negotiation successful
0809 05:34:23.269391 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":612,"thread_start_us":343,"threads_started":1}
I20260809 05:34:23.271606 30215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:23.256180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:46015 (local address 127.0.0.1:56390)
0809 05:34:23.256375 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:23.256397 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 05:34:23.256498 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:34:23.257398 (+ 900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:34:23.257402 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:34:23.257957 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:34:23.258133 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:23.258142 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.259898 (+ 1756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.259902 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:23.260963 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:23.260977 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.262054 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.262061 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:23.262296 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:23.262959 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:34:23.262987 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:34:23.265268 (+ 2281us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:34:23.268722 (+ 3454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:23.268727 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:23.268731 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:23.269157 (+ 426us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:23.269583 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:23.269588 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:23.269592 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:23.269760 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:23.270472 (+ 712us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:34:23.270475 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:34:23.270686 (+ 211us) client_negotiation.cc:769] Sending connection context
0809 05:34:23.270867 (+ 181us) client_negotiation.cc:240] Negotiation successful
0809 05:34:23.271265 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 05:34:23.271797 30217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:23.256248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56390 (local address 127.26.185.61:46015)
0809 05:34:23.257013 (+ 765us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:23.257021 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:23.257042 (+ 21us) server_negotiation.cc:407] Connection header received
0809 05:34:23.257117 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:23.257123 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:23.257217 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:23.257363 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:23.258328 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.259733 (+ 1405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.261143 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.261879 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.262027 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:23.265477 (+ 3450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:23.265482 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:23.265486 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:23.265533 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:23.268560 (+ 3027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:23.269289 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:23.269296 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:23.269299 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:23.269451 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:23.269881 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:23.269886 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:23.269891 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:23.270263 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:23.270417 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:23.271097 (+ 680us) server_negotiation.cc:299] Negotiation successful
0809 05:34:23.271426 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":613,"thread_start_us":427,"threads_started":1}
I20260809 05:34:23.273247 30208 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 } has no permanent_uuid. Determining permanent_uuid...
I20260809 05:34:23.273663 30093 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 } attempt: 5
Aug 09 05:34:23 dist-test-slave-h3ft krb5kdc[29835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253662, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.61@KRBTEST.COM for kudu/127.26.185.60@KRBTEST.COM
Aug 09 05:34:23 dist-test-slave-h3ft krb5kdc[29835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253661, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.61@KRBTEST.COM
Aug 09 05:34:23 dist-test-slave-h3ft krb5kdc[29835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253663, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.60@KRBTEST.COM for kudu/127.26.185.60@KRBTEST.COM
I20260809 05:34:23.292016 30215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:23.274269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42261 (local address 127.0.0.1:34128)
0809 05:34:23.274585 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:23.274605 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 05:34:23.274710 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:34:23.275462 (+ 752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:34:23.275468 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:34:23.276047 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:34:23.276251 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:23.276268 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.277720 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.277726 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:23.278971 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:23.278983 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.280264 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.280273 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:23.280545 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:23.281241 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:34:23.281269 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:34:23.284894 (+ 3625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:34:23.288701 (+ 3807us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:23.288708 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:23.288712 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:23.289276 (+ 564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:23.289863 (+ 587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:23.289869 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:23.289875 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:23.290028 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:23.290875 (+ 847us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:34:23.290879 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:34:23.291056 (+ 177us) client_negotiation.cc:769] Sending connection context
0809 05:34:23.291214 (+ 158us) client_negotiation.cc:240] Negotiation successful
0809 05:34:23.291569 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190}
I20260809 05:34:23.292182 30217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:23.272202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56392 (local address 127.26.185.61:46015)
0809 05:34:23.272394 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:23.272398 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:23.272603 (+ 205us) server_negotiation.cc:407] Connection header received
0809 05:34:23.272762 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:23.272767 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:23.272870 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:23.272978 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:23.275047 (+ 2069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.276181 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.277620 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.278296 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.278448 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:23.284938 (+ 6490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:23.284946 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:23.284953 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:23.285001 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:23.288737 (+ 3736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:23.289678 (+ 941us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:23.289684 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:23.289687 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:23.289858 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:23.290367 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:23.290372 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:23.290375 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:23.290731 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:23.290994 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:23.291615 (+ 621us) server_negotiation.cc:299] Negotiation successful
0809 05:34:23.291865 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 05:34:23.292229 30096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:23.274264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42261 (local address 127.0.0.1:34138)
0809 05:34:23.274540 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:23.274560 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 05:34:23.274665 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:34:23.275772 (+ 1107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:34:23.275780 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:34:23.276311 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:34:23.276534 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:23.276546 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.278100 (+ 1554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.278106 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:23.279319 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:23.279332 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.280137 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.280145 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:23.280385 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:23.281055 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:34:23.281081 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:34:23.283727 (+ 2646us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:34:23.288880 (+ 5153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:23.288886 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:23.288891 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:23.289441 (+ 550us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:23.289811 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:23.289816 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:23.289820 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:23.290002 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:23.290799 (+ 797us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:34:23.290804 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:34:23.290976 (+ 172us) client_negotiation.cc:769] Sending connection context
0809 05:34:23.291214 (+ 238us) client_negotiation.cc:240] Negotiation successful
0809 05:34:23.291570 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157}
I20260809 05:34:23.292970 30213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:23.274487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34128 (local address 127.26.185.60:42261)
0809 05:34:23.275110 (+ 623us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:23.275119 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:23.275138 (+ 19us) server_negotiation.cc:407] Connection header received
0809 05:34:23.275201 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:23.275206 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:23.275293 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:23.275402 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:23.276448 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.277606 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.279183 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.279931 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.280102 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:23.285080 (+ 4978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:23.285084 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:23.285087 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:23.285114 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:23.288554 (+ 3440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:23.289416 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:23.289424 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:23.289429 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:23.289763 (+ 334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:23.290149 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:23.290154 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:23.290157 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:23.290679 (+ 522us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:23.290828 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:23.292379 (+ 1551us) server_negotiation.cc:299] Negotiation successful
0809 05:34:23.292667 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":451,"spinlock_wait_cycles":45440}
I20260809 05:34:23.293565 30220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:23.274604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34138 (local address 127.26.185.60:42261)
0809 05:34:23.275477 (+ 873us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:23.275482 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:23.275503 (+ 21us) server_negotiation.cc:407] Connection header received
0809 05:34:23.275547 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:23.275552 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:23.275605 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:23.275718 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:23.276710 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.277969 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.279472 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.279961 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.280326 (+ 365us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:23.283996 (+ 3670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:23.284005 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:23.284013 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:23.284070 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:23.288746 (+ 4676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:23.289551 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:23.289558 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:23.289566 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:23.289695 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:23.290143 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:23.290147 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:23.290150 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:23.290662 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:23.290826 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:23.291319 (+ 493us) server_negotiation.cc:299] Negotiation successful
0809 05:34:23.293094 (+ 1775us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1587,"server-negotiator.queue_time_us":747,"spinlock_wait_cycles":53632,"thread_start_us":896,"threads_started":1}
I20260809 05:34:23.298406 27364 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 05:34:23.301198 30208 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14b7e6ba199c4cf5b10a3073abb52ad7: Bootstrap starting.
I20260809 05:34:23.301198 30093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9400062d9e654d8bb4f5bf2f71643105: Bootstrap starting.
I20260809 05:34:23.301551 29970 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 } attempt: 5
I20260809 05:34:23.301716 29923 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "3a87deb5b6304637bb481fa5b2130103"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36154
I20260809 05:34:23.306320 30208 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 14b7e6ba199c4cf5b10a3073abb52ad7: Neither blocks nor log segments found. Creating new log.
I20260809 05:34:23.306320 30093 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9400062d9e654d8bb4f5bf2f71643105: Neither blocks nor log segments found. Creating new log.
I20260809 05:34:23.308177 30208 log.cc:824] T 00000000000000000000000000000000 P 14b7e6ba199c4cf5b10a3073abb52ad7: Log is configured to *not* fsync() on all Append() calls
I20260809 05:34:23.308511 30093 log.cc:824] T 00000000000000000000000000000000 P 9400062d9e654d8bb4f5bf2f71643105: Log is configured to *not* fsync() on all Append() calls
I20260809 05:34:23.314993 30208 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14b7e6ba199c4cf5b10a3073abb52ad7: No bootstrap required, opened a new log
I20260809 05:34:23.315037 30093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9400062d9e654d8bb4f5bf2f71643105: No bootstrap required, opened a new log
Aug 09 05:34:23 dist-test-slave-h3ft krb5kdc[29835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253661, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for kudu/127.26.185.60@KRBTEST.COM
I20260809 05:34:23.324770 30213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:23.303127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34140 (local address 127.26.185.60:42261)
0809 05:34:23.307184 (+ 4057us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:23.307191 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:23.307215 (+ 24us) server_negotiation.cc:407] Connection header received
0809 05:34:23.307283 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:23.307289 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:23.307395 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:23.307520 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:23.308645 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.309852 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.311851 (+ 1999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.312609 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.312777 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:23.317086 (+ 4309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:23.317097 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:23.317104 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:23.317161 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:23.321578 (+ 4417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:23.322341 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:23.322348 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:23.322353 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:23.322513 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:23.322943 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:23.322950 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:23.322955 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:23.323468 (+ 513us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:23.323632 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:23.324095 (+ 463us) server_negotiation.cc:299] Negotiation successful
0809 05:34:23.324335 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3900}
I20260809 05:34:23.324792 29977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:23.302235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42261 (local address 127.0.0.1:34140)
0809 05:34:23.302665 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:23.302699 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 05:34:23.302847 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:34:23.307575 (+ 4728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:34:23.307582 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:34:23.308198 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:34:23.308472 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:23.308489 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.310019 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.310027 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:23.311646 (+ 1619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:23.311665 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.312797 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.312804 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:23.313054 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:23.313880 (+ 826us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:34:23.313902 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:34:23.316796 (+ 2894us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:34:23.321739 (+ 4943us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:23.321745 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:23.321749 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:23.322200 (+ 451us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:23.322631 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:23.322636 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:23.322640 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:23.322817 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:23.323593 (+ 776us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:34:23.323600 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:34:23.323783 (+ 183us) client_negotiation.cc:769] Sending connection context
0809 05:34:23.323943 (+ 160us) client_negotiation.cc:240] Negotiation successful
0809 05:34:23.324350 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264}
I20260809 05:34:23.327618 30208 raft_consensus.cc:348] T 00000000000000000000000000000000 P 14b7e6ba199c4cf5b10a3073abb52ad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a87deb5b6304637bb481fa5b2130103" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44941 } } peers { permanent_uuid: "9400062d9e654d8bb4f5bf2f71643105" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 46015 } } peers { permanent_uuid: "14b7e6ba199c4cf5b10a3073abb52ad7" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 } }
I20260809 05:34:23.327620 30093 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9400062d9e654d8bb4f5bf2f71643105 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a87deb5b6304637bb481fa5b2130103" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44941 } } peers { permanent_uuid: "9400062d9e654d8bb4f5bf2f71643105" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 46015 } } peers { permanent_uuid: "14b7e6ba199c4cf5b10a3073abb52ad7" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 } }
I20260809 05:34:23.328101 30093 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9400062d9e654d8bb4f5bf2f71643105 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9400062d9e654d8bb4f5bf2f71643105, State: Initialized, Role: FOLLOWER
I20260809 05:34:23.328138 30208 raft_consensus.cc:729] T 00000000000000000000000000000000 P 14b7e6ba199c4cf5b10a3073abb52ad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14b7e6ba199c4cf5b10a3073abb52ad7, State: Initialized, Role: FOLLOWER
I20260809 05:34:23.328774 30093 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9400062d9e654d8bb4f5bf2f71643105 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a87deb5b6304637bb481fa5b2130103" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44941 } } peers { permanent_uuid: "9400062d9e654d8bb4f5bf2f71643105" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 46015 } } peers { permanent_uuid: "14b7e6ba199c4cf5b10a3073abb52ad7" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 } }
I20260809 05:34:23.328756 30208 consensus_queue.cc:260] T 00000000000000000000000000000000 P 14b7e6ba199c4cf5b10a3073abb52ad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a87deb5b6304637bb481fa5b2130103" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44941 } } peers { permanent_uuid: "9400062d9e654d8bb4f5bf2f71643105" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 46015 } } peers { permanent_uuid: "14b7e6ba199c4cf5b10a3073abb52ad7" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 } }
I20260809 05:34:23.329931 30226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14b7e6ba199c4cf5b10a3073abb52ad7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a87deb5b6304637bb481fa5b2130103" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44941 } } peers { permanent_uuid: "9400062d9e654d8bb4f5bf2f71643105" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 46015 } } peers { permanent_uuid: "14b7e6ba199c4cf5b10a3073abb52ad7" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 } } }
I20260809 05:34:23.331071 30227 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9400062d9e654d8bb4f5bf2f71643105 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a87deb5b6304637bb481fa5b2130103" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44941 } } peers { permanent_uuid: "9400062d9e654d8bb4f5bf2f71643105" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 46015 } } peers { permanent_uuid: "14b7e6ba199c4cf5b10a3073abb52ad7" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 } } }
I20260809 05:34:23.331655 30226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14b7e6ba199c4cf5b10a3073abb52ad7 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 05:34:23.331830 30227 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9400062d9e654d8bb4f5bf2f71643105 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 05:34:23.331987 29970 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a87deb5b6304637bb481fa5b2130103: Bootstrap starting.
I20260809 05:34:23.331892 30208 sys_catalog.cc:564] T 00000000000000000000000000000000 P 14b7e6ba199c4cf5b10a3073abb52ad7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:34:23.332423 30093 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9400062d9e654d8bb4f5bf2f71643105 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:34:23.337116 29970 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a87deb5b6304637bb481fa5b2130103: Neither blocks nor log segments found. Creating new log.
I20260809 05:34:23.339601 29970 log.cc:824] T 00000000000000000000000000000000 P 3a87deb5b6304637bb481fa5b2130103: Log is configured to *not* fsync() on all Append() calls
I20260809 05:34:23.347510 29970 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a87deb5b6304637bb481fa5b2130103: No bootstrap required, opened a new log
I20260809 05:34:23.356745 29970 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a87deb5b6304637bb481fa5b2130103 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a87deb5b6304637bb481fa5b2130103" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44941 } } peers { permanent_uuid: "9400062d9e654d8bb4f5bf2f71643105" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 46015 } } peers { permanent_uuid: "14b7e6ba199c4cf5b10a3073abb52ad7" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 } }
I20260809 05:34:23.357911 29970 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a87deb5b6304637bb481fa5b2130103 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a87deb5b6304637bb481fa5b2130103, State: Initialized, Role: FOLLOWER
I20260809 05:34:23.358628 29970 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a87deb5b6304637bb481fa5b2130103 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a87deb5b6304637bb481fa5b2130103" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44941 } } peers { permanent_uuid: "9400062d9e654d8bb4f5bf2f71643105" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 46015 } } peers { permanent_uuid: "14b7e6ba199c4cf5b10a3073abb52ad7" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 } }
W20260809 05:34:23.363436 30259 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9400062d9e654d8bb4f5bf2f71643105: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 05:34:23.363744 30259 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 05:34:23.349072 29985 master_runner.cc:186] Error getting master registration for 127.26.185.62:44941: OK, instance_id { permanent_uuid: "3a87deb5b6304637bb481fa5b2130103" instance_seqno: 1786253661855928 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 05:34:23.364353 29985 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 05:34:23.369331 30268 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a87deb5b6304637bb481fa5b2130103 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a87deb5b6304637bb481fa5b2130103" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44941 } } peers { permanent_uuid: "9400062d9e654d8bb4f5bf2f71643105" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 46015 } } peers { permanent_uuid: "14b7e6ba199c4cf5b10a3073abb52ad7" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 } } }
I20260809 05:34:23.369866 30268 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a87deb5b6304637bb481fa5b2130103 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 05:34:23.372355 29970 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a87deb5b6304637bb481fa5b2130103 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:34:23.372534 29923 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a87deb5b6304637bb481fa5b2130103 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 05:34:23.372848 29923 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a87deb5b6304637bb481fa5b2130103 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:34:23.377990 29923 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a87deb5b6304637bb481fa5b2130103 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a87deb5b6304637bb481fa5b2130103" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44941 } } peers { permanent_uuid: "9400062d9e654d8bb4f5bf2f71643105" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 46015 } } peers { permanent_uuid: "14b7e6ba199c4cf5b10a3073abb52ad7" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 } }
I20260809 05:34:23.382081 30057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3a87deb5b6304637bb481fa5b2130103" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "9400062d9e654d8bb4f5bf2f71643105"
I20260809 05:34:23.382858 30057 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9400062d9e654d8bb4f5bf2f71643105 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:34:23.388527 30057 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9400062d9e654d8bb4f5bf2f71643105 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a87deb5b6304637bb481fa5b2130103 in term 1.
I20260809 05:34:23.389873 29886 leader_election.cc:302] T 00000000000000000000000000000000 P 3a87deb5b6304637bb481fa5b2130103 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a87deb5b6304637bb481fa5b2130103, 9400062d9e654d8bb4f5bf2f71643105; no voters:
I20260809 05:34:23.390740 30268 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a87deb5b6304637bb481fa5b2130103 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:34:23.398861 30167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3a87deb5b6304637bb481fa5b2130103" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "14b7e6ba199c4cf5b10a3073abb52ad7"
I20260809 05:34:23.399724 30167 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 14b7e6ba199c4cf5b10a3073abb52ad7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:34:23.405251 30167 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 14b7e6ba199c4cf5b10a3073abb52ad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a87deb5b6304637bb481fa5b2130103 in term 1.
I20260809 05:34:23.406862 29923 leader_election.cc:288] T 00000000000000000000000000000000 P 3a87deb5b6304637bb481fa5b2130103 [CANDIDATE]: Term 1 election: Requested vote from peers 9400062d9e654d8bb4f5bf2f71643105 (127.26.185.61:46015), 14b7e6ba199c4cf5b10a3073abb52ad7 (127.26.185.60:42261)
I20260809 05:34:23.423260 30268 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a87deb5b6304637bb481fa5b2130103 [term 1 LEADER]: Becoming Leader. State: Replica: 3a87deb5b6304637bb481fa5b2130103, State: Running, Role: LEADER
I20260809 05:34:23.424842 30268 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a87deb5b6304637bb481fa5b2130103 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a87deb5b6304637bb481fa5b2130103" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44941 } } peers { permanent_uuid: "9400062d9e654d8bb4f5bf2f71643105" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 46015 } } peers { permanent_uuid: "14b7e6ba199c4cf5b10a3073abb52ad7" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 } }
W20260809 05:34:23.442716 30134 tablet.cc:2369] T 00000000000000000000000000000000 P 14b7e6ba199c4cf5b10a3073abb52ad7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:34:23.460747 30272 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a87deb5b6304637bb481fa5b2130103 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a87deb5b6304637bb481fa5b2130103. Latest consensus state: current_term: 1 leader_uuid: "3a87deb5b6304637bb481fa5b2130103" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a87deb5b6304637bb481fa5b2130103" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44941 } } peers { permanent_uuid: "9400062d9e654d8bb4f5bf2f71643105" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 46015 } } peers { permanent_uuid: "14b7e6ba199c4cf5b10a3073abb52ad7" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 } } }
I20260809 05:34:23.461933 30272 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a87deb5b6304637bb481fa5b2130103 [sys.catalog]: This master's current role is: LEADER
I20260809 05:34:23.469846 30297 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
W20260809 05:34:23.504987 30023 tablet.cc:2369] T 00000000000000000000000000000000 P 9400062d9e654d8bb4f5bf2f71643105: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 05:34:23.510223 30303 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 05:34:23.515616 30297 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 05:34:23.527578 30304 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 05:34:23.544718 30216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:23.439644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36162 (local address 127.26.185.62:44941)
0809 05:34:23.439878 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:23.439888 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:23.450308 (+ 10420us) server_negotiation.cc:407] Connection header received
0809 05:34:23.450660 (+ 352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:23.450670 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:23.450806 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:23.450906 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:23.471245 (+ 20339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.472919 (+ 1674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.488249 (+ 15330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.489278 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.489439 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:23.504219 (+ 14780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:23.504229 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:23.504235 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:23.504296 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:23.529910 (+ 25614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:23.530838 (+ 928us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:23.530844 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:23.530848 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:23.533339 (+ 2491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:23.533785 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:23.533789 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:23.533793 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:23.534224 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:23.543713 (+ 9489us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:23.543906 (+ 193us) server_negotiation.cc:299] Negotiation successful
0809 05:34:23.544295 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 05:34:23.545109 30167 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 14b7e6ba199c4cf5b10a3073abb52ad7 [term 1 FOLLOWER]: Refusing update from remote peer 3a87deb5b6304637bb481fa5b2130103: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:34:23.545296 30057 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9400062d9e654d8bb4f5bf2f71643105 [term 1 FOLLOWER]: Refusing update from remote peer 3a87deb5b6304637bb481fa5b2130103: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:34:23.545881 30217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:23.437709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56394 (local address 127.26.185.61:46015)
0809 05:34:23.438007 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:23.438017 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:23.445669 (+ 7652us) server_negotiation.cc:407] Connection header received
0809 05:34:23.446134 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:23.446145 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:23.446277 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:23.446390 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:23.476561 (+ 30171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.478201 (+ 1640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.492684 (+ 14483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.493784 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.493952 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:23.519337 (+ 25385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:23.519348 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:23.519354 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:23.519428 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:23.526210 (+ 6782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:23.531975 (+ 5765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:23.531981 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:23.531985 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:23.532188 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:23.534381 (+ 2193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:23.534387 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:23.534390 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:23.534814 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:23.544967 (+ 10153us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:23.545148 (+ 181us) server_negotiation.cc:299] Negotiation successful
0809 05:34:23.545448 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260809 05:34:23.546401 30272 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3a87deb5b6304637bb481fa5b2130103 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9400062d9e654d8bb4f5bf2f71643105" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:34:23.546952 30213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:23.454949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34152 (local address 127.26.185.60:42261)
0809 05:34:23.455288 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:23.455299 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:23.464039 (+ 8740us) server_negotiation.cc:407] Connection header received
0809 05:34:23.464465 (+ 426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:23.464476 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:23.464657 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:23.464763 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:23.483756 (+ 18993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.485388 (+ 1632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.495752 (+ 10364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:23.496828 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:23.496981 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:23.520673 (+ 23692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:23.520682 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:23.520687 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:23.520739 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:23.528470 (+ 7731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:23.532673 (+ 4203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:23.532681 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:23.532685 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:23.532849 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:23.534969 (+ 2120us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:23.534975 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:23.534978 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:23.535390 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:23.535685 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:23.546236 (+ 10551us) server_negotiation.cc:299] Negotiation successful
0809 05:34:23.546573 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260809 05:34:23.552363 30272 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3a87deb5b6304637bb481fa5b2130103 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14b7e6ba199c4cf5b10a3073abb52ad7" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:34:23.513425 30104 master_runner.cc:186] Error getting master registration for 127.26.185.62:44941: OK, instance_id { permanent_uuid: "3a87deb5b6304637bb481fa5b2130103" instance_seqno: 1786253661855928 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 05:34:23.552975 30104 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 05:34:23.572842 30227 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9400062d9e654d8bb4f5bf2f71643105 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a87deb5b6304637bb481fa5b2130103. Latest consensus state: current_term: 1 leader_uuid: "3a87deb5b6304637bb481fa5b2130103" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a87deb5b6304637bb481fa5b2130103" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44941 } } peers { permanent_uuid: "9400062d9e654d8bb4f5bf2f71643105" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 46015 } } peers { permanent_uuid: "14b7e6ba199c4cf5b10a3073abb52ad7" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 } } }
I20260809 05:34:23.573244 30227 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9400062d9e654d8bb4f5bf2f71643105 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 05:34:23.575863 30305 mvcc.cc:205] Tried to move back new op lower bound from 7316495005841420288 to 7316495005420478464. Current Snapshot: MvccSnapshot[applied={T|T < 7316495005841420288}]
I20260809 05:34:23.585141 30226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14b7e6ba199c4cf5b10a3073abb52ad7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a87deb5b6304637bb481fa5b2130103. Latest consensus state: current_term: 1 leader_uuid: "3a87deb5b6304637bb481fa5b2130103" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a87deb5b6304637bb481fa5b2130103" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44941 } } peers { permanent_uuid: "9400062d9e654d8bb4f5bf2f71643105" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 46015 } } peers { permanent_uuid: "14b7e6ba199c4cf5b10a3073abb52ad7" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 } } }
I20260809 05:34:23.585608 30226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14b7e6ba199c4cf5b10a3073abb52ad7 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 05:34:23.594529 30307 mvcc.cc:205] Tried to move back new op lower bound from 7316495005841420288 to 7316495005420478464. Current Snapshot: MvccSnapshot[applied={T|T < 7316495005841420288}]
I20260809 05:34:23.598433 30272 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a87deb5b6304637bb481fa5b2130103 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3a87deb5b6304637bb481fa5b2130103" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a87deb5b6304637bb481fa5b2130103" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44941 } } peers { permanent_uuid: "9400062d9e654d8bb4f5bf2f71643105" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 46015 } } peers { permanent_uuid: "14b7e6ba199c4cf5b10a3073abb52ad7" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 } } }
I20260809 05:34:23.598819 30272 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a87deb5b6304637bb481fa5b2130103 [sys.catalog]: This master's current role is: LEADER
I20260809 05:34:23.599323 30272 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a87deb5b6304637bb481fa5b2130103 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3a87deb5b6304637bb481fa5b2130103" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a87deb5b6304637bb481fa5b2130103" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44941 } } peers { permanent_uuid: "9400062d9e654d8bb4f5bf2f71643105" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 46015 } } peers { permanent_uuid: "14b7e6ba199c4cf5b10a3073abb52ad7" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 } } }
I20260809 05:34:23.599620 30272 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a87deb5b6304637bb481fa5b2130103 [sys.catalog]: This master's current role is: LEADER
I20260809 05:34:23.607471 30226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14b7e6ba199c4cf5b10a3073abb52ad7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3a87deb5b6304637bb481fa5b2130103" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a87deb5b6304637bb481fa5b2130103" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44941 } } peers { permanent_uuid: "9400062d9e654d8bb4f5bf2f71643105" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 46015 } } peers { permanent_uuid: "14b7e6ba199c4cf5b10a3073abb52ad7" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 } } }
I20260809 05:34:23.607815 30226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14b7e6ba199c4cf5b10a3073abb52ad7 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 05:34:23.611052 30227 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9400062d9e654d8bb4f5bf2f71643105 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3a87deb5b6304637bb481fa5b2130103" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a87deb5b6304637bb481fa5b2130103" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 44941 } } peers { permanent_uuid: "9400062d9e654d8bb4f5bf2f71643105" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 46015 } } peers { permanent_uuid: "14b7e6ba199c4cf5b10a3073abb52ad7" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42261 } } }
I20260809 05:34:23.611402 30227 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9400062d9e654d8bb4f5bf2f71643105 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 05:34:23.614794 30297 catalog_manager.cc:1347] Generated new cluster ID: 2ad1807261974c24bdf26ee52d17555e
I20260809 05:34:23.614931 30297 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:34:23.679827 30297 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:34:23.684118 30297 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:34:23.711154 30297 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a87deb5b6304637bb481fa5b2130103: Generated new TSK 0
I20260809 05:34:23.712831 30297 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 05:34:23.837954 27364 mini_kdc.cc:348] Time spent kdestroy: real 0.105s user 0.004s sys 0.040s
W20260809 05:34:23.867118 30217 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:34:23.853623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56406 (local address 127.26.185.61:46015)
0809 05:34:23.853872 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:23.853880 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:23.864405 (+ 10525us) server_negotiation.cc:407] Connection header received
0809 05:34:23.864802 (+ 397us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:23.864810 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:23.864947 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:23.865050 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:23.866733 (+ 1683us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56406: BlockingRecv error: recv got EOF from 127.0.0.1:56406 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260809 05:34:23.870201 30213 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:34:23.867258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34162 (local address 127.26.185.60:42261)
0809 05:34:23.867518 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:23.867529 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:23.868092 (+ 563us) server_negotiation.cc:407] Connection header received
0809 05:34:23.868554 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:23.868560 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:23.868657 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:23.868736 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:23.869901 (+ 1165us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34162: BlockingRecv error: recv got EOF from 127.0.0.1:34162 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
W20260809 05:34:23.881367 30216 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:34:23.853923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36172 (local address 127.26.185.62:44941)
0809 05:34:23.854158 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:23.854168 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:23.866400 (+ 12232us) server_negotiation.cc:407] Connection header received
0809 05:34:23.866605 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:23.866614 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:23.866731 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:23.866854 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:23.881052 (+ 14198us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36172: BlockingRecv error: recv got EOF from 127.0.0.1:36172 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260809 05:34:23.902148 30217 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:34:23.898416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56408 (local address 127.26.185.61:46015)
0809 05:34:23.898669 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:23.898679 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:23.899908 (+ 1229us) server_negotiation.cc:407] Connection header received
0809 05:34:23.900282 (+ 374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:23.900289 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:23.900466 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:23.900622 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:23.901823 (+ 1201us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56408: BlockingRecv error: recv got EOF from 127.0.0.1:56408 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
W20260809 05:34:23.913839 30217 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:34:23.907413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56414 (local address 127.26.185.61:46015)
0809 05:34:23.907670 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:23.907676 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:23.911756 (+ 4080us) server_negotiation.cc:407] Connection header received
0809 05:34:23.912040 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:23.912048 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:23.912168 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:23.912305 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:23.913510 (+ 1205us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56414: BlockingRecv error: recv got EOF from 127.0.0.1:56414 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260809 05:34:23.922511 30217 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:34:23.919848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56430 (local address 127.26.185.61:46015)
0809 05:34:23.920072 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:23.920083 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:23.920707 (+ 624us) server_negotiation.cc:407] Connection header received
0809 05:34:23.920937 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:23.920943 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:23.921050 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:23.921178 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:23.922189 (+ 1011us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56430: BlockingRecv error: recv got EOF from 127.0.0.1:56430 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260809 05:34:23.936296 30217 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:34:23.933205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56440 (local address 127.26.185.61:46015)
0809 05:34:23.933514 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:23.933525 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:23.934196 (+ 671us) server_negotiation.cc:407] Connection header received
0809 05:34:23.934496 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:23.934510 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:23.934637 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:23.934791 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:23.935939 (+ 1148us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56440: BlockingRecv error: recv got EOF from 127.0.0.1:56440 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
W20260809 05:34:23.952194 30217 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:34:23.949067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56442 (local address 127.26.185.61:46015)
0809 05:34:23.949344 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:23.949353 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:23.950070 (+ 717us) server_negotiation.cc:407] Connection header received
0809 05:34:23.950352 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:23.950359 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:23.950564 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:23.950713 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:23.951838 (+ 1125us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56442: BlockingRecv error: recv got EOF from 127.0.0.1:56442 (error 108)
Metrics: {"server-negotiator.queue_time_us":104}
W20260809 05:34:23.975873 30217 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:34:23.972854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56448 (local address 127.26.185.61:46015)
0809 05:34:23.973101 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:23.973108 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:23.973882 (+ 774us) server_negotiation.cc:407] Connection header received
0809 05:34:23.974134 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:23.974142 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:23.974284 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:23.974443 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:23.975526 (+ 1083us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56448: BlockingRecv error: recv got EOF from 127.0.0.1:56448 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260809 05:34:24.015349 30217 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:34:24.012537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56462 (local address 127.26.185.61:46015)
0809 05:34:24.012849 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:24.012856 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:24.013311 (+ 455us) server_negotiation.cc:407] Connection header received
0809 05:34:24.013648 (+ 337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:24.013653 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:24.013746 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:24.013847 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:24.015005 (+ 1158us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56462: BlockingRecv error: recv got EOF from 127.0.0.1:56462 (error 108)
Metrics: {"server-negotiator.queue_time_us":106}
W20260809 05:34:24.086596 30217 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:34:24.084163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56470 (local address 127.26.185.61:46015)
0809 05:34:24.084527 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:24.084536 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:24.084804 (+ 268us) server_negotiation.cc:407] Connection header received
0809 05:34:24.085086 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:24.085091 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:24.085184 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:24.085287 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:24.086300 (+ 1013us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56470: BlockingRecv error: recv got EOF from 127.0.0.1:56470 (error 108)
Metrics: {"server-negotiator.queue_time_us":149}
W20260809 05:34:24.221802 30217 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:34:24.219378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56486 (local address 127.26.185.61:46015)
0809 05:34:24.219654 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:24.219662 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:24.220023 (+ 361us) server_negotiation.cc:407] Connection header received
0809 05:34:24.220250 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:24.220255 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:24.220351 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:24.220457 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:24.221508 (+ 1051us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56486: BlockingRecv error: recv got EOF from 127.0.0.1:56486 (error 108)
Metrics: {"server-negotiator.queue_time_us":111}
I20260809 05:34:24.366545 30259 catalog_manager.cc:1259] Loaded cluster ID: 2ad1807261974c24bdf26ee52d17555e
I20260809 05:34:24.366719 30259 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9400062d9e654d8bb4f5bf2f71643105: loading cluster ID for follower catalog manager: success
I20260809 05:34:24.369737 30259 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9400062d9e654d8bb4f5bf2f71643105: acquiring CA information for follower catalog manager: success
I20260809 05:34:24.371965 30259 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9400062d9e654d8bb4f5bf2f71643105: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 05:34:24.493216 30217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:24.485420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56492 (local address 127.26.185.61:46015)
0809 05:34:24.485778 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:24.485788 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:24.486260 (+ 472us) server_negotiation.cc:407] Connection header received
0809 05:34:24.486596 (+ 336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:24.486601 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:24.486839 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:24.487006 (+ 167us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:34:24.487666 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:24.488569 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:24.490294 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:24.490793 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:24.490999 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:24.491691 (+ 692us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:34:24.492448 (+ 757us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:34:24.492681 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:24.492745 (+ 64us) server_negotiation.cc:299] Negotiation successful
0809 05:34:24.492861 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129}
W20260809 05:34:24.503213 30414 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:34:24.500673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34166 (local address 127.26.185.60:42261)
0809 05:34:24.501275 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:24.501281 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:24.501304 (+ 23us) server_negotiation.cc:407] Connection header received
0809 05:34:24.501583 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:24.501588 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:24.501716 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:24.501834 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:24.502859 (+ 1025us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34166: BlockingRecv error: recv got EOF from 127.0.0.1:34166 (error 108)
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":334,"threads_started":1}
I20260809 05:34:24.516099 30303 catalog_manager.cc:1259] Loaded cluster ID: 2ad1807261974c24bdf26ee52d17555e
I20260809 05:34:24.516285 30303 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 14b7e6ba199c4cf5b10a3073abb52ad7: loading cluster ID for follower catalog manager: success
I20260809 05:34:24.519519 30303 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 14b7e6ba199c4cf5b10a3073abb52ad7: acquiring CA information for follower catalog manager: success
I20260809 05:34:24.521785 30303 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 14b7e6ba199c4cf5b10a3073abb52ad7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 05:34:25.025892 30426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:25.020071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56498 (local address 127.26.185.61:46015)
0809 05:34:25.020697 (+ 626us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:25.020703 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:25.020760 (+ 57us) server_negotiation.cc:407] Connection header received
0809 05:34:25.020996 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:25.021001 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:25.021092 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:25.021201 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:34:25.021721 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:25.022534 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:25.024139 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:25.024611 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:25.024723 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:25.025153 (+ 430us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:34:25.025277 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:34:25.025348 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:25.025483 (+ 135us) server_negotiation.cc:299] Negotiation successful
0809 05:34:25.025581 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":349,"threads_started":1}
I20260809 05:34:25.040642 30436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:25.033860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34176 (local address 127.26.185.60:42261)
0809 05:34:25.034475 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:25.034481 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:25.034501 (+ 20us) server_negotiation.cc:407] Connection header received
0809 05:34:25.034590 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:25.034594 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:25.034806 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:25.034939 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:34:25.035459 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:25.036436 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:25.038131 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:25.038586 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:25.038692 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:25.039286 (+ 594us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:34:25.040031 (+ 745us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:34:25.040166 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:25.040252 (+ 86us) server_negotiation.cc:299] Negotiation successful
0809 05:34:25.040334 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":324,"threads_started":1}
I20260809 05:34:25.059186 30436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:25.049388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34190 (local address 127.26.185.60:42261)
0809 05:34:25.049664 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:25.049674 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:25.052619 (+ 2945us) server_negotiation.cc:407] Connection header received
0809 05:34:25.053019 (+ 400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:25.053026 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:25.053135 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:25.053238 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:34:25.053864 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:25.055081 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:25.057017 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:25.057578 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:25.057711 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:25.058237 (+ 526us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:34:25.058383 (+ 146us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:34:25.058486 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:25.058670 (+ 184us) server_negotiation.cc:299] Negotiation successful
0809 05:34:25.058775 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 05:34:25.059758 30445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:25.048191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36182 (local address 127.26.185.62:44941)
0809 05:34:25.051687 (+ 3496us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:25.051692 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:25.051712 (+ 20us) server_negotiation.cc:407] Connection header received
0809 05:34:25.051847 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:25.051852 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:25.052148 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:25.052436 (+ 288us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:34:25.053470 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:25.054283 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:25.056502 (+ 2219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:25.057213 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:25.057366 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:25.058001 (+ 635us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:34:25.058646 (+ 645us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:34:25.058755 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:25.059298 (+ 543us) server_negotiation.cc:299] Negotiation successful
0809 05:34:25.059430 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3376,"thread_start_us":3259,"threads_started":1}
I20260809 05:34:25.059792 30426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:25.048283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56508 (local address 127.26.185.61:46015)
0809 05:34:25.048595 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:25.048604 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:25.053167 (+ 4563us) server_negotiation.cc:407] Connection header received
0809 05:34:25.053425 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:25.053432 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:25.053572 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:25.053651 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:34:25.054530 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:25.055527 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:25.057524 (+ 1997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:25.058126 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:25.058243 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:25.058850 (+ 607us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:34:25.059058 (+ 208us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:34:25.059127 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:25.059339 (+ 212us) server_negotiation.cc:299] Negotiation successful
0809 05:34:25.059433 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260809 05:34:25.066556 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 29855
I20260809 05:34:25.067932 29961 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:34:25.203073 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 29855
W20260809 05:34:25.233451 30009 connection.cc:535] server connection from 127.0.0.1:56384 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 05:34:25.234232 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 29985
I20260809 05:34:25.235800 30087 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:34:25.364001 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 29985
I20260809 05:34:25.401536 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 30104
I20260809 05:34:25.403188 30200 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:34:25.528815 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 30104
2026-08-09T05:34:25Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (6195 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 05:34:25 dist-test-slave-h3ft krb5kdc[30459](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 05:34:25 dist-test-slave-h3ft krb5kdc[30459](info): set up 2 sockets
Aug 09 05:34:25 dist-test-slave-h3ft krb5kdc[30459](info): commencing operation
krb5kdc: starting...
W20260809 05:34:26.974260 27364 mini_kdc.cc:121] Time spent starting KDC: real 1.388s user 0.000s sys 0.075s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/krb5kdc/test-user.keytab.
Aug 09 05:34:27 dist-test-slave-h3ft krb5kdc[30459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253667, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T05:34:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T05:34:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.185.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
Entry for principal kudu/127.26.185.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab.
I20260809 05:34:27.423442 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:43917
--webserver_interface=127.26.185.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:43143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:43917,127.26.185.61:43095,127.26.185.60:42421
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 05:34:27.860455 30482 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 05:34:27.860980 30482 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:34:27.861119 30482 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:34:27.861260 30482 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:34:27.869580 30482 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:34:27.869714 30482 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:34:27.869825 30482 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:34:27.870011 30482 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:34:27.870128 30482 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:34:27.882563 30482 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:43143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:43917,127.26.185.61:43095,127.26.185.60:42421
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.62.keytab
--principal=kudu/127.26.185.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.62:43917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.185.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:34:27.884603 30482 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:34:27.886423 30482 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:34:27.901248 30489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:34:27.901243 30493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:34:27.901854 30488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:34:27.902351 30482 server_base.cc:1034] running on GCE node
I20260809 05:34:27.903479 30482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:34:27.905301 30482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:34:27.906574 30482 hybrid_clock.cc:648] HybridClock initialized: now 1786253667906500 us; error 37 us; skew 500 ppm
I20260809 05:34:27.907044 30482 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:34:27 dist-test-slave-h3ft krb5kdc[30459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253667, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:34:27.915539 30482 init.cc:377] Logged in from keytab as kudu/127.26.185.62@KRBTEST.COM (short username kudu)
I20260809 05:34:27.917683 30482 webserver.cc:460] Webserver started at http://127.26.185.62:34443/ using document root <none> and password file <none>
I20260809 05:34:27.918777 30482 fs_manager.cc:359] Metadata directory not provided
I20260809 05:34:27.918883 30482 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:34:27.919305 30482 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:34:27.923146 30482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-0/data/instance:
uuid: "ab17d147403b47d2b8810d03d45a0874"
format_stamp: "Formatted at 2026-08-09 05:34:27 on dist-test-slave-h3ft"
server_key: "57c08d26d1cba9cfc1833848e76d875e"
server_key_iv: "4ce732c852583daa0885d21e246f09db"
server_key_version: "encryptionkey@0"
I20260809 05:34:27.924111 30482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-0/wal/instance:
uuid: "ab17d147403b47d2b8810d03d45a0874"
format_stamp: "Formatted at 2026-08-09 05:34:27 on dist-test-slave-h3ft"
server_key: "57c08d26d1cba9cfc1833848e76d875e"
server_key_iv: "4ce732c852583daa0885d21e246f09db"
server_key_version: "encryptionkey@0"
I20260809 05:34:27.930855 30482 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260809 05:34:27.935437 30502 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:34:27.937315 30482 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 05:34:27.937583 30482 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-0/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-0/wal
uuid: "ab17d147403b47d2b8810d03d45a0874"
format_stamp: "Formatted at 2026-08-09 05:34:27 on dist-test-slave-h3ft"
server_key: "57c08d26d1cba9cfc1833848e76d875e"
server_key_iv: "4ce732c852583daa0885d21e246f09db"
server_key_version: "encryptionkey@0"
I20260809 05:34:27.937885 30482 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:34:27.959789 30482 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:34:27.965574 30482 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:34:27.965962 30482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:34:27.989459 30482 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.62:43917
I20260809 05:34:27.989472 30577 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.62:43917 every 8 connection(s)
I20260809 05:34:27.991385 30482 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-0/data/info.pb
I20260809 05:34:27.996579 30579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:34:28.001893 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 30482
I20260809 05:34:28.002161 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-0/wal/instance
I20260809 05:34:28.002887 27364 external_mini_cluster.cc:1428] Setting key 7deaa70cfbe183e5eba91262cd47ad74
I20260809 05:34:28.007079 30579 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43917 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 05:34:28 dist-test-slave-h3ft krb5kdc[30459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253667, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:34:28.035969 30583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.012404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59654 (local address 127.26.185.62:43917)
0809 05:34:28.014560 (+ 2156us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:28.014570 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:28.014642 (+ 72us) server_negotiation.cc:407] Connection header received
0809 05:34:28.016647 (+ 2005us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:28.016655 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:28.016959 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:28.017198 (+ 239us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:28.018755 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:28.020187 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:28.021737 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:28.022391 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:28.022645 (+ 254us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:28.027178 (+ 4533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:28.027187 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:28.027205 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:28.027238 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:28.030499 (+ 3261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:28.031554 (+ 1055us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:28.031562 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:28.031564 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:28.031744 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:28.032352 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:28.032357 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:28.032359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:28.033086 (+ 727us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:28.033286 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:28.034062 (+ 776us) server_negotiation.cc:299] Negotiation successful
0809 05:34:28.034460 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":1896,"thread_start_us":1576,"threads_started":1}
I20260809 05:34:28.036022 30582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.012404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:43917 (local address 127.0.0.1:59654)
0809 05:34:28.013541 (+ 1137us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:28.013598 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 05:34:28.016178 (+ 2580us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:34:28.017221 (+ 1043us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:34:28.017228 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:34:28.018113 (+ 885us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:34:28.018516 (+ 403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:28.018535 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:28.020356 (+ 1821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:28.020364 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:28.021585 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:28.021597 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:28.022699 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:28.022706 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:28.022906 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:28.023795 (+ 889us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:34:28.023820 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:34:28.026818 (+ 2998us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:34:28.030664 (+ 3846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:28.030682 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:28.030700 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:28.031387 (+ 687us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:28.031881 (+ 494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:28.031889 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:28.031895 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:28.032183 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:28.033273 (+ 1090us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:34:28.033285 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:34:28.033595 (+ 310us) client_negotiation.cc:769] Sending connection context
0809 05:34:28.033927 (+ 332us) client_negotiation.cc:240] Negotiation successful
0809 05:34:28.034679 (+ 752us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":799,"mutex_wait_us":82,"thread_start_us":485,"threads_started":1}
I20260809 05:34:28.039988 30579 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43095 } has no permanent_uuid. Determining permanent_uuid...
I20260809 05:34:28.041658 30582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.041031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:43095 (local address 127.0.0.1:53154)
0809 05:34:28.041285 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:28.041457 (+ 172us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.61:43095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
W20260809 05:34:28.042064 30506 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.185.61:43095: connect: Connection refused (error 111)
I20260809 05:34:28.044245 30582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.043763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:43095 (local address 127.0.0.1:53160)
0809 05:34:28.044005 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:28.044096 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.61:43095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260809 05:34:28.044473 30579 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.61:43095: Network error: Client connection negotiation failed: client connection to 127.26.185.61:43095: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.26.185.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.61@KRBTEST.COM" created.
I20260809 05:34:28.094014 30579 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43095 } attempt: 1
I20260809 05:34:28.095829 30582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.095157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:43095 (local address 127.0.0.1:53166)
0809 05:34:28.095409 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:28.095627 (+ 218us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.61:43095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260809 05:34:28.097302 30582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.096723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:43095 (local address 127.0.0.1:53182)
0809 05:34:28.096965 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:28.097108 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.61:43095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260809 05:34:28.097577 30579 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.61:43095: Network error: Client connection negotiation failed: client connection to 127.26.185.61:43095: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.61.keytab.
Entry for principal kudu/127.26.185.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.61.keytab.
I20260809 05:34:28.099573 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.61:43095
--webserver_interface=127.26.185.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.61.keytab
--principal=kudu/127.26.185.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:43143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:43917,127.26.185.61:43095,127.26.185.60:42421
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:34:28.165942 30579 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43095 } attempt: 2
I20260809 05:34:28.167850 30582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.167060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:43095 (local address 127.0.0.1:53198)
0809 05:34:28.167403 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:28.167580 (+ 177us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.61:43095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260809 05:34:28.169314 30582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.168774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:43095 (local address 127.0.0.1:53204)
0809 05:34:28.168959 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:28.169105 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.61:43095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260809 05:34:28.169607 30579 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.61:43095: Network error: Client connection negotiation failed: client connection to 127.26.185.61:43095: connect: Connection refused (error 111)
I20260809 05:34:28.260987 30579 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43095 } attempt: 3
I20260809 05:34:28.262650 30582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.261989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:43095 (local address 127.0.0.1:53212)
0809 05:34:28.262284 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:28.262428 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.61:43095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260809 05:34:28.264096 30582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.263610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:43095 (local address 127.0.0.1:53218)
0809 05:34:28.263794 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:28.263897 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.61:43095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260809 05:34:28.264381 30579 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.61:43095: Network error: Client connection negotiation failed: client connection to 127.26.185.61:43095: connect: Connection refused (error 111)
I20260809 05:34:28.407698 30579 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43095 } attempt: 4
I20260809 05:34:28.409569 30582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.408677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:43095 (local address 127.0.0.1:53232)
0809 05:34:28.409153 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:28.409303 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.61:43095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239}
I20260809 05:34:28.411151 30582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.410581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:43095 (local address 127.0.0.1:53242)
0809 05:34:28.410794 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:28.410907 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.61:43095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260809 05:34:28.411459 30579 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.61:43095: Network error: Client connection negotiation failed: client connection to 127.26.185.61:43095: connect: Connection refused (error 111)
W20260809 05:34:28.533138 30589 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 05:34:28.533596 30589 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:34:28.533725 30589 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:34:28.533874 30589 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:34:28.542201 30589 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:34:28.542320 30589 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:34:28.542419 30589 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:34:28.542519 30589 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:34:28.542634 30589 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:34:28.554229 30589 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:43143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:43917,127.26.185.61:43095,127.26.185.60:42421
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.61.keytab
--principal=kudu/127.26.185.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.61:43095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.185.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:34:28.556188 30589 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:34:28.557897 30589 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:34:28.572256 30597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:34:28.572223 30604 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:34:28.572220 30598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:34:28.573786 30589 server_base.cc:1034] running on GCE node
I20260809 05:34:28.574934 30589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:34:28.576854 30589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:34:28.578102 30589 hybrid_clock.cc:648] HybridClock initialized: now 1786253668578028 us; error 39 us; skew 500 ppm
I20260809 05:34:28.578544 30589 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:34:28 dist-test-slave-h3ft krb5kdc[30459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253668, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:34:28.582726 30589 init.cc:377] Logged in from keytab as kudu/127.26.185.61@KRBTEST.COM (short username kudu)
I20260809 05:34:28.584774 30589 webserver.cc:460] Webserver started at http://127.26.185.61:34603/ using document root <none> and password file <none>
I20260809 05:34:28.585795 30589 fs_manager.cc:359] Metadata directory not provided
I20260809 05:34:28.585945 30589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:34:28.586352 30589 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:34:28.590947 30589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-1/data/instance:
uuid: "6b687a3732574079a04265e93ea424ac"
format_stamp: "Formatted at 2026-08-09 05:34:28 on dist-test-slave-h3ft"
server_key: "09f54833c2dacdc37ac5bfce3903d326"
server_key_iv: "6c60a25afd61dcbbc9acee6d70465974"
server_key_version: "encryptionkey@0"
I20260809 05:34:28.592088 30589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-1/wal/instance:
uuid: "6b687a3732574079a04265e93ea424ac"
format_stamp: "Formatted at 2026-08-09 05:34:28 on dist-test-slave-h3ft"
server_key: "09f54833c2dacdc37ac5bfce3903d326"
server_key_iv: "6c60a25afd61dcbbc9acee6d70465974"
server_key_version: "encryptionkey@0"
I20260809 05:34:28.598726 30589 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260809 05:34:28.603320 30617 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:34:28.605062 30589 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 05:34:28.605307 30589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-1/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-1/wal
uuid: "6b687a3732574079a04265e93ea424ac"
format_stamp: "Formatted at 2026-08-09 05:34:28 on dist-test-slave-h3ft"
server_key: "09f54833c2dacdc37ac5bfce3903d326"
server_key_iv: "6c60a25afd61dcbbc9acee6d70465974"
server_key_version: "encryptionkey@0"
I20260809 05:34:28.605603 30589 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:34:28.625015 30589 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:34:28.629947 30589 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:34:28.630280 30589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:34:28.652335 30589 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.61:43095
I20260809 05:34:28.652348 30693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.61:43095 every 8 connection(s)
I20260809 05:34:28.654075 30589 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-1/data/info.pb
I20260809 05:34:28.657363 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 30589
I20260809 05:34:28.657588 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-1/wal/instance
I20260809 05:34:28.658273 27364 external_mini_cluster.cc:1428] Setting key 23df6219e8f0e7e950ef95e41329f90c
I20260809 05:34:28.659507 30694 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:34:28.671530 30694 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43917 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 05:34:28 dist-test-slave-h3ft krb5kdc[30459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253668, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.61@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
I20260809 05:34:28.701418 30698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.676097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59488 (local address 127.26.185.62:43917)
0809 05:34:28.676887 (+ 790us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:28.676895 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:28.678248 (+ 1353us) server_negotiation.cc:407] Connection header received
0809 05:34:28.681111 (+ 2863us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:28.681120 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:28.681251 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:28.681402 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:28.683457 (+ 2055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:28.684842 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:28.686854 (+ 2012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:28.687674 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:28.687872 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:28.692353 (+ 4481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:28.692365 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:28.692374 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:28.692451 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:28.696835 (+ 4384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:28.697896 (+ 1061us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:28.697905 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:28.697912 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:28.698134 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:28.698666 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:28.698674 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:28.698681 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:28.699240 (+ 559us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:28.699415 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:28.700515 (+ 1100us) server_negotiation.cc:299] Negotiation successful
0809 05:34:28.700837 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":618,"thread_start_us":420,"threads_started":1}
I20260809 05:34:28.702368 30700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.676825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:43917 (local address 127.0.0.1:59488)
0809 05:34:28.677871 (+ 1046us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:28.677953 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0809 05:34:28.680720 (+ 2767us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:34:28.681681 (+ 961us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:34:28.681692 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:34:28.682372 (+ 680us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:34:28.683193 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:28.683217 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:28.685066 (+ 1849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:28.685071 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:28.686646 (+ 1575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:28.686661 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:28.687944 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:28.687951 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:28.688230 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:28.689155 (+ 925us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:34:28.689185 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:34:28.691998 (+ 2813us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:34:28.697058 (+ 5060us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:28.697068 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:28.697092 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:28.697718 (+ 626us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:28.698275 (+ 557us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:28.698279 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:28.698281 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:28.698521 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:28.699389 (+ 868us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:34:28.699397 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:34:28.699926 (+ 529us) client_negotiation.cc:769] Sending connection context
0809 05:34:28.700340 (+ 414us) client_negotiation.cc:240] Negotiation successful
0809 05:34:28.700883 (+ 543us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":680,"thread_start_us":393,"threads_started":1}
WARNING: no policy specified for kudu/127.26.185.60@KRBTEST.COM; defaulting to no policy
I20260809 05:34:28.704713 30694 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43095 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.185.60@KRBTEST.COM" created.
I20260809 05:34:28.710726 30579 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43095 } attempt: 5
Aug 09 05:34:28 dist-test-slave-h3ft krb5kdc[30459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253668, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.61@KRBTEST.COM for kudu/127.26.185.61@KRBTEST.COM
Aug 09 05:34:28 dist-test-slave-h3ft krb5kdc[30459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253667, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for kudu/127.26.185.61@KRBTEST.COM
I20260809 05:34:28.725903 30700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.705702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:43095 (local address 127.0.0.1:53428)
0809 05:34:28.705975 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:28.706004 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 05:34:28.706133 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:34:28.707353 (+ 1220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:34:28.707357 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:34:28.707901 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:34:28.708124 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:28.708136 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:28.709759 (+ 1623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:28.709767 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:28.711443 (+ 1676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:28.711463 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:28.712982 (+ 1519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:28.712991 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:28.713206 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:28.714017 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:34:28.714046 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:34:28.717000 (+ 2954us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:34:28.722223 (+ 5223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:28.722230 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:28.722233 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:28.722794 (+ 561us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:28.723357 (+ 563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:28.723363 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:28.723367 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:28.723561 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:28.724534 (+ 973us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:34:28.724542 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:34:28.724748 (+ 206us) client_negotiation.cc:769] Sending connection context
0809 05:34:28.724914 (+ 166us) client_negotiation.cc:240] Negotiation successful
0809 05:34:28.725312 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73}
I20260809 05:34:28.726051 30703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.705961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53428 (local address 127.26.185.61:43095)
0809 05:34:28.706754 (+ 793us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:28.706761 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:28.706792 (+ 31us) server_negotiation.cc:407] Connection header received
0809 05:34:28.706843 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:28.706850 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:28.707160 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:28.707300 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:28.708318 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:28.709577 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:28.711645 (+ 2068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:28.712817 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:28.712962 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:28.717271 (+ 4309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:28.717291 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:28.717319 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:28.717369 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:28.722066 (+ 4697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:28.722955 (+ 889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:28.722973 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:28.722979 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:28.723188 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:28.723716 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:28.723720 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:28.723721 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:28.724344 (+ 623us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:28.724607 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:28.725148 (+ 541us) server_negotiation.cc:299] Negotiation successful
0809 05:34:28.725538 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":614,"thread_start_us":458,"threads_started":1}
I20260809 05:34:28.729277 30582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.711638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:43095 (local address 127.0.0.1:53442)
0809 05:34:28.712376 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:28.712404 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 05:34:28.712574 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:34:28.713062 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:34:28.713068 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:34:28.713672 (+ 604us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:34:28.713978 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:28.713992 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:28.715757 (+ 1765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:28.715763 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:28.717225 (+ 1462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:28.717239 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:28.718053 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:28.718059 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:28.718327 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:28.718934 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:34:28.718953 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:34:28.721429 (+ 2476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:34:28.725729 (+ 4300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:28.725736 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:28.725740 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:28.726870 (+ 1130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:28.727385 (+ 515us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:28.727391 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:28.727394 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:28.727596 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:28.728173 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:34:28.728178 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:34:28.728365 (+ 187us) client_negotiation.cc:769] Sending connection context
0809 05:34:28.728525 (+ 160us) client_negotiation.cc:240] Negotiation successful
0809 05:34:28.728890 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":548}
I20260809 05:34:28.729324 30704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.711802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53442 (local address 127.26.185.61:43095)
0809 05:34:28.712669 (+ 867us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:28.712674 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:28.712698 (+ 24us) server_negotiation.cc:407] Connection header received
0809 05:34:28.712748 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:28.712752 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:28.712836 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:28.713562 (+ 726us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:28.714184 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:28.715596 (+ 1412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:28.717377 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:28.717884 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:28.718038 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:28.721706 (+ 3668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:28.721713 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:28.721717 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:28.721751 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:28.725553 (+ 3802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:28.727071 (+ 1518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:28.727076 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:28.727079 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:28.727241 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:28.727750 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:28.727753 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:28.727755 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:28.728034 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:28.728192 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:28.728632 (+ 440us) server_negotiation.cc:299] Negotiation successful
0809 05:34:28.728861 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":706,"thread_start_us":860,"threads_started":1}
I20260809 05:34:28.729553 30694 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 } has no permanent_uuid. Determining permanent_uuid...
I20260809 05:34:28.731299 30700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.730722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42421 (local address 127.0.0.1:36420)
0809 05:34:28.730894 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:28.731116 (+ 222us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260809 05:34:28.731334 30579 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 } has no permanent_uuid. Determining permanent_uuid...
W20260809 05:34:28.731608 30621 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42421: connect: Connection refused (error 111)
I20260809 05:34:28.733078 30582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.732469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42421 (local address 127.0.0.1:36430)
0809 05:34:28.732741 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:28.732858 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260809 05:34:28.734237 30582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.733826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42421 (local address 127.0.0.1:36442)
0809 05:34:28.734006 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:28.734109 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 05:34:28.734316 30707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.733087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42421 (local address 127.0.0.1:36438)
0809 05:34:28.733776 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:28.733970 (+ 194us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":427,"threads_started":1}
W20260809 05:34:28.734568 30579 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.60:42421: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42421: connect: Connection refused (error 111)
W20260809 05:34:28.734695 30694 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.60:42421: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42421: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.185.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.60.keytab.
Entry for principal kudu/127.26.185.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.60.keytab.
W20260809 05:34:28.762957 27364 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.26.185.60: real 0.104s user 0.004s sys 0.040s
I20260809 05:34:28.764051 27364 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
/tmp/dist-test-taskaxTOnW/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.60:42421
--webserver_interface=127.26.185.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.60.keytab
--principal=kudu/127.26.185.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.185.20:43143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.185.62:43917,127.26.185.61:43095,127.26.185.60:42421
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 05:34:28.784170 30694 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 } attempt: 1
I20260809 05:34:28.785789 30707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.785185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42421 (local address 127.0.0.1:36452)
0809 05:34:28.785474 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:28.785598 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260809 05:34:28.785833 30579 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 } attempt: 1
I20260809 05:34:28.787308 30582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.786655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42421 (local address 127.0.0.1:36466)
0809 05:34:28.786874 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:28.787061 (+ 187us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260809 05:34:28.787331 30707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.786822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42421 (local address 127.0.0.1:36478)
0809 05:34:28.787061 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:28.787166 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
W20260809 05:34:28.787598 30694 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.60:42421: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42421: connect: Connection refused (error 111)
I20260809 05:34:28.788558 30582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.788180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42421 (local address 127.0.0.1:36488)
0809 05:34:28.788364 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:28.788435 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260809 05:34:28.788825 30579 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.60:42421: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42421: connect: Connection refused (error 111)
I20260809 05:34:28.855844 30694 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 } attempt: 2
I20260809 05:34:28.857059 30579 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 } attempt: 2
I20260809 05:34:28.857566 30707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.856851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42421 (local address 127.0.0.1:36502)
0809 05:34:28.857190 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:28.857332 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145}
I20260809 05:34:28.858557 30582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.857849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42421 (local address 127.0.0.1:36506)
0809 05:34:28.858200 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:28.858312 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183}
I20260809 05:34:28.858901 30707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.858421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42421 (local address 127.0.0.1:36516)
0809 05:34:28.858586 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:28.858696 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 05:34:28.859354 30694 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.60:42421: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42421: connect: Connection refused (error 111)
I20260809 05:34:28.859875 30582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.859423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42421 (local address 127.0.0.1:36518)
0809 05:34:28.859647 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:28.859729 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
W20260809 05:34:28.860126 30579 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.60:42421: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42421: connect: Connection refused (error 111)
I20260809 05:34:28.950668 30694 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 } attempt: 3
I20260809 05:34:28.952515 30707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.951744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42421 (local address 127.0.0.1:36532)
0809 05:34:28.952101 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:28.952261 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260809 05:34:28.954254 30707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.953566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42421 (local address 127.0.0.1:36536)
0809 05:34:28.953883 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:28.954019 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170}
W20260809 05:34:28.954731 30694 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.60:42421: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42421: connect: Connection refused (error 111)
I20260809 05:34:28.966413 30579 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 } attempt: 3
I20260809 05:34:28.968238 30582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.967493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42421 (local address 127.0.0.1:36550)
0809 05:34:28.967801 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:28.967943 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260809 05:34:28.970069 30582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:28.969454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42421 (local address 127.0.0.1:36562)
0809 05:34:28.969720 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:28.969846 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
W20260809 05:34:28.970335 30579 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.60:42421: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42421: connect: Connection refused (error 111)
I20260809 05:34:29.098097 30694 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 } attempt: 4
I20260809 05:34:29.099967 30707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:29.099330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42421 (local address 127.0.0.1:36576)
0809 05:34:29.099594 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:29.099733 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260809 05:34:29.101699 30707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:29.101136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42421 (local address 127.0.0.1:36590)
0809 05:34:29.101407 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:29.101506 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260809 05:34:29.102038 30694 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.60:42421: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42421: connect: Connection refused (error 111)
I20260809 05:34:29.147634 30579 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 } attempt: 4
I20260809 05:34:29.149325 30582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:29.148662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42421 (local address 127.0.0.1:36598)
0809 05:34:29.148991 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:29.149115 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
I20260809 05:34:29.151104 30582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:29.150528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42421 (local address 127.0.0.1:36606)
0809 05:34:29.150784 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:29.150896 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144}
W20260809 05:34:29.151427 30579 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.185.60:42421: Network error: Client connection negotiation failed: client connection to 127.26.185.60:42421: connect: Connection refused (error 111)
W20260809 05:34:29.239107 30708 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 05:34:29.239596 30708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 05:34:29.239678 30708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 05:34:29.239771 30708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 05:34:29.248528 30708 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 05:34:29.248680 30708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 05:34:29.248746 30708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 05:34:29.248796 30708 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 05:34:29.248871 30708 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 05:34:29.260651 30708 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.185.20:43143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.185.62:43917,127.26.185.61:43095,127.26.185.60:42421
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/krb5kdc/kudu_127.26.185.60.keytab
--principal=kudu/127.26.185.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.185.60:42421
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.185.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 03:51:24 UTC on ccycloud.quasar-zwepce.root.comops.site
build id 4575769
ASAN enabled
I20260809 05:34:29.262820 30708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 05:34:29.264804 30708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 05:34:29.279280 30716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:34:29.279233 30719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 05:34:29.279330 30717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 05:34:29.280690 30708 server_base.cc:1034] running on GCE node
I20260809 05:34:29.281693 30708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 05:34:29.283561 30708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 05:34:29.284803 30708 hybrid_clock.cc:648] HybridClock initialized: now 1786253669284712 us; error 62 us; skew 500 ppm
I20260809 05:34:29.285173 30708 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 05:34:29 dist-test-slave-h3ft krb5kdc[30459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253669, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 05:34:29.289165 30708 init.cc:377] Logged in from keytab as kudu/127.26.185.60@KRBTEST.COM (short username kudu)
I20260809 05:34:29.290983 30708 webserver.cc:460] Webserver started at http://127.26.185.60:38189/ using document root <none> and password file <none>
I20260809 05:34:29.291916 30708 fs_manager.cc:359] Metadata directory not provided
I20260809 05:34:29.292014 30708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 05:34:29.292332 30708 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 05:34:29.295984 30708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-2/data/instance:
uuid: "ad38ae9b932040fcb7263a829ba45c5d"
format_stamp: "Formatted at 2026-08-09 05:34:29 on dist-test-slave-h3ft"
server_key: "ed61054656bc6d4f1b7670da4ba7621a"
server_key_iv: "b60a6d0e6d8d95588062d5efe5d5ef16"
server_key_version: "encryptionkey@0"
I20260809 05:34:29.296852 30708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-2/wal/instance:
uuid: "ad38ae9b932040fcb7263a829ba45c5d"
format_stamp: "Formatted at 2026-08-09 05:34:29 on dist-test-slave-h3ft"
server_key: "ed61054656bc6d4f1b7670da4ba7621a"
server_key_iv: "b60a6d0e6d8d95588062d5efe5d5ef16"
server_key_version: "encryptionkey@0"
I20260809 05:34:29.302973 30708 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260809 05:34:29.307516 30727 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 05:34:29.309327 30708 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260809 05:34:29.309573 30708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-2/data,/tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-2/wal
uuid: "ad38ae9b932040fcb7263a829ba45c5d"
format_stamp: "Formatted at 2026-08-09 05:34:29 on dist-test-slave-h3ft"
server_key: "ed61054656bc6d4f1b7670da4ba7621a"
server_key_iv: "b60a6d0e6d8d95588062d5efe5d5ef16"
server_key_version: "encryptionkey@0"
I20260809 05:34:29.309864 30708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 05:34:29.349725 30708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 05:34:29.354743 30708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 05:34:29.355160 30708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 05:34:29.377362 30708 rpc_server.cc:307] RPC server started. Bound to: 127.26.185.60:42421
I20260809 05:34:29.377382 30806 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.185.60:42421 every 8 connection(s)
I20260809 05:34:29.379148 30708 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-2/data/info.pb
I20260809 05:34:29.384375 30807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 05:34:29.386525 27364 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu as pid 30708
I20260809 05:34:29.386790 27364 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskaxTOnW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786253234117492-27364-0/minicluster-data/master-2/wal/instance
I20260809 05:34:29.387490 27364 external_mini_cluster.cc:1428] Setting key c74b2f6c7c964765315c5af0618d4830
I20260809 05:34:29.395969 30807 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43917 } has no permanent_uuid. Determining permanent_uuid...
I20260809 05:34:29.401325 30694 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 } attempt: 5
Aug 09 05:34:29 dist-test-slave-h3ft krb5kdc[30459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253667, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.60@KRBTEST.COM
Aug 09 05:34:29 dist-test-slave-h3ft krb5kdc[30459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253669, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.60@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
Aug 09 05:34:29 dist-test-slave-h3ft krb5kdc[30459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253668, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.61@KRBTEST.COM for kudu/127.26.185.60@KRBTEST.COM
I20260809 05:34:29.418602 30812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:29.389795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36622 (local address 127.26.185.60:42421)
0809 05:34:29.390862 (+ 1067us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:29.390877 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:29.390934 (+ 57us) server_negotiation.cc:407] Connection header received
0809 05:34:29.392829 (+ 1895us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:29.392858 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:29.393364 (+ 506us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:29.393774 (+ 410us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:29.395906 (+ 2132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.397409 (+ 1503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.399163 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.400382 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.401252 (+ 870us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:29.406194 (+ 4942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:29.406206 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:29.406228 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:29.406290 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:29.411355 (+ 5065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:29.412548 (+ 1193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:29.412559 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:29.412571 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:29.412820 (+ 249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:29.413342 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:29.413349 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:29.413356 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:29.414399 (+ 1043us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:29.414772 (+ 373us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:29.416195 (+ 1423us) server_negotiation.cc:299] Negotiation successful
0809 05:34:29.416826 (+ 631us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":800,"thread_start_us":500,"threads_started":1}
I20260809 05:34:29.419130 30814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:29.399307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.62:43917 (local address 127.0.0.1:59492)
0809 05:34:29.400301 (+ 994us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:29.400353 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 05:34:29.400571 (+ 218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:34:29.401038 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:34:29.401046 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:34:29.402067 (+ 1021us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:34:29.402492 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:29.402509 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.404238 (+ 1729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.404246 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:29.406125 (+ 1879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:29.406142 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.406969 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.406975 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:29.407218 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:29.407791 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:34:29.407810 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:34:29.411033 (+ 3223us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:34:29.415525 (+ 4492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:29.415538 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:29.415547 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:29.416196 (+ 649us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:29.416725 (+ 529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:29.416731 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:29.416735 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:29.416910 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:29.417650 (+ 740us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:34:29.417658 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:34:29.417891 (+ 233us) client_negotiation.cc:769] Sending connection context
0809 05:34:29.418205 (+ 314us) client_negotiation.cc:240] Negotiation successful
0809 05:34:29.418634 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":761,"spinlock_wait_cycles":28032,"thread_start_us":570,"threads_started":1}
I20260809 05:34:29.420157 30813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:29.399240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59492 (local address 127.26.185.62:43917)
0809 05:34:29.399920 (+ 680us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:29.399929 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:29.400471 (+ 542us) server_negotiation.cc:407] Connection header received
0809 05:34:29.400727 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:29.400733 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:29.400830 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:29.400965 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:29.402717 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.403994 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.406300 (+ 2306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.406752 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.406936 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:29.411286 (+ 4350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:29.411292 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:29.411295 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:29.411338 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:29.415351 (+ 4013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:29.416348 (+ 997us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:29.416355 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:29.416359 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:29.416575 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:29.417051 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:29.417060 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:29.417065 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:29.417480 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:29.417688 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:29.419612 (+ 1924us) server_negotiation.cc:299] Negotiation successful
0809 05:34:29.419833 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":510,"thread_start_us":331,"threads_started":1}
I20260809 05:34:29.421350 30707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:29.402127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42421 (local address 127.0.0.1:36638)
0809 05:34:29.402515 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:29.402554 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 05:34:29.402738 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:34:29.403639 (+ 901us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:34:29.403644 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:34:29.404135 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:34:29.404316 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:29.404326 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.406148 (+ 1822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.406155 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:29.408287 (+ 2132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:29.408309 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.409444 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.409452 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:29.409646 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:29.410352 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:34:29.410380 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:34:29.413484 (+ 3104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:34:29.418115 (+ 4631us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:29.418121 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:29.418126 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:29.418613 (+ 487us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:29.419369 (+ 756us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:29.419376 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:29.419380 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:29.419568 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:29.420229 (+ 661us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:34:29.420234 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:34:29.420415 (+ 181us) client_negotiation.cc:769] Sending connection context
0809 05:34:29.420565 (+ 150us) client_negotiation.cc:240] Negotiation successful
0809 05:34:29.420933 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212}
I20260809 05:34:29.422354 30807 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43095 } has no permanent_uuid. Determining permanent_uuid...
I20260809 05:34:29.422670 30815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:29.402144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36638 (local address 127.26.185.60:42421)
0809 05:34:29.403322 (+ 1178us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:29.403326 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:29.403345 (+ 19us) server_negotiation.cc:407] Connection header received
0809 05:34:29.403380 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:29.403384 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:29.403435 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:29.403573 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:29.404527 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.405907 (+ 1380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.408472 (+ 2565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.409237 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.409399 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:29.413770 (+ 4371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:29.413779 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:29.413784 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:29.413822 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:29.417955 (+ 4133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:29.418963 (+ 1008us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:29.418968 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:29.418970 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:29.419212 (+ 242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:29.419715 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:29.419720 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:29.419722 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:29.420087 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:29.421752 (+ 1665us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:29.421888 (+ 136us) server_negotiation.cc:299] Negotiation successful
0809 05:34:29.422211 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1073,"thread_start_us":893,"threads_started":1}
I20260809 05:34:29.428689 30579 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 } attempt: 5
I20260809 05:34:29.431133 30694 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b687a3732574079a04265e93ea424ac: Bootstrap starting.
Aug 09 05:34:29 dist-test-slave-h3ft krb5kdc[30459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253667, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.62@KRBTEST.COM
Aug 09 05:34:29 dist-test-slave-h3ft krb5kdc[30459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253669, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.60@KRBTEST.COM for kudu/127.26.185.61@KRBTEST.COM
I20260809 05:34:29.436118 30694 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6b687a3732574079a04265e93ea424ac: Neither blocks nor log segments found. Creating new log.
I20260809 05:34:29.437928 30694 log.cc:824] T 00000000000000000000000000000000 P 6b687a3732574079a04265e93ea424ac: Log is configured to *not* fsync() on all Append() calls
Aug 09 05:34:29 dist-test-slave-h3ft krb5kdc[30459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253667, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.62@KRBTEST.COM for kudu/127.26.185.60@KRBTEST.COM
I20260809 05:34:29.443890 30694 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b687a3732574079a04265e93ea424ac: No bootstrap required, opened a new log
I20260809 05:34:29.446013 30814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:29.423497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.61:43095 (local address 127.0.0.1:53444)
0809 05:34:29.423690 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:29.423711 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 05:34:29.423812 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:34:29.424951 (+ 1139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:34:29.424956 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:34:29.425521 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:34:29.425743 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:29.425755 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.427485 (+ 1730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.427491 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:29.428828 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:29.428843 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.431485 (+ 2642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.431491 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:29.431766 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:29.432457 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:34:29.432480 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:34:29.437299 (+ 4819us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:34:29.442343 (+ 5044us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:29.442348 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:29.442352 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:29.443162 (+ 810us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:29.443729 (+ 567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:29.443736 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:29.443744 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:29.443986 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:29.444874 (+ 888us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:34:29.444879 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:34:29.445100 (+ 221us) client_negotiation.cc:769] Sending connection context
0809 05:34:29.445255 (+ 155us) client_negotiation.cc:240] Negotiation successful
0809 05:34:29.445587 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62,"mutex_wait_us":24}
I20260809 05:34:29.447294 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:29.423949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53444 (local address 127.26.185.61:43095)
0809 05:34:29.424593 (+ 644us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:29.424600 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:29.424622 (+ 22us) server_negotiation.cc:407] Connection header received
0809 05:34:29.424673 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:29.424680 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:29.424768 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:29.424896 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:29.425934 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.427338 (+ 1404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.429032 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.431131 (+ 2099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.431264 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:29.437573 (+ 6309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:29.437581 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:29.437588 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:29.437654 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:29.442162 (+ 4508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:29.443398 (+ 1236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:29.443404 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:29.443407 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:29.443585 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:29.444142 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:29.444147 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:29.444150 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:29.444632 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:29.444791 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:29.446467 (+ 1676us) server_negotiation.cc:299] Negotiation successful
0809 05:34:29.446766 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":486,"thread_start_us":504,"threads_started":1}
I20260809 05:34:29.448140 30582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:29.429350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42421 (local address 127.0.0.1:36644)
0809 05:34:29.429653 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:29.429674 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 05:34:29.429780 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:34:29.430367 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:34:29.430374 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:34:29.430973 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:34:29.431252 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:29.431267 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.432902 (+ 1635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.432910 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:29.434433 (+ 1523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:29.434450 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.435637 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.435644 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:29.435889 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:29.436593 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:34:29.436624 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:34:29.440489 (+ 3865us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:34:29.444890 (+ 4401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:29.444895 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:29.444899 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:29.445544 (+ 645us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:29.446023 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:29.446028 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:29.446032 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:29.446256 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:29.446935 (+ 679us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:34:29.446940 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:34:29.447165 (+ 225us) client_negotiation.cc:769] Sending connection context
0809 05:34:29.447310 (+ 145us) client_negotiation.cc:240] Negotiation successful
0809 05:34:29.447643 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"spinlock_wait_cycles":29568}
I20260809 05:34:29.448460 30813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:29.424262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59494 (local address 127.26.185.62:43917)
0809 05:34:29.424701 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:29.424707 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:29.424724 (+ 17us) server_negotiation.cc:407] Connection header received
0809 05:34:29.424773 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:29.424777 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:29.424881 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:29.426632 (+ 1751us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:29.426799 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.427772 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.429090 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.429722 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.429873 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:29.436605 (+ 6732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:29.436614 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:29.436619 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:29.436665 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:29.443778 (+ 7113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:29.444889 (+ 1111us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:29.444895 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:29.444899 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:29.445084 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:29.445599 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:29.445604 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:29.445607 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:29.446059 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:29.446382 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:29.447893 (+ 1511us) server_negotiation.cc:299] Negotiation successful
0809 05:34:29.448166 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295}
I20260809 05:34:29.448899 30807 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 } has no permanent_uuid. Determining permanent_uuid...
I20260809 05:34:29.449437 30815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:29.429439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36644 (local address 127.26.185.60:42421)
0809 05:34:29.430011 (+ 572us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:29.430017 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:29.430036 (+ 19us) server_negotiation.cc:407] Connection header received
0809 05:34:29.430088 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:29.430094 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:29.430190 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:29.430296 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:29.431481 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.432713 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.434670 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.435438 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.436224 (+ 786us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:29.440776 (+ 4552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:29.440784 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:29.440793 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:29.440841 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:29.444718 (+ 3877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:29.445726 (+ 1008us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:29.445731 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:29.445734 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:29.445866 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:29.446410 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:29.446414 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:29.446417 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:29.446781 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:29.448591 (+ 1810us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:29.448764 (+ 173us) server_negotiation.cc:299] Negotiation successful
0809 05:34:29.449042 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":436}
I20260809 05:34:29.457026 30579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab17d147403b47d2b8810d03d45a0874: Bootstrap starting.
Aug 09 05:34:29 dist-test-slave-h3ft krb5kdc[30459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253669, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.185.60@KRBTEST.COM for kudu/127.26.185.60@KRBTEST.COM
I20260809 05:34:29.461019 30694 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6b687a3732574079a04265e93ea424ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab17d147403b47d2b8810d03d45a0874" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43917 } } peers { permanent_uuid: "6b687a3732574079a04265e93ea424ac" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43095 } } peers { permanent_uuid: "ad38ae9b932040fcb7263a829ba45c5d" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 } }
I20260809 05:34:29.461658 30694 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6b687a3732574079a04265e93ea424ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b687a3732574079a04265e93ea424ac, State: Initialized, Role: FOLLOWER
Aug 09 05:34:29 dist-test-slave-h3ft krb5kdc[30459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786253667, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.185.61@KRBTEST.COM
I20260809 05:34:29.462387 30694 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6b687a3732574079a04265e93ea424ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab17d147403b47d2b8810d03d45a0874" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43917 } } peers { permanent_uuid: "6b687a3732574079a04265e93ea424ac" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43095 } } peers { permanent_uuid: "ad38ae9b932040fcb7263a829ba45c5d" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 } }
I20260809 05:34:29.463806 30579 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ab17d147403b47d2b8810d03d45a0874: Neither blocks nor log segments found. Creating new log.
I20260809 05:34:29.465761 30579 log.cc:824] T 00000000000000000000000000000000 P ab17d147403b47d2b8810d03d45a0874: Log is configured to *not* fsync() on all Append() calls
I20260809 05:34:29.469645 30812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:29.450178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36658 (local address 127.26.185.60:42421)
0809 05:34:29.450321 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:29.450326 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:29.450345 (+ 19us) server_negotiation.cc:407] Connection header received
0809 05:34:29.450446 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:29.450452 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:29.450529 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:29.450601 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:29.451775 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.452946 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.454729 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.455429 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.455539 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:29.460729 (+ 5190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:29.460736 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:29.460741 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:29.460782 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:29.465323 (+ 4541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:29.466528 (+ 1205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:29.466537 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:29.466543 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:29.466725 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:29.467245 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:29.467253 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:29.467260 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:29.467781 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:29.467945 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:29.468685 (+ 740us) server_negotiation.cc:299] Negotiation successful
0809 05:34:29.469069 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 05:34:29.470924 30814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:29.449764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.185.60:42421 (local address 127.0.0.1:36658)
0809 05:34:29.450185 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0809 05:34:29.450208 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 05:34:29.450320 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 05:34:29.450813 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 05:34:29.450818 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 05:34:29.451402 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0809 05:34:29.451630 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:29.451642 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.453160 (+ 1518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.453166 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:29.454577 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 05:34:29.454592 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.455815 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.455821 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 05:34:29.456050 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:29.456844 (+ 794us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 05:34:29.456872 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 05:34:29.460482 (+ 3610us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 05:34:29.465590 (+ 5108us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:29.465599 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:29.465606 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:29.466369 (+ 763us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:29.466898 (+ 529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 05:34:29.466906 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 05:34:29.466912 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 05:34:29.467114 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 05:34:29.468063 (+ 949us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 05:34:29.468071 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 05:34:29.468322 (+ 251us) client_negotiation.cc:769] Sending connection context
0809 05:34:29.469915 (+ 1593us) client_negotiation.cc:240] Negotiation successful
0809 05:34:29.470408 (+ 493us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297}
I20260809 05:34:29.471390 30822 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b687a3732574079a04265e93ea424ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab17d147403b47d2b8810d03d45a0874" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43917 } } peers { permanent_uuid: "6b687a3732574079a04265e93ea424ac" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43095 } } peers { permanent_uuid: "ad38ae9b932040fcb7263a829ba45c5d" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 } } }
I20260809 05:34:29.473246 30822 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b687a3732574079a04265e93ea424ac [sys.catalog]: This master's current role is: FOLLOWER
I20260809 05:34:29.473942 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:29.450946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53450 (local address 127.26.185.61:43095)
0809 05:34:29.451167 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:29.451173 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:29.451192 (+ 19us) server_negotiation.cc:407] Connection header received
0809 05:34:29.451245 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:29.451249 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:29.451389 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:29.451508 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:29.453486 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.454697 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.456579 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.457320 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.457446 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:29.464072 (+ 6626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:29.464081 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:29.464086 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:29.464141 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:29.468757 (+ 4616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:29.470066 (+ 1309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:29.470072 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:29.470075 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:29.470308 (+ 233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:29.470902 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:29.470909 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:29.470913 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:29.471427 (+ 514us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:29.471804 (+ 377us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:29.473290 (+ 1486us) server_negotiation.cc:299] Negotiation successful
0809 05:34:29.473603 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260809 05:34:29.476080 30579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab17d147403b47d2b8810d03d45a0874: No bootstrap required, opened a new log
I20260809 05:34:29.478125 30807 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad38ae9b932040fcb7263a829ba45c5d: Bootstrap starting.
I20260809 05:34:29.483038 27364 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 05:34:29.484493 30694 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6b687a3732574079a04265e93ea424ac [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:34:29.486819 30807 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ad38ae9b932040fcb7263a829ba45c5d: Neither blocks nor log segments found. Creating new log.
I20260809 05:34:29.487063 30539 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "ab17d147403b47d2b8810d03d45a0874"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59494
I20260809 05:34:29.488396 30807 log.cc:824] T 00000000000000000000000000000000 P ad38ae9b932040fcb7263a829ba45c5d: Log is configured to *not* fsync() on all Append() calls
I20260809 05:34:29.488338 30579 raft_consensus.cc:348] T 00000000000000000000000000000000 P ab17d147403b47d2b8810d03d45a0874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab17d147403b47d2b8810d03d45a0874" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43917 } } peers { permanent_uuid: "6b687a3732574079a04265e93ea424ac" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43095 } } peers { permanent_uuid: "ad38ae9b932040fcb7263a829ba45c5d" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 } }
I20260809 05:34:29.488835 30579 raft_consensus.cc:729] T 00000000000000000000000000000000 P ab17d147403b47d2b8810d03d45a0874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab17d147403b47d2b8810d03d45a0874, State: Initialized, Role: FOLLOWER
I20260809 05:34:29.489526 30579 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab17d147403b47d2b8810d03d45a0874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab17d147403b47d2b8810d03d45a0874" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43917 } } peers { permanent_uuid: "6b687a3732574079a04265e93ea424ac" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43095 } } peers { permanent_uuid: "ad38ae9b932040fcb7263a829ba45c5d" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 } }
I20260809 05:34:29.491541 30832 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab17d147403b47d2b8810d03d45a0874 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab17d147403b47d2b8810d03d45a0874" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43917 } } peers { permanent_uuid: "6b687a3732574079a04265e93ea424ac" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43095 } } peers { permanent_uuid: "ad38ae9b932040fcb7263a829ba45c5d" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 } } }
I20260809 05:34:29.492621 30832 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab17d147403b47d2b8810d03d45a0874 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 05:34:29.492930 30579 sys_catalog.cc:564] T 00000000000000000000000000000000 P ab17d147403b47d2b8810d03d45a0874 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:34:29.493073 30539 raft_consensus.cc:482] T 00000000000000000000000000000000 P ab17d147403b47d2b8810d03d45a0874 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 05:34:29.493161 30807 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad38ae9b932040fcb7263a829ba45c5d: No bootstrap required, opened a new log
I20260809 05:34:29.493351 30539 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ab17d147403b47d2b8810d03d45a0874 [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:34:29.499251 30539 raft_consensus.cc:504] T 00000000000000000000000000000000 P ab17d147403b47d2b8810d03d45a0874 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab17d147403b47d2b8810d03d45a0874" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43917 } } peers { permanent_uuid: "6b687a3732574079a04265e93ea424ac" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43095 } } peers { permanent_uuid: "ad38ae9b932040fcb7263a829ba45c5d" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 } }
I20260809 05:34:29.503358 30652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ab17d147403b47d2b8810d03d45a0874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "6b687a3732574079a04265e93ea424ac"
I20260809 05:34:29.504205 30652 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6b687a3732574079a04265e93ea424ac [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:34:29.509517 30652 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6b687a3732574079a04265e93ea424ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab17d147403b47d2b8810d03d45a0874 in term 1.
I20260809 05:34:29.509770 30807 raft_consensus.cc:348] T 00000000000000000000000000000000 P ad38ae9b932040fcb7263a829ba45c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab17d147403b47d2b8810d03d45a0874" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43917 } } peers { permanent_uuid: "6b687a3732574079a04265e93ea424ac" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43095 } } peers { permanent_uuid: "ad38ae9b932040fcb7263a829ba45c5d" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 } }
I20260809 05:34:29.510493 30807 raft_consensus.cc:729] T 00000000000000000000000000000000 P ad38ae9b932040fcb7263a829ba45c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad38ae9b932040fcb7263a829ba45c5d, State: Initialized, Role: FOLLOWER
I20260809 05:34:29.510766 30506 leader_election.cc:302] T 00000000000000000000000000000000 P ab17d147403b47d2b8810d03d45a0874 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b687a3732574079a04265e93ea424ac, ab17d147403b47d2b8810d03d45a0874; no voters:
I20260809 05:34:29.511322 30807 consensus_queue.cc:260] T 00000000000000000000000000000000 P ad38ae9b932040fcb7263a829ba45c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab17d147403b47d2b8810d03d45a0874" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43917 } } peers { permanent_uuid: "6b687a3732574079a04265e93ea424ac" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43095 } } peers { permanent_uuid: "ad38ae9b932040fcb7263a829ba45c5d" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 } }
I20260809 05:34:29.512427 30539 leader_election.cc:288] T 00000000000000000000000000000000 P ab17d147403b47d2b8810d03d45a0874 [CANDIDATE]: Term 1 election: Requested vote from peers 6b687a3732574079a04265e93ea424ac (127.26.185.61:43095), ad38ae9b932040fcb7263a829ba45c5d (127.26.185.60:42421)
I20260809 05:34:29.519542 30832 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ab17d147403b47d2b8810d03d45a0874 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 05:34:29.525301 30807 sys_catalog.cc:564] T 00000000000000000000000000000000 P ad38ae9b932040fcb7263a829ba45c5d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 05:34:29.525378 30770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ab17d147403b47d2b8810d03d45a0874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "ad38ae9b932040fcb7263a829ba45c5d"
I20260809 05:34:29.526048 30770 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ad38ae9b932040fcb7263a829ba45c5d [term 0 FOLLOWER]: Advancing to term 1
I20260809 05:34:29.531626 30770 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ad38ae9b932040fcb7263a829ba45c5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab17d147403b47d2b8810d03d45a0874 in term 1.
I20260809 05:34:29.524883 30846 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad38ae9b932040fcb7263a829ba45c5d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab17d147403b47d2b8810d03d45a0874" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43917 } } peers { permanent_uuid: "6b687a3732574079a04265e93ea424ac" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43095 } } peers { permanent_uuid: "ad38ae9b932040fcb7263a829ba45c5d" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 } } }
I20260809 05:34:29.534760 30846 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad38ae9b932040fcb7263a829ba45c5d [sys.catalog]: This master's current role is: FOLLOWER
I20260809 05:34:29.537504 30832 raft_consensus.cc:686] T 00000000000000000000000000000000 P ab17d147403b47d2b8810d03d45a0874 [term 1 LEADER]: Becoming Leader. State: Replica: ab17d147403b47d2b8810d03d45a0874, State: Running, Role: LEADER
I20260809 05:34:29.538401 30832 consensus_queue.cc:237] T 00000000000000000000000000000000 P ab17d147403b47d2b8810d03d45a0874 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab17d147403b47d2b8810d03d45a0874" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43917 } } peers { permanent_uuid: "6b687a3732574079a04265e93ea424ac" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43095 } } peers { permanent_uuid: "ad38ae9b932040fcb7263a829ba45c5d" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 } }
I20260809 05:34:29.570425 30856 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab17d147403b47d2b8810d03d45a0874 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab17d147403b47d2b8810d03d45a0874. Latest consensus state: current_term: 1 leader_uuid: "ab17d147403b47d2b8810d03d45a0874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab17d147403b47d2b8810d03d45a0874" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43917 } } peers { permanent_uuid: "6b687a3732574079a04265e93ea424ac" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43095 } } peers { permanent_uuid: "ad38ae9b932040fcb7263a829ba45c5d" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 } } }
I20260809 05:34:29.571072 30856 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab17d147403b47d2b8810d03d45a0874 [sys.catalog]: This master's current role is: LEADER
I20260809 05:34:29.572880 30812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:29.535529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36672 (local address 127.26.185.60:42421)
0809 05:34:29.535809 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:29.535818 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:29.536253 (+ 435us) server_negotiation.cc:407] Connection header received
0809 05:34:29.536625 (+ 372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:29.536634 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:29.536758 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:29.536847 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:29.539848 (+ 3001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.541414 (+ 1566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.547193 (+ 5779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.548124 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.548263 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:29.553043 (+ 4780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:29.553055 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:29.553064 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:29.553128 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:29.559695 (+ 6567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:29.564143 (+ 4448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:29.564153 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:29.564160 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:29.564427 (+ 267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:29.567142 (+ 2715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:29.567153 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:29.567158 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:29.567736 (+ 578us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:29.568072 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:29.571758 (+ 3686us) server_negotiation.cc:299] Negotiation successful
0809 05:34:29.572197 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260809 05:34:29.585441 30813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:29.534939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59500 (local address 127.26.185.62:43917)
0809 05:34:29.535299 (+ 360us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:29.535309 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:29.541198 (+ 5889us) server_negotiation.cc:407] Connection header received
0809 05:34:29.542921 (+ 1723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:29.542930 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:29.543092 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:29.543197 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:29.550550 (+ 7353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.552294 (+ 1744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.563360 (+ 11066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.564546 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.564697 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:29.569335 (+ 4638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:29.569346 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:29.569355 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:29.569425 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:29.575792 (+ 6367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:29.581146 (+ 5354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:29.581155 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:29.581160 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:29.581398 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:29.582444 (+ 1046us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:29.582455 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:29.582458 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:29.582958 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:29.583353 (+ 395us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:29.584607 (+ 1254us) server_negotiation.cc:299] Negotiation successful
0809 05:34:29.584959 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132}
I20260809 05:34:29.592545 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:29.539107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53462 (local address 127.26.185.61:43095)
0809 05:34:29.539390 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:29.539400 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:29.543310 (+ 3910us) server_negotiation.cc:407] Connection header received
0809 05:34:29.544730 (+ 1420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:29.544737 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:29.544845 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:29.544923 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:29.556807 (+ 11884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.558282 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.561738 (+ 3456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:29.562640 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:29.562771 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:29.581375 (+ 18604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 05:34:29.581387 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 05:34:29.581396 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 05:34:29.581466 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0809 05:34:29.587692 (+ 6226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:29.589134 (+ 1442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:29.589145 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:29.589151 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:29.589435 (+ 284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 05:34:29.590043 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 05:34:29.590052 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 05:34:29.590058 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 05:34:29.590614 (+ 556us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 05:34:29.591089 (+ 475us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:29.591786 (+ 697us) server_negotiation.cc:299] Negotiation successful
0809 05:34:29.592101 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260809 05:34:29.580451 30482 master_runner.cc:186] Error getting master registration for 127.26.185.61:43095: OK, instance_id { permanent_uuid: "6b687a3732574079a04265e93ea424ac" instance_seqno: 1786253668645995 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 05:34:29.592933 30482 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 05:34:29.602185 30875 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ab17d147403b47d2b8810d03d45a0874: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 05:34:29.602392 30875 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 05:34:29.602532 30876 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 05:34:29.606926 30876 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260809 05:34:29.607995 30737 tablet.cc:2369] T 00000000000000000000000000000000 P ad38ae9b932040fcb7263a829ba45c5d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 05:34:29.611835 30885 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6b687a3732574079a04265e93ea424ac: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 05:34:29.612023 30885 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 05:34:29.605489 30589 master_runner.cc:186] Error getting master registration for 127.26.185.60:42421: OK, instance_id { permanent_uuid: "ad38ae9b932040fcb7263a829ba45c5d" instance_seqno: 1786253669370845 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 05:34:29.632131 30589 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 05:34:29.633584 30625 tablet.cc:2369] T 00000000000000000000000000000000 P 6b687a3732574079a04265e93ea424ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 05:34:29.633544 30907 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ad38ae9b932040fcb7263a829ba45c5d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 05:34:29.633724 30907 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 05:34:29.637744 30770 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ad38ae9b932040fcb7263a829ba45c5d [term 1 FOLLOWER]: Refusing update from remote peer ab17d147403b47d2b8810d03d45a0874: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:34:29.639145 30652 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6b687a3732574079a04265e93ea424ac [term 1 FOLLOWER]: Refusing update from remote peer ab17d147403b47d2b8810d03d45a0874: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 05:34:29.641507 30856 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ab17d147403b47d2b8810d03d45a0874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b687a3732574079a04265e93ea424ac" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:34:29.642426 30856 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ab17d147403b47d2b8810d03d45a0874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad38ae9b932040fcb7263a829ba45c5d" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 05:34:29.686101 30822 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b687a3732574079a04265e93ea424ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab17d147403b47d2b8810d03d45a0874. Latest consensus state: current_term: 1 leader_uuid: "ab17d147403b47d2b8810d03d45a0874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab17d147403b47d2b8810d03d45a0874" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43917 } } peers { permanent_uuid: "6b687a3732574079a04265e93ea424ac" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43095 } } peers { permanent_uuid: "ad38ae9b932040fcb7263a829ba45c5d" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 } } }
I20260809 05:34:29.686578 30822 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b687a3732574079a04265e93ea424ac [sys.catalog]: This master's current role is: FOLLOWER
I20260809 05:34:29.701450 30856 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab17d147403b47d2b8810d03d45a0874 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ab17d147403b47d2b8810d03d45a0874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab17d147403b47d2b8810d03d45a0874" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43917 } } peers { permanent_uuid: "6b687a3732574079a04265e93ea424ac" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43095 } } peers { permanent_uuid: "ad38ae9b932040fcb7263a829ba45c5d" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 } } }
I20260809 05:34:29.701800 30856 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab17d147403b47d2b8810d03d45a0874 [sys.catalog]: This master's current role is: LEADER
I20260809 05:34:29.704218 30822 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b687a3732574079a04265e93ea424ac [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ab17d147403b47d2b8810d03d45a0874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab17d147403b47d2b8810d03d45a0874" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43917 } } peers { permanent_uuid: "6b687a3732574079a04265e93ea424ac" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43095 } } peers { permanent_uuid: "ad38ae9b932040fcb7263a829ba45c5d" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 } } }
I20260809 05:34:29.704596 30822 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b687a3732574079a04265e93ea424ac [sys.catalog]: This master's current role is: FOLLOWER
I20260809 05:34:29.707031 30876 catalog_manager.cc:1347] Generated new cluster ID: 06195efa2d6b42ba86bdc722f78ba1cb
I20260809 05:34:29.707192 30876 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 05:34:29.729046 30846 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad38ae9b932040fcb7263a829ba45c5d [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab17d147403b47d2b8810d03d45a0874. Latest consensus state: current_term: 1 leader_uuid: "ab17d147403b47d2b8810d03d45a0874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab17d147403b47d2b8810d03d45a0874" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43917 } } peers { permanent_uuid: "6b687a3732574079a04265e93ea424ac" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43095 } } peers { permanent_uuid: "ad38ae9b932040fcb7263a829ba45c5d" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 } } }
I20260809 05:34:29.729523 30846 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad38ae9b932040fcb7263a829ba45c5d [sys.catalog]: This master's current role is: FOLLOWER
I20260809 05:34:29.732738 30832 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab17d147403b47d2b8810d03d45a0874 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ab17d147403b47d2b8810d03d45a0874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab17d147403b47d2b8810d03d45a0874" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43917 } } peers { permanent_uuid: "6b687a3732574079a04265e93ea424ac" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43095 } } peers { permanent_uuid: "ad38ae9b932040fcb7263a829ba45c5d" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 } } }
I20260809 05:34:29.733178 30832 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab17d147403b47d2b8810d03d45a0874 [sys.catalog]: This master's current role is: LEADER
I20260809 05:34:29.736918 30913 mvcc.cc:205] Tried to move back new op lower bound from 7316495030776524800 to 7316495030451572736. Current Snapshot: MvccSnapshot[applied={T|T < 7316495030776524800}]
I20260809 05:34:29.752194 30846 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad38ae9b932040fcb7263a829ba45c5d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ab17d147403b47d2b8810d03d45a0874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab17d147403b47d2b8810d03d45a0874" member_type: VOTER last_known_addr { host: "127.26.185.62" port: 43917 } } peers { permanent_uuid: "6b687a3732574079a04265e93ea424ac" member_type: VOTER last_known_addr { host: "127.26.185.61" port: 43095 } } peers { permanent_uuid: "ad38ae9b932040fcb7263a829ba45c5d" member_type: VOTER last_known_addr { host: "127.26.185.60" port: 42421 } } }
I20260809 05:34:29.752553 30846 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad38ae9b932040fcb7263a829ba45c5d [sys.catalog]: This master's current role is: FOLLOWER
I20260809 05:34:29.768807 30876 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 05:34:29.771327 30876 catalog_manager.cc:1504] Loading token signing keys...
I20260809 05:34:29.798945 30876 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ab17d147403b47d2b8810d03d45a0874: Generated new TSK 0
I20260809 05:34:29.804670 30876 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 05:34:29.937875 27364 mini_kdc.cc:348] Time spent kdestroy: real 0.117s user 0.000s sys 0.043s
W20260809 05:34:30.001240 30813 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:34:29.982380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59514 (local address 127.26.185.62:43917)
0809 05:34:29.982657 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:29.982664 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:29.997694 (+ 15030us) server_negotiation.cc:407] Connection header received
0809 05:34:29.999118 (+ 1424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:29.999126 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:29.999247 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:29.999343 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:30.000897 (+ 1554us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59514: BlockingRecv error: recv got EOF from 127.0.0.1:59514 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
W20260809 05:34:30.006990 30819 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:34:29.990977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53474 (local address 127.26.185.61:43095)
0809 05:34:29.991276 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:29.991283 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:30.003168 (+ 11885us) server_negotiation.cc:407] Connection header received
0809 05:34:30.004662 (+ 1494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:30.004670 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:30.004806 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:30.004917 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:30.006601 (+ 1684us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53474: BlockingRecv error: recv got EOF from 127.0.0.1:53474 (error 108)
Metrics: {"server-negotiator.queue_time_us":124}
W20260809 05:34:30.010056 30812 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:34:29.982659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36684 (local address 127.26.185.60:42421)
0809 05:34:29.982890 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:29.982898 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:29.997088 (+ 14190us) server_negotiation.cc:407] Connection header received
0809 05:34:30.007469 (+ 10381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:30.007500 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:30.007660 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:30.007776 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:30.009617 (+ 1841us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36684: BlockingRecv error: recv got EOF from 127.0.0.1:36684 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260809 05:34:30.068390 30819 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:34:30.057663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53478 (local address 127.26.185.61:43095)
0809 05:34:30.057967 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:30.057974 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:30.065286 (+ 7312us) server_negotiation.cc:407] Connection header received
0809 05:34:30.066085 (+ 799us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:30.066093 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:30.066271 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:30.066380 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:30.068054 (+ 1674us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53478: BlockingRecv error: recv got EOF from 127.0.0.1:53478 (error 108)
Metrics: {"server-negotiator.queue_time_us":121}
W20260809 05:34:30.119335 30819 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:34:30.109542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53486 (local address 127.26.185.61:43095)
0809 05:34:30.109816 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:30.109823 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:30.115969 (+ 6146us) server_negotiation.cc:407] Connection header received
0809 05:34:30.116426 (+ 457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:30.116435 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:30.116578 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:30.116690 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:30.118965 (+ 2275us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53486: BlockingRecv error: recv got EOF from 127.0.0.1:53486 (error 108)
Metrics: {"server-negotiator.queue_time_us":103}
W20260809 05:34:30.169914 30819 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:34:30.159662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53500 (local address 127.26.185.61:43095)
0809 05:34:30.159924 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:30.159931 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:30.167200 (+ 7269us) server_negotiation.cc:407] Connection header received
0809 05:34:30.167919 (+ 719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:30.167931 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:30.168076 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:30.168180 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:30.169511 (+ 1331us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53500: BlockingRecv error: recv got EOF from 127.0.0.1:53500 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
W20260809 05:34:30.223680 30819 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:34:30.212834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53516 (local address 127.26.185.61:43095)
0809 05:34:30.213219 (+ 385us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:30.213228 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:30.220904 (+ 7676us) server_negotiation.cc:407] Connection header received
0809 05:34:30.221660 (+ 756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:30.221667 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:30.221802 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:30.221905 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:30.223356 (+ 1451us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53516: BlockingRecv error: recv got EOF from 127.0.0.1:53516 (error 108)
Metrics: {"server-negotiator.queue_time_us":198}
W20260809 05:34:30.280932 30819 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:34:30.270459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53518 (local address 127.26.185.61:43095)
0809 05:34:30.270751 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:30.270759 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:30.278123 (+ 7364us) server_negotiation.cc:407] Connection header received
0809 05:34:30.278835 (+ 712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:30.278843 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:30.278971 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:30.279100 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:30.280582 (+ 1482us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53518: BlockingRecv error: recv got EOF from 127.0.0.1:53518 (error 108)
Metrics: {"server-negotiator.queue_time_us":100}
W20260809 05:34:30.306600 30819 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:34:30.303396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53524 (local address 127.26.185.61:43095)
0809 05:34:30.303688 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:30.303696 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:30.304600 (+ 904us) server_negotiation.cc:407] Connection header received
0809 05:34:30.304900 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:30.304910 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:30.305054 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:30.305219 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:30.306281 (+ 1062us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53524: BlockingRecv error: recv got EOF from 127.0.0.1:53524 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260809 05:34:30.345744 30819 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:34:30.343088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53538 (local address 127.26.185.61:43095)
0809 05:34:30.343329 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:30.343336 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:30.343926 (+ 590us) server_negotiation.cc:407] Connection header received
0809 05:34:30.344131 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:30.344138 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:30.344288 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:30.344429 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:30.345425 (+ 996us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53538: BlockingRecv error: recv got EOF from 127.0.0.1:53538 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
W20260809 05:34:30.416793 30819 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:34:30.414373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53542 (local address 127.26.185.61:43095)
0809 05:34:30.414609 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:30.414614 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:30.415151 (+ 537us) server_negotiation.cc:407] Connection header received
0809 05:34:30.415362 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:30.415367 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:30.415573 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:30.415688 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:30.416568 (+ 880us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53542: BlockingRecv error: recv got EOF from 127.0.0.1:53542 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260809 05:34:30.556026 30819 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 05:34:30.553731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53550 (local address 127.26.185.61:43095)
0809 05:34:30.553971 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:30.553977 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:30.554463 (+ 486us) server_negotiation.cc:407] Connection header received
0809 05:34:30.554652 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:30.554657 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:30.554752 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:30.554864 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 05:34:30.555788 (+ 924us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53550: BlockingRecv error: recv got EOF from 127.0.0.1:53550 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 05:34:30.616398 30885 catalog_manager.cc:1259] Loaded cluster ID: 06195efa2d6b42ba86bdc722f78ba1cb
I20260809 05:34:30.616576 30885 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6b687a3732574079a04265e93ea424ac: loading cluster ID for follower catalog manager: success
I20260809 05:34:30.619979 30885 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6b687a3732574079a04265e93ea424ac: acquiring CA information for follower catalog manager: success
I20260809 05:34:30.623134 30885 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6b687a3732574079a04265e93ea424ac: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 05:34:30.636406 30907 catalog_manager.cc:1259] Loaded cluster ID: 06195efa2d6b42ba86bdc722f78ba1cb
I20260809 05:34:30.636548 30907 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ad38ae9b932040fcb7263a829ba45c5d: loading cluster ID for follower catalog manager: success
I20260809 05:34:30.639658 30907 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ad38ae9b932040fcb7263a829ba45c5d: acquiring CA information for follower catalog manager: success
I20260809 05:34:30.641821 30907 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ad38ae9b932040fcb7263a829ba45c5d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 05:34:30.823712 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:30.816873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53554 (local address 127.26.185.61:43095)
0809 05:34:30.817180 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:30.817188 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:30.817521 (+ 333us) server_negotiation.cc:407] Connection header received
0809 05:34:30.817790 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:30.817795 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:30.818010 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:30.818154 (+ 144us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:34:30.818668 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:30.819518 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:30.820990 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:30.821449 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:30.821605 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:30.822208 (+ 603us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:34:30.822939 (+ 731us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:34:30.823189 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:30.823248 (+ 59us) server_negotiation.cc:299] Negotiation successful
0809 05:34:30.823354 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260809 05:34:30.837651 31038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:30.831180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36688 (local address 127.26.185.60:42421)
0809 05:34:30.831742 (+ 562us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:30.831747 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:30.831825 (+ 78us) server_negotiation.cc:407] Connection header received
0809 05:34:30.832091 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:30.832097 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:30.832305 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:30.832490 (+ 185us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:34:30.832899 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:30.833698 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:30.835160 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:30.835624 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:30.835727 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:30.836284 (+ 557us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:34:30.836986 (+ 702us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:34:30.837188 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:30.837265 (+ 77us) server_negotiation.cc:299] Negotiation successful
0809 05:34:30.837359 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":318,"threads_started":1}
I20260809 05:34:30.865485 31038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:30.850521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36696 (local address 127.26.185.60:42421)
0809 05:34:30.851036 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:30.851046 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:30.857660 (+ 6614us) server_negotiation.cc:407] Connection header received
0809 05:34:30.857943 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:30.857954 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:30.858121 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:30.858242 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:34:30.859574 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:30.860818 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:30.863112 (+ 2294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:30.863767 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:30.863950 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:30.864624 (+ 674us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:34:30.864747 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:34:30.864868 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:30.864991 (+ 123us) server_negotiation.cc:299] Negotiation successful
0809 05:34:30.865101 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202}
I20260809 05:34:30.865983 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:30.849624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53570 (local address 127.26.185.61:43095)
0809 05:34:30.850139 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:30.850149 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:30.859037 (+ 8888us) server_negotiation.cc:407] Connection header received
0809 05:34:30.859192 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:30.859198 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:30.859328 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:30.859470 (+ 142us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:34:30.860367 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:30.861612 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:30.863594 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:30.864270 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:30.864393 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:30.865039 (+ 646us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:34:30.865191 (+ 152us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:34:30.865266 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:30.865523 (+ 257us) server_negotiation.cc:299] Negotiation successful
0809 05:34:30.865626 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260809 05:34:30.867703 31051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 05:34:30.849162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59528 (local address 127.26.185.62:43917)
0809 05:34:30.859439 (+ 10277us) server_negotiation.cc:206] Beginning negotiation
0809 05:34:30.859447 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 05:34:30.859471 (+ 24us) server_negotiation.cc:407] Connection header received
0809 05:34:30.859643 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 05:34:30.859652 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 05:34:30.859958 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 05:34:30.860207 (+ 249us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 05:34:30.860989 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:30.862156 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:30.864287 (+ 2131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 05:34:30.864946 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 05:34:30.865101 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 05:34:30.865906 (+ 805us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 05:34:30.866594 (+ 688us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 05:34:30.867188 (+ 594us) server_negotiation.cc:1035] Waiting for connection context
0809 05:34:30.867247 (+ 59us) server_negotiation.cc:299] Negotiation successful
0809 05:34:30.867359 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10086,"thread_start_us":8361,"threads_started":1}
I20260809 05:34:30.874287 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 30482
I20260809 05:34:30.875488 30567 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:34:31.010319 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 30482
I20260809 05:34:31.040058 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 30589
I20260809 05:34:31.041545 30688 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:34:31.171815 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 30589
I20260809 05:34:31.210769 27364 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu pid 30708
I20260809 05:34:31.212253 30802 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 05:34:31.334683 27364 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskaxTOnW/build/asan/bin/kudu with pid 30708
2026-08-09T05:34:31Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (5805 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (12001 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (437183 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST